Re: gitweb performance/errors

--===============4219155474849710978==
Content-Type: multipart/signed; boundary="Sig_/x=2GaGxTyDtE4jU=7botS8i";
 protocol="application/pgp-signature"; micalg=pgp-sha256

--Sig_/x=2GaGxTyDtE4jU=7botS8i
Content-Type: text/plain; charset=US-ASCII
Content-Transfer-Encoding: quoted-printable

tmknight88--- via Privoxy-users <[email protected]> wrote on =
2026-01-25 at 12:06:35:

> Hi, I wanted to report (assuming you are unaware) that the gitweb interfa=
ce
> of privoxy.git performance has degraded since approximately 23 Jan 2026.
> For example, the summary page can take many seconds to load and frequently
> times out with a generic nginx error message.

Thanks for the report.

I was already aware of the problem but haven't had time to look into solvin=
g it.

The robots.txt already disallows crawling of /gitweb and a bunch
of obvious "AI" bots receive static error pages, but since about
three days ago there are simply too many requests coming in from
clients that ignore the robots.txt and don't use obvious "AI" bot
User-Agent headers either.

Looks like we need more crawler counter measures.

Fabian

--Sig_/x=2GaGxTyDtE4jU=7botS8i
Content-Type: application/pgp-signature
Content-Description: OpenPGP digital signature

-----BEGIN PGP SIGNATURE-----

iQIzBAEBCAAdFiEETzbBfzgWkTZUoehQaRgikYuiNxwFAml2WoQACgkQaRgikYui
NxwRag//bKSnOUBN5cZrXLQk/qySZaAg8MBb/1mRFO8lV4HFTKdtBLvnoBrXd/IG
p3ZdzMKORPDxBAT66W4VhkqNbzkA/u50Px0TOZWnxqGmkZEdBmRWBJP9roodTTsG
/A0S3Dv3/aavclRQdybyWQkQd6mAsB+pMkYE8hKrfKSCnn9iK5KcN2xWZDk/ziVJ
xCQipXkhBQLTpPGC02EnX9z5xyEIznUxLsSSWTcyIoBbx3O8/QG/t9WeOynr0bAk
W5O1fksiYiwdGeT5IuFnMtUmeT2BoL31z9PJ18Ch/cdrYUv9g4p28r7UW79bHnVv
08l5SsqgOmEJVjcxD1PCTtZ91t5RAKipBJF2ZSBeWmC1zsEBU5U2ZKXbjb79q+6h
m5NekbvQWBaDqLgGMUxVqnPGbRvf/oWD6xhmUxCCVGffHSOC5IP8UNz+KZfptcJV
Tq+EnvXRaJWOLs7dY7chpcm9+VqbtOCQ9VDS7B50I2+XxFSQ7ZPf22JXWhthv/vz
lQxFuMvxtgpCP5YGb+zJJsaWkXeiOBI+e2s7Wh2Tt21AMJLVDmyFqKovyU5McAGf
hVR5ulCCfxTqEYGru1KwUV5WgZxCxL+KZrNp0IstfN0QGaqCdaAPNJ018ssUEofh
gwfapy+PC5oyasC2v7w9tl6+22XF7W0rdqDR83iHs0PPGTH4oL0=
=tJmq
-----END PGP SIGNATURE-----

--Sig_/x=2GaGxTyDtE4jU=7botS8i--

--===============4219155474849710978==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
Privoxy-users mailing list
[email protected]
https://lists.privoxy.org/mailman/listinfo/privoxy-users

--===============4219155474849710978==--