bits from the ci.debian.net operators

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA512

Hi all,

We wanted to share some information, so here is a bits from the ci.debian.net
team.

Surviving scraper traffic
=========================

Like most of the open web, Debian Continuous Integration has been struggling
for a while to keep up with the insatiable hunger from data scrapers
everywhere. Solving this involved a lot of trial and error; the final result
seems to be stable, and consists of two parts.

First, all Debian CI data pages, except the direct links to test log files
(such as those provided by the Release Team's testing migration excuses), now
require users to be authenticated before being accessed. This means that the
Debian CI data is no longer publicly browseable, which is a bit sad. However,
this is where we are now.

Additionally, there is now a fail2ban powered firewall-level access limitation
for clients that display an abusive access pattern. This went through several
iterations, with some of them unfortunately blocking legitimate Debian
contributors, but the current state seems to strike a good balance between
blocking scrapers and not blocking real users. Please get in touch with the
team on the #debci OFTC channel if you are affected by this.


support questions
=================

Please feel free to ask your questions about autopkgtest or its test results on
the #debci OFTC channel. If your prefer e-mail, you can use
[email protected]. Please be aware that we are not the same team as the one that
operates salsa-ci.


On behalf of the team,
Paul




-----BEGIN PGP SIGNATURE-----

iQIzBAEBCgAdFiEEG5OTVaxMNcrfvXOcBqMo4AxqzhUFAmmEV/IACgkQBqMo4Axq
zhV0RQ//cqnHyg53xW4wWon4PMJ8P69yAqgMd0SD8U3pEI5Nd49T4oGTz25HRqKb
FHS7zLAXmDKvB/g501C1CNqvdq/+dhFAq8gIXus3sIPJs6xtWHZZC5HgvxXeUPmn
Fsx3UsKIVeEJCoBfrImC3D2xTtF4fjZxIEpk7Vhtxc3FPMohk7I0A46qPYFA3F+6
oKXyTBq5wInDhpO6Ns9bub13bayWu4VaHVvORYZUXdH8A+XL7xEgVnY/fvai7fMg
/gqzO/5qn9pMR3X2cL/MG3q1pSbL4lrKV71m1vvokVurmxXI0TEtOxh5utaY4Ej/
1avrSOX1G/0JqL3QsLpcoS6b0FB8xfe6tVu/bHGPgUoUixenxctOapGT8t90QG0w
GVu0Gc8KE8f+cM9oxSx9t80vcKdBFwvpDoyab0tpbHkpNA9tYUegheDwI5acIEiK
BERp4l36Dx4A8yKOwKhqy1Ty40+Y+9Bkay80nJWr5RvF5K88SUH/4RU0M0m6plWQ
sM1VmHatLxDIyzoy93qjojRyIT46+CeCdL/N0FF+z0N+66K/AErpxSv3mon2chOI
vDSyXpqqIBbTTt+o8tzAusceNs3GuecAMjor7kFerkPff6rOzCAphAwCePp43suu
DFFF9X2FYIK3a6NRjiTEEKMy3uumHDbiU7uuO22kbZGRtir3mZs=
=J8Yy
-----END PGP SIGNATURE-----