Bug#1132413: udd: Ubuntu importers have failed since March 23, 2026

Hi Sébastien,

On 07/04/26 at 15:31 +0200, Sebastien Bacher wrote:
> Hey Lucas,
> 
> Thanks for flagging that, it had been indeed blocked again while they were
> trying to cut some load issue due to IA bots/scapers.
> 
> Do you have an idea of the number of API requests/pages load UDD is usually
> doing on a $period (day?), I wonder if the load is really that high and if
> there is some client optimization that could be done in UDD...

AFAIK, there are two UDD processes that query launchpad.

One is ubuntu-upload-history, that should query Launchpad's API once per
upload (or twice, since the API redirects to launchpadlibrarian.net).

The other one is ubuntu-bugs, that refreshes the status of Ubuntu bugs
in UDD. That one runs on a regular basis (once per day currently).

The relevant code is
https://salsa.debian.org/qa/udd/-/blob/master/scripts/launchpad-ubuntu-changes?ref_type=heads
for the first script, and
https://salsa.debian.org/qa/udd/-/blob/master/udd/ubuntu_bugs_gatherer.py?ref_type=heads
for the second script.

The refresh frequency of ubuntu-bugs could probably be reduced if that
helps.

Lucas