Bug#1132413: udd: Ubuntu importers have failed since March 23, 2026

--000000000000f3291b0653c324f3
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

Hey Lucas,

Indeed, launchpad is still struggling with AI scrappers and similar and the
number of requests UDD is making has led to the IP being blocked again. It
is unblocked now, but I think we need figure out a way for it to not hammer
launchpad that hard on a regular basis (if my previous quick check is
correct is does read 160k+ pages every run). Was there any technical reason
to not use launchpad API (which would allow to filter on recent changes and
only process bugs that changed recently instead of hammering every
launchpad bug page at every run)?

Cheers,
S=C3=A9bastien

On Mon, 8 Jun 2026 at 21:05, Lucas Nussbaum <[email protected]> wrote:

> Hi,
>
> It looks like ullmann.debian.org is blacklisted again.
> `curl https://launchpad.net/ubuntu/+bugs-text`
> <https://launchpad.net/ubuntu/+bugs-text> timeouts.
>
> $ host ullmann.debian.org
> ullmann.debian.org has address 209.87.16.38
>
> Cheers,
>
> Lucas
>

--000000000000f3291b0653c324f3
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div><div><div>Hey Lucas,<br><br></div>Indeed, launchpad i=
s still struggling with AI scrappers and similar and the number of requests=
 UDD is making has led to the IP being blocked again. It is unblocked now, =
but I think we need figure out a way for it to not hammer launchpad that ha=
rd on a regular basis (if my previous quick check is correct is does read 1=
60k+ pages every run). Was there any technical reason to not use launchpad =
API (which would allow to filter on recent changes and only process bugs th=
at changed recently instead of hammering every launchpad bug page at every =
run)?<br><br></div>Cheers,<br></div>S=C3=A9bastien</div><br><div class=3D"g=
mail_quote gmail_quote_container"><div dir=3D"ltr" class=3D"gmail_attr">On =
Mon, 8 Jun 2026 at 21:05, Lucas Nussbaum &lt;<a href=3D"mailto:lucas@debian=
.org">[email protected]</a>&gt; wrote:<br></div><blockquote class=3D"gmail_q=
uote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,2=
04);padding-left:1ex">Hi,<br>
<br>
It looks like <a href=3D"http://ullmann.debian.org" rel=3D"noreferrer" targ=
et=3D"_blank">ullmann.debian.org</a> is blacklisted again.<br>
`curl <a href=3D"https://launchpad.net/ubuntu/+bugs-text" rel=3D"noreferrer=
" target=3D"_blank">https://launchpad.net/ubuntu/+bugs-text`</a> timeouts.<=
br>
<br>
$ host <a href=3D"http://ullmann.debian.org" rel=3D"noreferrer" target=3D"_=
blank">ullmann.debian.org</a><br>
<a href=3D"http://ullmann.debian.org" rel=3D"noreferrer" target=3D"_blank">=
ullmann.debian.org</a> has address 209.87.16.38<br>
<br>
Cheers,<br>
<br>
Lucas<br>
</blockquote></div>

--000000000000f3291b0653c324f3--