Bug#1118567: udd: archive-ubuntu importer isn't working

Hi!

On Wed, 2025-10-22 at 11:32:20 +0200, Lucas Nussbaum wrote:
> Running the importer in debug mode fails with:
> > Processing /srv/udd.debian.org/mirrors/ubuntu//dists/questing/main/binary-amd64/Packages.gz rel=questing comp=main arch=amd64
> > Processing /srv/udd.debian.org/mirrors/ubuntu//dists/questing/main/binary-amd64v3/Packages.gz rel=questing comp=main arch=amd64v3
> > /srv/udd.debian.org/udd/udd/archive_gatherer.rb:290:in `exec_prepared': ERROR:  duplicate key value violates unique constraint "ubuntu_packages_pkey" (PG::UniqueViolation)
> > DETAIL:  Key (package, version, architecture, distribution, release, component)=(3cpio, 0.10.2-0ubuntu1, amd64, ubuntu, questing, main) already exists.
> 
> It looks like Ubuntu enabled Architecture Variants
> (https://wiki.debian.org/ArchitectureVariants). The Packages.gz file in
> binary-amd64v3 has 'Architecture-Variant: amd64v3', which is currently
> ignored by UDD.
> 
> There's a blog article from December 2023 about this at
> https://ubuntu.com/blog/optimising-ubuntu-performance-on-amd64-architecture
> but I did not find any communication since then. What is the status of
> this on the Ubuntu/Canonical side? Was this coordinated with Debian
> somehow?

There was some discussion in the debian-dpkg mailing list some time
ago, about the design details, but then it died out, and it was not
clear to me whether there was a blocker somewhere, and AFAIR at the
time I was expecting them to come back with either further discussion,
or patches, etc. But this then just got implemented in Ubuntu.

> For now I disabled rsync'ing the binary-amd64v3/Packages.gz files, so
> UDD does not process them. I'd like to understand a bit better the long
> term plan before adding a proper fix into UDD.

I need and have pending to revisit this, but given that this was pushed
unilaterally, in this kind of cases (for the dpkg side) I reserve the
right to make any change that might feel needed (in semantics, naming,
or implementation).

Thanks,
Guillem