[Lvfs-announce] Remote Metadata XML Rebuilding

Richard Hughes <[email protected]> Thu, 6 Jul 2023 16:30:21 +0100
Newsgroups dev.linux.lists.lvfs-announce
Message-ID <CAD2FfiGRfyDrufM2qOEhya1uxCy4d4zAq_Z8FWT5fngPtpZGXQ@mail.gmail.com>
Hi all,

tl;dr: Metadata is going to be rebuilt less frequently.

I wanted to let you know about a change I=E2=80=99m going to make to the LV=
FS
in the next hour or so. At the moment metadata is being rebuilt after
the firmware is re-signed. This takes seconds for smaller vendors, a
few minutes for the larger embargo remotes and several tens of minutes
for testing/stable. This leads to the =E2=80=9Clatest=E2=80=9D metadata bei=
ng
invalidated on the CDN multiple times per hour on average and means
we=E2=80=99re not using the CDN effectively. This also causes problems when
syncing when using the PULP_MANIFEST as the content of the remote can
have changed before the mirror has finished syncing.

So, to reduce load, locking contention and bandwidth I=E2=80=99m going to s=
et
the LVFS to only rebuild the embargo remotes every 1h and the public
testing/stable remotes every 4h. This means you might need to wait a
little while from testing using the public remotes after pushing to
testing. During this time the firmware is available in the old embargo
remote =E2=80=93 so it might be a perfect time to do that end-to-end testin=
g.

Richard