[Lvfs-announce] Remote Metadata XML Rebuilding
Richard Hughes <[email protected]> Thu, 6 Jul 2023 16:30:21 +0100
| Newsgroups | dev.linux.lists.lvfs-announce |
|---|---|
| Message-ID | <CAD2FfiGRfyDrufM2qOEhya1uxCy4d4zAq_Z8FWT5fngPtpZGXQ@mail.gmail.com> |
Hi all, tl;dr: Metadata is going to be rebuilt less frequently. I wanted to let you know about a change I=E2=80=99m going to make to the LV= FS in the next hour or so. At the moment metadata is being rebuilt after the firmware is re-signed. This takes seconds for smaller vendors, a few minutes for the larger embargo remotes and several tens of minutes for testing/stable. This leads to the =E2=80=9Clatest=E2=80=9D metadata bei= ng invalidated on the CDN multiple times per hour on average and means we=E2=80=99re not using the CDN effectively. This also causes problems when syncing when using the PULP_MANIFEST as the content of the remote can have changed before the mirror has finished syncing. So, to reduce load, locking contention and bandwidth I=E2=80=99m going to s= et the LVFS to only rebuild the embargo remotes every 1h and the public testing/stable remotes every 4h. This means you might need to wait a little while from testing using the public remotes after pushing to testing. During this time the firmware is available in the old embargo remote =E2=80=93 so it might be a perfect time to do that end-to-end testin= g. Richard