Re: Size of the security-tracker repository
Sylvain Beucler <[email protected]> Fri, 12 Jun 2026 07:35:29 +0200
| Newsgroups | gmane.linux.debian.devel.security,gmane.linux.debian.security.tracker |
|---|---|
| Message-ID | <[email protected]> |
Hi, (moving the discussion to debian-security-tracker, last post to debian-security :)) On 11/06/2026 07:21, Sylvain Beucler wrote: > On 07/06/2026 21:24, Christoph Biedl wrote: >> This I can confirm, the auto-gc brought this down to 5.3G last night. > [...] >> Still, this is a lot worse than ealier: On April 7th the total size of >> .git/objects/ was just 1571M here - a day later things started to go >> downhill. > > Interesting. Do you graph the .git usage somehow, and do you have more > data? > > > I believe that Salsa is still sending very suboptimal packs over the > network, which are then reused by the local Git. > > 'git gc --aggressive --keep-largest-pack' repacked the most recents > packs from last week MUCH more efficiently (1.6GB -> 12MB), which tends > to confirm this hypothesis. > > 'git gc --aggressive' is supposed to repack everything, but I'm not able > to run it on my computer anymore at this currently OOMs at >20GB RAM, > which means previous packs may stay fat and non-optimized forever. FTR I ran: $ git -c pack.windowMemory=2G gc --aggressive which took 15h and peeked at 30GB RAM (over the nproc*2GB limit). Result: $ du -sh .git 1,8G .git (from 7GB) Not very practical of course, but mainly this fits my above hypothesis. >> It's a bit saddening nothing has happened about this while everybody >> should have been aware this will not resolve by itself - but rather get >> worse over time :( > > I also see that files >50MB now get a warning at GitHub (before getting > rejected at >100MB), so with our data/CVE/list at 53MB we're starting to > hit all kinds of hard limits, confirming we have to do something sooner > than later. > > Maybe this is something where the LTS Team can help with, let's wait for > the bookworm LTS handover to take place this week, and I'll try and > reach out to involved teams. Cheers! Sylvain Beucler Debian LTS Team