Re: [Tiki-devel] composer.tiki.org slightly borken?
Marc Laporte <[email protected]>
| Newsgroups | gmane.comp.cms.tiki.devel |
|---|---|
| Message-ID | <[email protected]> |
I agree that all the dev tools should not come from composer.tiki.org Thanks! On Fri, 8 Apr 2022 10:30:06 +0100 Tiki developers [email protected] said > Thanks Jean-Marc > > What's MongoDB doing in there? That's not part of Tiki is it? > > Maybe php-unit (and perhaps the rest of the dev tools) could bypass > composer.tiki.org and come from packagist.org directly somehow? There seem to > be an awful lot of those... > > jb > > > > > On 7 Apr 2022, at 17:10, Jean-Marc Libs <[email protected]> wrote: > > > > Hi Victor, > > > > It's a huge file so I left it online: > > That's a simple du -sh : > > http://composer.tiki.org/packages_du-sh.txt > > That one is sorted by size: > > http://composer.tiki.org/packages_du-sh_sorted.txt > > > > No problem, > > J-M > > > > On Wed, Apr 6, 2022 at 2:05 PM Victor Emanouilov via TikiWiki-devel > > <[email protected]> wrote: > >> JM, can you `du -sh` on the satis storage dirs and send us a list of the > >> directories that take the most amount of space? We might limit semantic > >> versions of those packages to what Tiki really needs... > >> > >> Thanks, > >> Victor > >> > >> On 4/5/22 6:42 PM, Jonny Bradley via TikiWiki-devel wrote: > >> > Hi Victor > >> > > >> > Yes, that was going to be plan B, if just listing what's needed currently > > in all the branches didn't result in freeing up enough space we could keep just > > the supported ones (somehow, we don't actually have that info in a format we > > can access easily afaik). > >> > > >> > The main thing needed is to change from using the actual used version to > > working out all the possible required ones, i expect we can use whatever > > composer uses to calculate that but i probably need to know more about how > > satis working internally... > >> > > >> > And have more free time! ;) > >> > > >> > jb > >> > > >> > > >> > > >> >> On 5 Apr 2022, at 11:44, Victor Emanouilov via TikiWiki-devel > > <[email protected]> wrote: > >> >> > >> >> Hi Jonny, Jean-Marc, > >> >> > >> >> Thanks for fixing this! It has been a lingering problem for quite some > > time. We definitely don't need all the packages that are downloaded on > > composer.tiki.org but Jonny, that's a static repository generator which means > > it can't fall back to download a missing package. I am thinking why don't we > > reduce to the number of official Tiki releases we support - we get all semantic > > versions of packages and generate only those in satis? Symfony packages, for > > example, will be reduced to v3 or v4 only and not everything from 2 to 6 > > (https://composer.tiki.org/#symfony/config) for example. Each official Tiki > > release can have Jonny's improved script run and generate the correct satis > > config. I believe we should decrease storage requirements several times this > > way. > >> >> > >> >> Regards, > >> >> Victor > >> >> > >> >> On 4/5/22 12:15 PM, Jonny Bradley via TikiWiki-devel wrote: > >> >>> Hi Jean-Marc and all > >> >>> > >> >>> Had a spare hour last night so started on this: > >> >>> > >> >>> > > https://gitlab.com/tikiwiki/tiki/-/blob/master/doc/devtools/composer_packages_in_use.php > >> >>> > >> >>> which at the moment lists all the versions currently in use by all the > > branches in tiki on gitlab. > >> >>> > >> >>> However, it then occurred to me that many of these branches will have > > outstanding automatic updates pending, e.g. if we ran `composer update` on tiki > > 22.x there almost certainly would be updates to newer packages, so maybe this > > isn't the right strategy after all... > >> >>> > >> >>> I guess we need to take into account the semantic versioning in all the > > composer.json files rather than the actual ones in use in the lock files, but > > at least it's a start? > >> >>> > >> >>> Would it be possible to remove some packages form satis on composer.t.o, > > but if something requests one of them it re-downloads it? Then we could be more > > confident in deleting stuff... > >> >>> > >> >>> Or just put a larger drive on it‽ :p > >> >>> > >> >>> Thanks for fixing it again! > >> >>> > >> >>> jonny > >> >>> > >> >>> > >> >>> > >> >>>> On 5 Apr 2022, at 01:09, Jean-Marc Libs <[email protected]> > > wrote: > >> >>>> > >> >>>> Hi folks, > >> >>>> > >> >>>> root partition was full on composer.tiki.org 😞 I managed to find 26G > > and it works again but the volume is staggering (409G, 103G once compressed for > > backups) and goes up all the time. > >> >>>> > >> >>>> Do we need so many third-party libs? > >> >>>> > >> >>>> Cheers, > >> >>>> J-M > >> >>>> > >> >>>> On Mon, Apr 4, 2022 at 5:17 PM Victor Emanouilov via TikiWiki-devel > > <[email protected]> wrote: > >> >>>> +1 same for me ... that URL returns 304 not modified - maybe some > >> >>>> apache/nginx config is needed? Composer expects a valid json file > > there... > >> >>>> > >> >>>> Regards, > >> >>>> Victor > >> >>>> > >> >>>> On 4/4/22 3:03 PM, Jonny Bradley via TikiWiki-devel wrote: > >> >>>>> Hi all > >> >>>>> > >> >>>>> I'm trying to update composer for the bootstrap5 branch following some > > rebasing and it seem composer is failing now, and it's the same in > > trunk/master/main now. > >> >>>>> > >> >>>>> When i do: > >> >>>>> > >> >>>>> $ php74 temp/composer.phar update --working-dir vendor_bundled > > --prefer-dist --optimize-autoloader > >> >>>>> > >> >>>>> I get: > >> >>>>> > >> >>>>>> In JsonFile.php line 345: > >> >>>>>> > > "https://composer.tiki.org/include/all%2419ac295e729a70b8272116cec8bdb0716f3dd8d2.json" does not contain valid JSON > >> >>>>>> Parse error on line 1: > >> >>>>>> > >> >>>>>> ^ > >> >>>>>> Expected one of: 'STRING', 'NUMBER', 'NULL', 'TRUE', 'FALSE', '{', > > '[' > >> >>>>>> > >> >>>>> > > https://composer.tiki.org/include/all%2419ac295e729a70b8272116cec8bdb0716f3dd8d2.json > > is an empty file, which presumably is the problem. > >> >>>>> > >> >>>>> Does anyone know why? (probably a Jean-Marc thing i expect, maybe > > satis needs updating/restarting/flushing?) > >> >>>>> > >> >>>>> jonny > >> >>>>> > >> >>>>> > >> >>>>> > >> >>>>> > >> >>>>> _______________________________________________ > >> >>>>> TikiWiki-devel mailing list > >> >>>>> [email protected] > >> >>>>> https://lists.sourceforge.net/lists/listinfo/tikiwiki-devel > >> >>>> _______________________________________________ > >> >>>> TikiWiki-devel mailing list > >> >>>> [email protected] > >> >>>> https://lists.sourceforge.net/lists/listinfo/tikiwiki-devel > >> >>>> _______________________________________________ > >> >>>> TikiWiki-devel mailing list > >> >>>> [email protected] > >> >>>> https://lists.sourceforge.net/lists/listinfo/tikiwiki-devel > >> >>> > >> >>> _______________________________________________ > >> >>> TikiWiki-devel mailing list > >> >>> [email protected] > >> >>> https://lists.sourceforge.net/lists/listinfo/tikiwiki-devel > >> >> > >> >> _______________________________________________ > >> >> TikiWiki-devel mailing list > >> >> [email protected] > >> >> https://lists.sourceforge.net/lists/listinfo/tikiwiki-devel > >> > > >> > > >> > _______________________________________________ > >> > TikiWiki-devel mailing list > >> > [email protected] > >> > https://lists.sourceforge.net/lists/listinfo/tikiwiki-devel > >> > >> > >> _______________________________________________ > >> TikiWiki-devel mailing list > >> [email protected] > >> https://lists.sourceforge.net/lists/listinfo/tikiwiki-devel > >> _______________________________________________ > >> TikiWiki-devel mailing list > >> [email protected] > >> https://lists.sourceforge.net/lists/listinfo/tikiwiki-devel > > > > > _______________________________________________ > TikiWiki-devel mailing list > [email protected] > https://lists.sourceforge.net/lists/listinfo/tikiwiki-devel > _______________________________________________ TikiWiki-devel mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/tikiwiki-devel