Re: Status of help.gnome.org and Pintail
Shaun McCance <[email protected]> Tue, 09 Nov 2021 21:27:56 -0500
| Newsgroups | gmane.comp.gnome.documentation |
|---|---|
| Message-ID | <[email protected]> |
--===============1930844851270128362== Content-Type: multipart/alternative; boundary="=-EjAlAuHEFA2MkmUR/HN2" --=-EjAlAuHEFA2MkmUR/HN2 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit On Tue, 2021-09-28 at 22:02 +0100, Emmanuele Bassi via gnome-doc-list wrote: > A few things I found out while playing with this, today: > > - pintail is not really blazing fast, taking 15 minutes to build the > site for the default C locale; but once translations are thrown in > the mix it gets **really** slow. The full build takes 3 hours on the > CI runner. I haven't looked at pintail in depth, but maybe we can > speed it up a bit by running each language in parallel, or cloning > all repositories in parallel with a threaded executor So, it took me a few more weekends than I'd hoped, but I finally landed two changes that affect performance: * Per ebassi's suggestion, Pintail can now do itstool translations in threads. * Pintail can do build entire directories of Mallard files (effectively "documents") at once, instead of doing an xslt run for each page. This required yelp-xsl changes because of stylesheet-global params. These are both behind config options, because they could cause bugs. But I tested on help.gnome.org until I got byte-for-byte equivalence. So I've now enabled them both. On my most recent test builds, without these two features enabled, the build took 2 hours and 9 minutes. With these two features enabled, the build took 17 minutes. This could vary on build machines based on how many cores are available for threading. Still, I'm pretty happy with the speed improvement. I'm still committed to revamping things. I'm just slow because work keeps me on other things. -- Shaun --=-EjAlAuHEFA2MkmUR/HN2 Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: quoted-printable <html><head></head><body><div>On Tue, 2021-09-28 at 22:02 +0100, Emmanuele = Bassi via gnome-doc-list wrote:</div><blockquote type=3D"cite" style=3D"mar= gin:0 0 0 .8ex; border-left:2px #729fcf solid;padding-left:1ex"><div dir=3D= "ltr"><div>A few things I found out while playing with this, today:</div><d= iv><br></div><div>- pintail is not really blazing fast, taking 15 minutes t= o build the site for the default C locale; but once translations are thrown= in the mix it gets **really** slow. The full build takes 3 hours on the CI= runner. I haven't looked at pintail in depth, but maybe we can speed it up= a bit by running each language in parallel, or cloning all repositories in= parallel with a threaded executor</div></div></blockquote><div><br></div><= div>So, it took me a few more weekends than I'd hoped, but I finally landed= two changes that affect performance:</div><div><br></div><div>* Per ebassi= 's suggestion, Pintail can now do itstool translations in threads.</div><di= v><br></div><div>* Pintail can do build entire directories of Mallard files= (effectively "documents") at once, instead of doing an xslt run for each p= age. This required yelp-xsl changes because of stylesheet-global params.</d= iv><div><br></div><div>These are both behind config options, because they c= ould cause bugs. But I tested on help.gnome.org until I got byte-for-byte e= quivalence. So I've now enabled them both.</div><div><br></div><div>On my m= ost recent test builds, without these two features enabled, the build took = 2 hours and 9 minutes. With these two features enabled, the build took 17 m= inutes. This could vary on build machines based on how many cores are avail= able for threading. Still, I'm pretty happy with the speed improvement.</di= v><div><br></div><div>I'm still committed to revamping things. I'm just slo= w because work keeps me on other things.</div><div><br></div><div>--</div><= div>Shaun</div><div><br></div><div><span></span></div></body></html> --=-EjAlAuHEFA2MkmUR/HN2-- --===============1930844851270128362== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ gnome-doc-list mailing list [email protected] https://mail.gnome.org/mailman/listinfo/gnome-doc-list --===============1930844851270128362==--