Re: performance of parsing docbook with xincludes

Nick Wellnhofer <[email protected]>
Newsgroups gmane.comp.gnome.lib.xml.general
Message-ID <[email protected]>
On 13/05/2018 20:54, Stefan Sauer wrote:
> Lets look at some numbers using glib (https://gitlab.gnome.org/GNOME/glib)
> 
> cd glib/docs/reference/glib
> xmllint --timing --xinclude --noout glib-docs.xml
> Parsing took 0 ms
> Xinclude processing took 4560 ms
> Freeing took 91 ms
> 
> Any idea how I can get more breakdown of whats happening in  'Xinclude
> processing'?

It seems that "XInclude processing" also contains the time needed to parse the 
included documents, so maybe the XIncludes aren't the issue at all 
(glib-docs.xml is a small document including several larger ones). Can you 
save glib-docs.xml after processing XIncludes and check whether parsing the 
consolidated document is considerably faster?

> Running with "perf record -g -- xmllint --timing --xinclude --noout
> glib-docs.xml" gets me such a report.
> 
> +   17.15%    16.69%  xmllint  libc-2.24.so        [.] _int_malloc
> +   11.93%    11.87%  xmllint  libc-2.24.so        [.] malloc_consolidate
> +    9.01%     8.97%  xmllint  libxml2.so.2.9.4    [.] xmlDictLookup
> +    7.15%     0.00%  xmllint  ld-2.24.so          [.] 0xffff8021a0022010
> +    6.25%     6.21%  xmllint  libxml2.so.2.9.4    [.] xmlHashAddEntry3
> +    6.22%     0.00%  xmllint  libxml2.so.2.9.4    [.] xmlSAX2IsStandalone
> +    6.22%     0.00%  xmllint  [unknown]           [.] 0x56413c74c0854810
> +    3.95%     3.94%  xmllint  libxml2.so.2.9.4    [.] xmlHashLookup2
>       3.72%     3.70%  xmllint  libc-2.24.so        [.] _int_free
> +    3.28%     0.00%  xmllint  [unknown]           [.] 0000000000000000
> +    3.06%     3.04%  xmllint  libxml2.so.2.9.4    [.]
> xmlFreeDocElementContent
> +    2.96%     2.91%  xmllint  libc-2.24.so        [.] free

The callgraph based reports (perf report -g or -G) are usually more helpful.

> Any ideas. Is there a know issues with using xincludes here?

It might be quadratic behavior in the XInclude engine or something else 
entirely. How large is glib-docs.xml after processing XIncludes?

Nick
_______________________________________________
xml mailing list, project page  http://xmlsoft.org/
[email protected]
https://mail.gnome.org/mailman/listinfo/xml
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.