Re: Wikipedia dump file processing shoot out
Tyler Riddle <[email protected]>
| Newsgroups | gmane.comp.lang.perl.xml |
|---|---|
| Message-ID | <[email protected]> |
> > An other module that's pretty fast is XML::Rules. > I'm going to write a benchmark for that - does anyone else have XML processing modules they can recommend? I'm trying to get my benchmarks to be as comprehensive as possible. Remember it can't hold the entire document into memory, it's got to be able to stream it parts at a time. XML::Twig is already benchmarked. On another note I think it's funny I solved that problem in a very similar way with Parse::MediaWikiDump when I destupified the original creation it was: http://cpansearch.perl.org/src/TRIDDLE/Parse-MediaWikiDump-1.0.3/lib/Parse/MediaWikiDump/Pages.pm - configuration for the engine that transforms the XML document into a data structure. http://cpansearch.perl.org/src/TRIDDLE/Parse-MediaWikiDump-1.0.3/lib/Parse/MediaWikiDump/Revisions.pm - the engine that makes it possible. Cheers, Tyler Riddle -- If you wish to make an apple pie from scratch you must first invent the universe. -- Carl Sagan _______________________________________________ Perl-XML mailing list [email protected] To unsubscribe: http://listserv.ActiveState.com/mailman/mysubs