Speaking of performance...

Robert Krawitz <rlk-FrUbXkNCsVf2fBVCVOL8/[email protected]>
Newsgroups gmane.comp.kde.kimdaba
Message-ID <20190127152838.B31741418BE@localhost>
We really do need to attack the startup performance somehow, for
people (like myself) with big collections.  I currently have a little
over 300,000 shots in my collection, and depending upon how well we do
in the postseason that could increase by another 10% over the next few
months.  It takes about 13 seconds for kpa to start up, largely due to
the XML parsing.  Since the XML file is "only" 57 MB, it's clearly not
I/O-limited.

I understand (and agree with) the desire for a readable and editable
file format.  I've fixed things up myself on occasion.  But I don't
want to pay that kind of startup price every time.

What I'm thinking in terms of is to save the file in two formats, a
fast format (which could be an SQL database, a binary serialization,
or such) and the XML format.  The fast format would have an embedded
timestamp; if the XML file were newer, it would be used instead, or
the user would be prompted to choose which.

Autosave would save only the fast format (possibly only a delta, but
that would likely be quite difficult).  Full save would save both
formats; if we were really clever, we might be able to parallelize the
two operations.
-- 
Robert Krawitz                                     <rlk-FrUbXkNCsVf2fBVCVOL8/[email protected]>

***  MIT Engineers   A Proud Tradition   http://mitathletics.com  ***
Member of the League for Programming Freedom  --  http://ProgFree.org
Project lead for Gutenprint   --    http://gimp-print.sourceforge.net

"Linux doesn't dictate how I work, I dictate how Linux works."
--Eric Crampton
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.