Re: discussion of createrepo and repodata format future

On Sat, 2010-08-07 at 17:43 +0200, Michael Schroeder wrote:

> Hmm, I thought that those sqlite databases are generated from
> scratch. Don't you suffer from fragmentation issues if you
> just do insert/deletes? Our libzypp folkes experimented with a
> single sqlite database that contains the data of all repositories,
> and while it was fast in the beginning it got slower and slower
> the more the database was changed. (That may be fixed in current
> sqlite versions, though. Or maybe I remember it wrong.)
> 


Sorry if I was unclear. I'm not talking abour merging across multiple
repos. I just mean per-repo writing directly to the sqlite instead of
going through the intermediary step of the xml. Even if we end up
rewriting the sqlite files to avoid fragmentation issues accessing and
dumping out pkg objects from the sqlite is faster than from the xml -
for random access especially.

It's also lighter in terms of memory.

-sv