Problems importing huge amounts of data

Hi,

Last weekend I've had my firsts problems using DirStorage.  I was
creating a new database, and importing in it a lot of data from some
XML files, being converted to ZODB objects.   Using DirStorage the
process become slowly and, after 16 hours, it only was able to commit
a transaction every 7 minuts.   I've tried to modify some parameters,
like md5sum's and flushing, but not luck, the same results repeated.  
 Finally, I have run the import process against a FileStorage, packing
it, and then converting the result to DirStorage.   That way I could
have my database with all data and using DirStorage.

My questions are:
1) Is there any workarround for that massive writting cases ?
2) If not, could you figure any way to solve the problem ?   Something
like a massive writting tool could be possible ?  I'm not sure if the
limitations are in DirStorage or in ReiserFS.   If this tool could be
possible, I can try to find some sponsorship.

Oh, I was using Linux 2.4 with ReiserFS over an IDE hard disk, and
DirStorage 1.1.17, and here you have the result of a checkds:

    2326 maximum referencee graph depth
    527.2 average reference graph depth
  1118542 objects
1091957716 bytes in object files
      895 transactions
  1130451 revisions of objects
  1114117 object data files with no md5 checksum
      599 transaction files with no checksum
  9119536 bytes in transaction files
1101077252 total bytes

Thanks in advance
--
Santi Camps
Earcon S.L. - http://www.earcon.com
                  - http://www.kmkey.com


-------------------------------------------------------
This SF.net email is sponsored by: Splunk Inc. Do you grep through log files
for problems?  Stop!  Download the new AJAX search engine that makes
searching your log files as easy as surfing the  web.  DOWNLOAD SPLUNK!
http://sel.as-us.falkag.net/sel?cmd=lnk&kid3432&bid#0486&dat1642