RE: Performance

Thank you very much Eickvonder, I am sorry for the confusion on the number I
gave, in my current RDBMS DB I have 20 million records, and I am trying to
push most of them (around 60%) into xindice XML ( may be in 10 different XML
files). Each XML file will be definitely very bulky - This we are doing
because based on our client data, we are not finding any standard
normalization techniques in our current RDBMS Datamodel, its changing too
frequently. I thought of accommodating all un-normalized data into XML and
other % of data into RDBMS DB.
 
Regards
--SasiKanth
 
  _____  

From: Eickvonder Bjoern [mailto:[email protected]] 
Sent: Thursday, July 28, 2005 11:42 AM
To: [email protected]
Subject: AW: Performance
 
Thats really a huge number. You mean you have 20 million xml-files to store?
What size does each file have? What kind of request do you expect (give me
document this or that or do you have to seach for specific data within all
these 20 million records)? I personally think that XIndice will not be
suited for your needs. I already had trouble with a few dozens of
collections because Xindice opens file descriptors for each of these .tbl
and .idx files for concurrent access but never closes them (til shutdown),
so I got a too many open files exception on a linux system. Moreover I had
problems if multiple users are adding/writing (different) files to a
collection concurrently (some data was later on corrupt or missing), so I
had to synchronize the write access to each collection. So if all these 500
users will have to write data this will be a problem for you too.
 
Bjoern Eickvonder   
 
  _____  

Von: Sasikanth Tenneti [mailto:[email protected]] 
Gesendet: Donnerstag, 28. Juli 2005 07:55
An: [email protected]
Betreff: Performance
Dear All
 
 
            I am trying to move one of our product database content into XML
xindice DB, the volume I am looking is around 20 million records, is xindice
can scale to  those many number of records efficiently with about 500
concurrent users requests?
 
Please help me to get some focus on this.
 
Thank you in advance
--SasiKanth


____________
Virus checked by G DATA AntiVirusKit
Version: AVK 15.0.6273 from 27.07.2005