Extracting large amounts of data
Matt Ford <[email protected]> Thu, 09 Feb 2006 00:12:58 +0000
| Newsgroups | gmane.text.xml.xindice.user |
|---|---|
| Message-ID | <[email protected]> |
Hi, I have a reasonably sized database (500MB) all in one collection in Xindice. I would like to extract a single element from everyone of the many docs - the trouble is the client machine keeps running out of memory. Here's the single element result of my query. <xq:result xmlns:xq="http://xml.apache.org/xindice/Query" xq:col="/rus/RUR" xq:key="2006-01-24T23:12:06Z:[email protected]">PT00H00M00S</xq:result> Is there any way I can stream the results to a file? Are their better ways to extract large amounts of data, than using ResourceSet resourceSet = service.query(xpath); What other strategies are available? I've been thinking about perhaps splitting my database into smaller collections and aggregating the results from these... Any pointers much appreciated, Kind regards, Matt Ford.