Re: Dealing with large datasets

Martin Simmons <[email protected]> Thu, 11 Feb 2016 18:18:21 GMT
Newsgroups gmane.lisp.clsql.general
Message-ID <[email protected]>
SSBob3BlIHRoaXMgaXMgbm90IGNvbnNpZGVyZWQgb2ZmLXRvcGljLCBidXQgbmVzdGVkIHF1ZXJp
ZXMgd29yayBpbiBMaXNwV29ya3MKQ29tbW9uIFNRTC4KCi0tIApNYXJ0aW4gU2ltbW9ucwpMaXNw
V29ya3MgTHRkCmh0dHA6Ly93d3cubGlzcHdvcmtzLmNvbS8KCj4+Pj4+IE9uIFRodSwgMTEgRmVi
IDIwMTYgMTE6MDM6MzkgLTA2MDAsIEJsYWtlIE1jQnJpZGUgc2FpZDoKPiAKPiBZZWEsIHRoYXQg
aXMgd2hhdCBJIHN1c3BlY3RlZCBhbmQgZmVhcmVkLiAgSSB0aGluayBhZGRpbmcgY3Vyc29ycyB3
b3VsZCBub3QKPiBiZSBoYXJkLCBidXQgaXQgd291bGQgYmUgYSBsaXR0bGUgbW9yZSBpbnZvbHZl
ZCB0aGFuIHlvdSBzdWdnZXN0LiAgUmlnaHQgbm93Cj4geW91IGhhdmU6Cj4gCj4gZGF0YWJhc2Ug
LT4gZGF0YQo+IAo+IFlvdSBuZWVkOgo+IAo+IGRhdGFiYXNlIC0+IGN1cnNvciAtPiBkYXRhCj4g
Cj4gU28sIHlvdSB3b3VsZCBvYnRhaW4gYSBjdXJzb3Igb2JqZWN0IGZyb20gYSBkYXRhYmFzZSBv
YmplY3QsIGFuZCB0aGVuIGFsbCBvZgo+IHlvdXIgb3BlcmF0aW9ucyB3b3VsZCBiZSBvbiB0aGUg
Y3Vyc29yIG9iamVjdCByYXRoZXIgdGhhbiBhIGRhdGFiYXNlIG9iamVjdC4KPiBPZiBjb3Vyc2Us
IHlvdSBjYW4gY3JlYXRlIGFueSBudW1iZXIgb2YgY3Vyc29yIG9iamVjdHMgYWdhaW5zdCBhIHNp
bmdsZQo+IGRhdGFiYXNlIGNvbm5lY3Rpb24gdGh1cyBzb2x2aW5nIHRoZSB0d28gcHJvYmxlbXMg
SSBtZW50aW9uZWQuCj4gCj4gRmV3IHRoaW5ncyB3b3VsZCBnaXZlIG1lIG1vcmUgcGxlYXN1cmUg
dGhlbiBnZXR0aW5nIGludG8gdGhlIGNvZGUgbXlzZWxmLgo+IEluIGZhY3QgSSd2ZSBkb25lIGEg
Yml0IG9mIGNvbnRyaWJ1dGluZyBpbiB0aGUgcGFzdCAoCj4gaHR0cHM6Ly9naXRodWIuY29tL2Js
YWtlbWNicmlkZT90YWI9cmVwb3NpdG9yaWVzICkgYnV0IHRpbWUgaXMgYSBodWdlCj4gcHJvYmxl
bSBmb3IgbWUgcmlnaHQgbm93Lgo+IAo+IEkgcmVhbGx5IGFwcHJlY2lhdGUgYWxsIG9mIHlvdXIg
YW5kIG90aGVycyBncmVhdCB3b3JrIHdpdGggQ0xTUUwuICBJdCB3b3VsZAo+IGJlIGdyZWF0IHRv
IHNlZSBjdXJzb3JzIHNvbWUgdGltZS4KPiAKPiBMYXN0bHksIHdpdGggbGlzcCBwYWNrYWdlcywg
SSB0aGluayBsaXNwIHdvdWxkIGRvIGZpbmUgd2l0aCBhIG1hbnkKPiBwcm9ncmFtbWVyIGFwcGxp
Y2F0aW9uLgo+IAo+IFRoYW5rcy4KPiAKPiBCbGFrZSBNY0JyaWRlCj4gCj4gCj4gT24gVGh1LCBG
ZWIgMTEsIDIwMTYgYXQgMTA6NDggQU0sIFJ1c3MgVHluZGFsbCA8cnVzc0BhY2NlbGVyYXRpb24u
bmV0Pgo+IHdyb3RlOgo+IAo+ID4gSnVzdCByYW4gYSBxdWljayB0ZXN0IG9mIG5lc3RlZCBxdWVy
aWVzOgo+ID4KPiA+ICh3aXRoLWEtZGItcm9sZSAoOmRldi1vbGQpCj4gPiAgIChjbHNxbDpkby1x
dWVyeQo+ID4gICAgICgoYWNjdCkgIlNFTEVDVCBhY2NvdW50aWQgRlJPTSBjbGllbnRzIikKPiA+
ICAgICAoY2xzcWw6cXVlcnkKPiA+ICAgICAgIz8iU0VMRUNUIGNvbXBhbnluYW1lIEZST00gY2xp
ZW50cyBXSEVSRSBhY2NvdW50aWQ9JHthY2N0fSIpKSkKPiA+Cj4gPiBXaGljaCByZXN1bHRlZCBp
biBhIGVycm9yOgo+ID4gQSBkYXRhYmFzZSBlcnJvciBvY2N1cnJlZDogTklMIC8gMjQwMDAKPiA+
ICAgW3VuaXhPREJDXVtGcmVlVERTXVtTUUwgU2VydmVyXUludmFsaWQgY3Vyc29yIHN0YXRlIFtD
b25kaXRpb24gb2YgdHlwZQo+ID4gICAgQ0xTUUwtU1lTOlNRTC1EQVRBQkFTRS1FUlJPUl0KPiA+
Cj4gPiBTbyB0aGUgbW9zdCBiYXNpYyBuZXN0ZWQgcXVlcnkgZG9lcyBOT1Qgc2VlbSB0byB3b3Jr
IHJpZ2h0IG5vdy4gQWdhaW4gSQo+ID4gZmVlbCBsaWtlIHRoZXJlIGFyZSBwcm9iYWJseSBzb21l
IGZpZGRseSBDIGJpdHMgdG8gYWxpZ24gYW5kL29yIHJlc291cmNlCj4gPiBtYW5hZ2UgYmV0dGVy
LCBhbmQgaXQgKmNvdWxkKiB3b3JrLCBidXQgcHJvYmFibHkgbm90IHNvbWV0aGluZyBJIHdpbGwg
ZXZlcgo+ID4gZ2V0IGFyb3VuZCB0byBkZXZlbG9waW5nIGdyYXRpcy4KPiA+Cj4gPiBSdXNzIFR5
bmRhbGwgUHJvZ3JhbW1lciBBY2NlbGVyYXRpb24ubmV0Cj4gPgo+ID4KPiA+IE9uIDAyLzExLzIw
MTYgMTE6MzMgQU0sIFJ1c3MgVHluZGFsbCB3cm90ZToKPiA+Cj4gPj4KPiA+PiBBcyBmb3IgbmVz
dGVkIHF1ZXJpZXMsIHRoZXkgbWF5IHdvcmsganVzdCBmaW5lIChwcm9iYWJseSBkbyksIEkgcmVh
bGx5Cj4gPj4gaGF2ZSBuZXZlciBuZWVkZWQgdGhlbSwgYW5kIHNvIGRvbid0IHdhbnQgdG8gcmVh
bGx5IGNvbW1pdCB0byBpdC4gIE15Cj4gPj4gZ3Vlc3MgaXMgdGhhdCBpdCB3b3VsZCBjb21lIGRv
d24gdG8gaG93IHRoZSBpbnRlcm5hbHMgYXJlIGhhbmRsaW5nIHRoZSBDCj4gPj4gYml0cywgd2hp
Y2ggaXMgcHJvYmFibHkgbW9zdGx5IGNvcnJlY3QuICBJIHVzZSBzZXBhcmF0ZSBjb25uZWN0aW9u
cyBmb3IKPiA+PiB0aGluZ3MgbGlrZSB3cml0aW5nIGxvZ2dpbmcgb3V0c2lkZSBvZiB0aGUgY3Vy
cmVudCB0cmFuc2FjdGlvbiwgc28gdGhleQo+ID4+IGFyZSByZXF1aXJlZC4KPiA+Pgo+ID4KPiA+
Cj4gPiBfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXyBDTFNR
TCBtYWlsaW5nIGxpc3QKPiA+IENMU1FMQGxpc3RzLmtwZS5pbyBodHRwOi8vbGlzdHMua3BlLmlv
L2NnaS1iaW4vbWFpbG1hbi9saXN0aW5mby9jbHNxbAo+ID4KPiAKX19fX19fX19fX19fX19fX19f
X19fX19fX19fX19fX19fX19fX19fX19fX19fX18KQ0xTUUwgbWFpbGluZyBsaXN0CkNMU1FMQGxp
c3RzLmtwZS5pbwpodHRwOi8vbGlzdHMua3BlLmlvL2NnaS1iaW4vbWFpbG1hbi9saXN0aW5mby9j
bHNxbAo=