Re: Searching without retaining all results
"Kevin Aires" <[email protected]> Thu, 3 Aug 2017 22:28:48 +0000
| Newsgroups | gmane.comp.lang.perl.modules.ldap |
|---|---|
| Message-ID | <OF0101FD55.AF584731-ON00258171.007B7CDA-00258171.007B7CDF@notes.na.collabserv.com> |
<font face=3D"Verdana,Arial,Helvetica,sans-serif" size=3D"2"><div>Why am I = on this list. I don't even remotely understand what this is about! &n= bsp;Please could someone remove me.<br>Best regards,<br><br>Kevin Aires<br>= European Lead<br>IBM Digital Video Services<br><br><a href=3D"mailto:aires@= us.ibm.com">[email protected]</a> (Based in UK)<br>+44 (0) 7771 366388</div>= <br><br><font face=3D"Default Sans Serif,Verdana,Arial,Helvetica,sans-serif= " size=3D"2" color=3D"#000000"><font color=3D"#990099">-----Chris Ridd <= <a href=3D"mailto:[email protected]" target=3D"=5Fblank">[email protected]<= /a>> wrote: -----</font><div class=3D"iNotesHistory" style=3D"padding-le= ft:5px;"><div style=3D"padding-right:0px;padding-left:5px;border-left:solid= black 2px;">To: <a href=3D"mailto:[email protected]" target=3D"=5Fblank">= [email protected]</a><br>From: Chris Ridd <<a href=3D"mailto:chrisridd@= mac.com" target=3D"=5Fblank">[email protected]</a>><br>Date: 03/08/2017 = 17:00<br>Subject: Searching without retaining all results<br><br><div><font= face=3D"Courier New,Courier,monospace" size=3D"2">I had a requirement to e= xtract 30+ million entries from an ldap server, and naively thought that us= ing callbacks would be useful.<br><br>While they are useful in getting me e= ach result quickly, I didn't realise that Search still captures each result= in self. So after reading several million entries Linux's oom killer kindl= y killed a) the ldap server and then b) my script to try and get back some = memory!<br><br>I ended up patching Search.pm to avoid capturing each result= when using callbacks. Is there a better way to do this?<br><br>Cheers,<br>= <br>Chris<br></font></div></div></div></font></font><BR>