Scalability
Philipp Gühring <[email protected]> Mon, 22 Nov 2004 00:57:37 +0100
| Newsgroups | gmane.comp.web.perlfect-search |
|---|---|
| Organization | Futureware 2001 |
| Message-ID | <[email protected]> |
--===============1037491852== Content-Type: multipart/signed; boundary="nextPart3402989.TTXrROotFD"; protocol="application/pgp-signature"; micalg=pgp-sha1 Content-Transfer-Encoding: 7bit --nextPart3402989.TTXrROotFD Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Hi, Perlfect Search is really nice.=20 But for only 2000 documents, I am using grep.=20 Can we get Perlfect Search to handle 200.000.000 documents? Nov 21 16:06:46 linux3 kernel: __alloc_pages: 0-order allocation failed=20 (gfp=3D0x1f0/0) Nov 21 16:06:47 linux3 kernel: __alloc_pages: 0-order allocation failed=20 (gfp=3D0x1d2/0) Nov 21 16:06:47 linux3 kernel: __alloc_pages: 0-order allocation failed=20 (gfp=3D0x1d2/0) Nov 21 16:06:47 linux3 kernel: VM: killing process perl :-( What is causing the memory-consumption here?=20 Are the database-tied hashes using so much memory?=20 Or is the problem in the indexer itself? ( I already have $LOW_MEMORY_INDEX =3D 1; ) By the way, we will soon have it finally integrated on=20 http://www.quintessenz.at/ , which is needing about 50.000 documents. Many greetings, Philipp G=FChring --nextPart3402989.TTXrROotFD Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.4 (GNU/Linux) iD8DBQBBoSt4lqQ+F+0wB3oRAgQmAKCT84ifUO3KERfYqykiQp1ReSh7JACdGZ9R bmPkv5650YhjshvHLpFTESk= =gSUr -----END PGP SIGNATURE----- --nextPart3402989.TTXrROotFD-- --===============1037491852== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ perlfect-search mailing list [email protected] To unsubscribe, set other personal options or view the list archives please visit: http://perlfect.com/mailman/listinfo/perlfect-search --===============1037491852==--