Scalability

Philipp Gühring <[email protected]> Mon, 22 Nov 2004 00:57:37 +0100
Newsgroups gmane.comp.web.perlfect-search
Organization Futureware 2001
Message-ID <[email protected]>
--===============1037491852==
Content-Type: multipart/signed; boundary="nextPart3402989.TTXrROotFD";
	protocol="application/pgp-signature"; micalg=pgp-sha1
Content-Transfer-Encoding: 7bit

--nextPart3402989.TTXrROotFD
Content-Type: text/plain;
  charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
Content-Disposition: inline

Hi,

Perlfect Search is really nice.=20
But for only 2000 documents, I am using grep.=20
Can we get Perlfect Search to handle 200.000.000 documents?

Nov 21 16:06:46 linux3 kernel: __alloc_pages: 0-order allocation failed=20
(gfp=3D0x1f0/0)
Nov 21 16:06:47 linux3 kernel: __alloc_pages: 0-order allocation failed=20
(gfp=3D0x1d2/0)
Nov 21 16:06:47 linux3 kernel: __alloc_pages: 0-order allocation failed=20
(gfp=3D0x1d2/0)
Nov 21 16:06:47 linux3 kernel: VM: killing process perl

:-(

What is causing the memory-consumption here?=20
Are the database-tied hashes using so much memory?=20
Or is the problem in the indexer itself?
( I already have $LOW_MEMORY_INDEX =3D 1; )

By the way, we will soon have it finally integrated on=20
http://www.quintessenz.at/ , which is needing about 50.000 documents.

Many greetings,
Philipp G=FChring

--nextPart3402989.TTXrROotFD
Content-Type: application/pgp-signature

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.4 (GNU/Linux)

iD8DBQBBoSt4lqQ+F+0wB3oRAgQmAKCT84ifUO3KERfYqykiQp1ReSh7JACdGZ9R
bmPkv5650YhjshvHLpFTESk=
=gSUr
-----END PGP SIGNATURE-----

--nextPart3402989.TTXrROotFD--

--===============1037491852==
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
perlfect-search mailing list
[email protected]
To unsubscribe, set other personal options or view the list archives please visit:
http://perlfect.com/mailman/listinfo/perlfect-search
--===============1037491852==--