Indexing by HTTP - lots of pages!

"Katie Hague" <[email protected]> Tue, 26 Aug 2003 13:55:36 +0100
Newsgroups gmane.comp.web.perlfect-search
Message-ID <[email protected]>
I have literally 1000s of dynamically created PHP pages which I need to index via PHP. Is there a max number it will index, eg before it times out?

Or can I set the max number pages to 10,000 and just let it run and run?!

Thanks,

Katie