Re: Indexer doesn't follow links with an "&" in it
Jens Gutzeit <[email protected]>
| Newsgroups | gmane.comp.web.perlfect-search |
|---|---|
| Message-ID | <[email protected]> |
Am Fri, 23 Aug 2002 17:06:34 +0200 Daniel Naber <[email protected]> schrieb: > It tries to index an unlimited number of URL like these: > http://lfsforum.org/ghostbb/login.php?goto=... > > So you have to limit (conf/no_index.txt) the URLs so that these pages > are ignored. Then (if $HTTP_MAX_PAGES is big enough) the howto pages > will be found. Hi That's not the problem, the no_index.txt is configured ok, it indexes only that files that it should index, but it didn't index the howtos. Only if I set @HTTP_LIMIT_URLS it indexes my howtos, but then it didn't index anything else. @HTTP_FILES_URLS is an arry, so I have tried @HTTP_FILES_URLS = ('http://lfsforum.org/', 'http://lfsforum.org/howtos/'), I think then it should index the howtos and the other pages (that should be indexed), but its always indexing the other pages only and not the howtos. I hope you understand what I say, my english is not so good. :-( > Regards > Daniel best regards Jens -- Hilfe zu LFS Problemen: http://www.lfsforum.de Public Key: http://lfsforum.org/jens-gutzeit.asc _______________________________________________ perlfect-search mailing list [email protected] To unsubscribe, set other personal options or view the list archives please visit: http://perlfect.com/mailman/listinfo/perlfect-search