Re: Indexing and searching multiple domains
Daniel Naber <[email protected]>
| Newsgroups | gmane.comp.web.perlfect-search |
|---|---|
| Message-ID | <[email protected]> |
On Friday 31 January 2003 21:17, Ken Petersen wrote: > I am using Perlfect 3.30. I need to be able to search 2 or more domains > and have the results come back as one set on the same web page. Is > this > something that indexing via HTTP can handle? If you set @HTTP_LIMIT_URLS accordingly, yes. You may only index your own servers and you need to watch indexing progress because the crawler might get stuck somewhere and will not stop. Also robots.txt files are currently ignored. > If so, can I also put all > the files/folders I want excluded from the search from both domains > into > one noindex.txt file? Yes. > Also is there a limit to the number of domains > that can be indexed this way? Theoretically not. In reality, however, Perlfect Search was written only for one server. Regards Daniel -- http://www.danielnaber.de _______________________________________________ perlfect-search mailing list [email protected] To unsubscribe, set other personal options or view the list archives please visit: http://perlfect.com/mailman/listinfo/perlfect-search