Webboard: url file

Author: Marti
Email: 
Message:
Okay, How do I make sure now the indexer does not follow any outside 

links/server that are not listed in my url.txt?



> Hi,

> 

> > Hi, I want to index/crawl hundred servers so

> > I have a file with

> > 

> > Tag computer

> > http://www.A.com/

> > http://www.B.com/

> > http://www.C.com/

> > 

> > 

> > then I run

> > ./indexer -i -f url.txt

> > 

> > but I get the message

> > 

> > No 'Server' command for url

> > 

> > 

> > (Tried to put Server in fornt but did not help)

> 

> The text file url.txt should contain only URLs, one entry per line,

> without any "Server" commands.

> 

> Don't forget to push this command into indexer.conf:

> 

> Realm site *

> 

> Otherwise, you'll get the "No 'Server' command for url" errors.

> 

Reply: <http://www.mnogosearch.org/board/message.php?id=21045>