Webboard: url file

[email protected]
Newsgroups gmane.comp.web.mnogosearch.general
Message-ID <[email protected]>
Author: Alexander Barkov
Email: [email protected]
Message:
> Okay, How do I make sure now the indexer does not follow any outside 

> links/server that are not listed in my url.txt?



With the "Realm site *"  command it should not follow outside links.



> 

> > Hi,

> > 

> > > Hi, I want to index/crawl hundred servers so

> > > I have a file with

> > > 

> > > Tag computer

> > > http://www.A.com/

> > > http://www.B.com/

> > > http://www.C.com/

> > > 

> > > 

> > > then I run

> > > ./indexer -i -f url.txt

> > > 

> > > but I get the message

> > > 

> > > No 'Server' command for url

> > > 

> > > 

> > > (Tried to put Server in fornt but did not help)

> > 

> > The text file url.txt should contain only URLs, one entry per line,

> > without any "Server" commands.

> > 

> > Don't forget to push this command into indexer.conf:

> > 

> > Realm site *

> > 

> > Otherwise, you'll get the "No 'Server' command for url" errors.

> > 

Reply: <http://www.mnogosearch.org/board/message.php?id=21047>
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.