Webboard: Can't get indexer to pick up news Docs on index page
| Newsgroups | gmane.comp.web.mnogosearch.general |
|---|---|
| Message-ID | <[email protected]> |
Author: Momma Email: Message: Greetings! in my indexer.conf I have: ============================ Tag news MaxHops 4 Period 1m Server page http://domain.com/news/headlines/index.shtml Server page http://domain.com/news/headlines/archive.shtml Period 7d Server path http://domain.com/news/headlines/articles/ ============================ index.shtml and archive.shtml are basically lists of pages to be indexed. All of the pages to be indexed are at http://domain.com/news/headlines/articles/#####.shtml But, when I run indexer it refuses to index new pages that it finds. I have used the following: ./indexer -u "http://domain.com/news/headlines/index.shtml" -a ./indexer -u "http://domain.com/news/headlines/%" My understanding is that indexer should find new URLs from the index.shtml page and then immediately index them. The 7d Period should not affect brand new URLs that have yet to be indexed? I just want to check this page several times a day and immediately index *new* URLS. I do not want the Period for /news/headlines/articles/ set low because there are thousands of pages and I do not want it to have to check all those pages each time when all I want is new URLs. Appreciate any insight. TIA! Reply: <http://www.mnogosearch.org/board/message.php?id=18088>