Webboard: Indexer with regex

Author: Laurent
Email: 
Message:
Hi Alex,

Ok, I finally found the issue...

First, there was a:
Allow NoMatch Regex \.php$|\.cgi$|\.pl$

Activated. Because of it, mostly all URLs were acceptable.

This because this allow was before the disallow related to the servers.
This totally changed my approach of the indexing file.

Before, I was Allowing/Disallow specific wide patterns (*.suffix etc), than the disallow of URLs and then allow of URLs.
Now I disallow servers first, then allow/disallow wide patterns and finally server allows.

This strongly lowered by unsupported content-type statistics as well:-)

Thanks for your support !!

Reply: <http://www.mnogosearch.org/board/message.php?id=21584>

_______________________________________________
General mailing list
[email protected]
http://lists.mnogosearch.org/listinfo/general