Re: Indexing HTML comments - FOLLOW UP

For anyone interested ...

It occurred to me that I was using the same 'custom' noindex definition in 3.2.0b6 that I was using without problems in 3.1.6:

 noindex_start:  <!-- citysearch_noindex -->
 noindex_end:    <!-- /citysearch_noindex --> 

On a hunch that this was somehow making htdig brain dead on comments in general, I removed that from the .conf file and re-indexed.

Seems to be fine now.

(Took the opportunity to switch to the <noindex follow></noindex> tagging that makes it easier to do what I really want the spider to do anyway. Although, I wouldn't be able to use those tags if the pages weren't generated dynamically, allowing me to insert the tags only for htdig without breaking valid xhtml .... such as it is :-)

SRB



-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
_______________________________________________
ht://Dig general mailing list: <[email protected]>
ht://Dig FAQ: http://htdig.sourceforge.net/FAQ.html
List information (subscribe/unsubscribe, etc.)
https://lists.sourceforge.net/lists/listinfo/htdig-general