For anyone interested ... It occurred to me that I was using the same 'custom' noindex definition in 3.2.0b6 that I was using without problems in 3.1.6:
noindex_start: <!-- citysearch_noindex --> noindex_end: <!-- /citysearch_noindex --> On a hunch that this was somehow making htdig brain dead on comments in general, I removed that from the .conf file and re-indexed. Seems to be fine now. (Took the opportunity to switch to the <noindex follow></noindex> tagging that makes it easier to do what I really want the spider to do anyway. Although, I wouldn't be able to use those tags if the pages weren't generated dynamically, allowing me to insert the tags only for htdig without breaking valid xhtml .... such as it is :-) SRB ------------------------------------------------------------------------- Take Surveys. Earn Cash. Influence the Future of IT Join SourceForge.net's Techsay panel and you'll get the chance to share your opinions on IT & business topics through brief surveys - and earn cash http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV _______________________________________________ ht://Dig general mailing list: <[email protected]> ht://Dig FAQ: http://htdig.sourceforge.net/FAQ.html List information (subscribe/unsubscribe, etc.) https://lists.sourceforge.net/lists/listinfo/htdig-general
