I'm using htdig on my office intranet to index several different sites. Last week when adding several manuals to my doc site they did not appear to be indexed after rundig completed.
Hope a follow up is ok to my own question. Turns out there were a bunch of files that had
<META NAME="ROBOTS" CONTENT="NOINDEX">
in their html doc head. :)
Live and learn.
BTW, is there any way to do an incremental index operation? My DB files are approaching 100MB and as I add content to be indexed it'd be nice to have a way to just index the new stuff and update with that only.
Marty Landman Face 2 Interface Inc 845-679-9387 Free Formmailer: http://face2interface.com/Products/Formal.shtml FormATable DB: http://face2interface.com/Products/FormATable.shtml Make a Website: http://face2interface.com/Home/Demo.shtml
------------------------------------------------------- SF.Net is sponsored by: Speed Start Your Linux Apps Now. Build and deploy apps & Web services for Linux with a free DVD software kit from IBM. Click Now! http://ads.osdn.com/?ad_id=1356&alloc_id=3438&op=click _______________________________________________ ht://Dig general mailing list: <[EMAIL PROTECTED]> ht://Dig FAQ: http://htdig.sourceforge.net/FAQ.html List information (subscribe/unsubscribe, etc.) https://lists.sourceforge.net/lists/listinfo/htdig-general
