Hello. I'm using ht://Dig 3.1.6. I seem to be having the same problem reported in 1998 where ht:dig was not indexing pages with the robots meta tag set to content="index,nofollow":
http://www.htdig.org/mail/1998/09/0235.html http://www.htdig.org/mail/1998/09/0303.html Are any of you experiencing this same problem with version 3.1.6? Could there be some other configuration problem I'm overlooking? It indexes pages correctly that have content="index,follow". Regards, Garrel Renick ------------------------------------------------------- This sf.net email is sponsored by: To learn the basics of securing your web site with SSL, click here to get a FREE TRIAL of a Thawte Server Certificate: http://www.gothawte.com/rd524.html _______________________________________________ htdig-general mailing list <[EMAIL PROTECTED]> To unsubscribe, send a message to <[EMAIL PROTECTED]> with a subject of unsubscribe FAQ: http://htdig.sourceforge.net/FAQ.html
