[htdig] htdig ignores robots.txt

[Collin Gayde]

Has anyone seen where htdig (appearntly) is ignoring robots.txt.    

 

 

Collin Gayde
Systems Programmer (Unix)
Office of Information Technology
Indiana State University
[EMAIL PROTECTED]