These observations are based off the output of htdig during a dig.
1) htdig doesn't understand single quotes in URL's. For example,
<A HREF='http://www.et.byu.edu'>click here</A> in a page will result is
htdig looking for http://www.et.byu.edu/'http://www.et.byu.edu'
2) Redirects (302 or 304) followed by Not Found (404) return the ref as
the original request, like this:
Not found: http://www2.et.byu.edu/~joshm/ Ref:
http://www.et.byu.edu/~joshm/
Instead of returning the page with the original request. It would be
more useful if it treated the 'redirect page' as an alias instead of a
page to be indexed. It would also work if it treated it the same as a
404, but still follow the indicated link.
Gordon
----------------------------------------------------------------------
To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED] containing the single word "unsubscribe" in
the body of the message.
