Hi all, I just saw a report that ht://Dig has trouble with non-PC line endings in the robots.txt file -- it requires CR/LF. Is this current? I searched the site and could not tell. If so, could you add checks for just CR (Mac line end character) and just LF (Unix line end character)? Avi ------------------------------------ To unsubscribe from the htdig mailing list, send a message to [EMAIL PROTECTED] You will receive a message to confirm this.
- [htdig] Indexing proteted servers spantke
- Re: [htdig] Indexing proteted servers Paul DuBois
- Re: [htdig] line endings in robots.txt? nets
- Re: [htdig] line endings in robots.txt? Geoff Hutchison
- Re: [htdig] Indexing proteted servers Geoff Hutchison
- Re: [htdig] Indexing proteted servers Paul DuBois
- Re: [htdig] Indexing proteted servers Geoff Hutchison
