This happens only on *my* own site. The others work ok. What is causing
it to be 'skipped'? There is no "robots.txt". What is the reason for
looking for one?
=== Cut ===
0:0:http://www.karicobs.com/
New server: www.karicobs.com, 80
Retrieval command for http://www.karicobs.com/robots.txt: GET
/robots.txt HTTP/1.0
User-Agent: htdig/3.1.3 ([EMAIL PROTECTED])
Host: www.karicobs.com
Header line: HTTP/1.1 404 Not Found
Header line: Date: Fri, 29 Oct 1999 15:08:25 GMT
Header line: Server: Apache/1.3.9 (Unix)
Header line: Connection: close
Header line: Content-Type: text/html
Header line:
returnStatus = 1
pushed
1:0:http://www.karicobs.com/ skipped
pick: www.karicobs.com, # servers = 1
0:1:255:http://www.karicobs.com/: Retrieval command for
http://www.karicobs.com/: GET / HTTP/1.0
User-Agent: htdig/3.1.3 ([EMAIL PROTECTED])
If-Modified-Since: Fri, 29 Oct 1999 15:07:04 GMT
Host: www.karicobs.com
Header line: HTTP/1.1 304 Not Modified
Header line: Date: Fri, 29 Oct 1999 15:08:25 GMT
Header line: Server: Apache/1.3.9 (Unix)
Header line: Connection: close
Header line: ETag: "b20a0-197a-3819b818"
Header line:
returnStatus = 2
not changed
pick: www.karicobs.com, # servers = 1
=== Cut ===
KS
------------------------------------
To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED] containing the single word unsubscribe in
the SUBJECT of the message.
