Can you send the contents of robots.txt? It looks like indexing is
being disallowed.
Found 'disallow' line:
Pattern:
pushed
1:1:http://bdis/ skipped
even though the error message is perhaps misleading.
Do you get the same result if you remove the robots.txt file?
Just a thought...
Ted Stresen-Reuter
On Jan 25, 2006, at 9:57 AM, Wolfgang Winkler wrote:
Hi,
i have a problem with htdig.
This is the first time i use htdig, maybe its a very simple error.
i start htdig -vvv and get the following output:
bdfl01:~ # htdig -vvv
0:1:http://bdis/
New server: bdis, 80
Retrieval command for http://bdis/robots.txt: GET /robots.txt HTTP/1.0
User-Agent: htdig/3.1.6 ([EMAIL PROTECTED])
Host: bdis
Header line: HTTP/1.1 200 OK
Header line: Date: Wed, 25 Jan 2006 09:46:28 GMT
Header line: Server: Apache/2.0.49 (Linux/SuSE)
Header line: Last-Modified: Tue, 10 Jan 2006 12:37:48 GMT
Converted Tue, 10 Jan 2006 12:37:48 GMT to Tue, 10 Jan 2006 12:37:48
Header line: ETag: "1447f-18-40a00620adf00"
Header line: Accept-Ranges: bytes
Header line: Content-Length: 24
Header line: Connection: close
Header line: Content-Type: text/plain; charset=ISO-8859-1
Header line:
returnStatus = 0
Read 24 from document
Read a total of 24 bytes
Parsing robots.txt file using myname = htdig
Robots.txt line: User-Agent: *
Found 'user-agent' line: *
Robots.txt line: Disallow:
Found 'disallow' line:
Pattern:
pushed
1:1:http://bdis/ skipped
pick: bdis, # servers = 1
0:1:0:http://bdis/: Unable to build connection with bdis:80
no server running
pick: bdis, # servers = 1
bdfl01:~ #
it says "Unable to build connection with bdis:80" but why the
robots.txt is found?
any suggestions are welcome.
Best regards
Mit freundlichen Grüßen
Wolfgang Winkler
--
Landeshauptstadt München, Kreisverwaltungsreferat
Branddirektion, Sachgebiet Informationsverarbeitung
An der Hauptfeuerwache 8, 80331 München
Tel.: 089 2353-6169 E-Mail: [EMAIL PROTECTED]
-------------------------------------------------------
This SF.net email is sponsored by: Splunk Inc. Do you grep through log
files
for problems? Stop! Download the new AJAX search engine that makes
searching your log files as easy as surfing the web. DOWNLOAD SPLUNK!
http://sel.as-us.falkag.net/sel?cmd=lnk&kid3432&bid#0486&dat1642
_______________________________________________
ht://Dig general mailing list: <[email protected]>
ht://Dig FAQ: http://htdig.sourceforge.net/FAQ.html
List information (subscribe/unsubscribe, etc.)
https://lists.sourceforge.net/lists/listinfo/htdig-general
-------------------------------------------------------
This SF.net email is sponsored by: Splunk Inc. Do you grep through log files
for problems? Stop! Download the new AJAX search engine that makes
searching your log files as easy as surfing the web. DOWNLOAD SPLUNK!
http://sel.as-us.falkag.net/sel?cmd=lnk&kid3432&bid#0486&dat1642
_______________________________________________
ht://Dig general mailing list: <[email protected]>
ht://Dig FAQ: http://htdig.sourceforge.net/FAQ.html
List information (subscribe/unsubscribe, etc.)
https://lists.sourceforge.net/lists/listinfo/htdig-general
