This may be premature but I had to ask... I have added some urls to my start_url in htdig.conf (v3.2.0b4).
3 of the 5 of them have no content and 2 of them are as follows: 1) <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN" "http://www.w3.org/TR/html4/strict.dtd";> <HTML> <HEAD> <TITLE>LIS 5364 Introduction to Final Project</TITLE> <META NAME="description" content="Introduction to defining your target audience for a web site."> <META NAME="keywords" content=""> <META HTTP-EQUIV="content-type" content="text/html; charset=ISO-8859-1"> <META HTTP-EQUIV="Content-Language" CONTENT="en"> <META NAME="Author" content="Patricia Wellwood"> <LINK REL=StyleSheet HREF="style.css" TYPE="text/css"> </HEAD> <BODY> Under Construction </BODY> </HTML> 2) <html> Just a test will be update soon. </html> ----------that's it. I ran ./rundig several times, checked my conf and then searched for"under", "test" and for "construction" and got nomatch, so i checked it again and then ran ./rundig -vvvv -below is what I got. Is there anything in there that prevents my search? (or anything you might advise be changed considering I'll be adding about 45 more URLs). %./rundig -vvvv ht://dig Start Time: Sat Dec 1 00:40:30 2001 1:1:http://slis-two.lis.fsu.edu/~G634-1/ New server: slis-two.lis.fsu.edu, 80 - Persistent connections: enabled - HEAD before GET: disabled - Timeout: 30 - Connection space: 0 - Max Documents: -1 - TCP retries: 1 - TCP wait time: 5 Trying to retrieve robots.txt file Making HTTP request on http://slis-two.lis.fsu.edu/robots.txt Header line: HTTP/1.1 404 Not Found Header line: Date: Sat, 01 Dec 2001 05:40:30 GMT Header line: Server: Apache/1.3.14 (Unix) Header line: Transfer-Encoding: chunked Header line: Content-Type: text/html; charset=iso-8859-1 No modification time returned: assuming now Retrieving document /robots.txt on host: slis-two.lis.fsu.edu:80 Http version : HTTP/1.1 Server : HTTP/1.1 Status Code : 404 Reason : Not Found Access Time : Sat, 01 Dec 2001 00:40:30 GMT Modification Time : Sat, 01 Dec 2001 05:40:30 GMT Content-type : text/html; charset=iso-8859-1 Transfer-encoding : chunked Request time: 0 secs pushed 1:1:http://slis-two.lis.fsu.edu/~G634-2/ Rejected: URL not in the limits! 1:1:http://slis-two.lis.fsu.edu/~G634-16/index.htm pushed 1:1:http://slis-two.lis.fsu.edu/~G634-24/ Rejected: URL not in the limits! 1:1:http://slis-two.lis.fsu.edu/~G634-31/ Rejected: URL not in the limits! pick: slis-two.lis.fsu.edu, # servers = 1 > slis-two.lis.fsu.edu supports HTTP persistent connections (infinite) 0:2:0:http://slis-two.lis.fsu.edu/~G634-1/: Making HTTP request on http://slis-two.lis.fsu.edu/~G634-1/ Header line: HTTP/1.1 403 Forbidden Header line: Date: Sat, 01 Dec 2001 05:40:30 GMT Header line: Server: Apache/1.3.14 (Unix) Header line: Transfer-Encoding: chunked Header line: Content-Type: text/html; charset=iso-8859-1 No modification time returned: assuming now Retrieving document /~G634-1/ on host: slis-two.lis.fsu.edu:80 Http version : HTTP/1.1 Server : HTTP/1.1 Status Code : 403 Reason : Forbidden Access Time : Sat, 01 Dec 2001 05:40:30 GMT Modification Time : Sat, 01 Dec 2001 05:40:30 GMT Content-type : text/html; charset=iso-8859-1 Transfer-encoding : chunked Request time: 0 secs not found 1:3:0:http://slis-two.lis.fsu.edu/~G634-16/index.htm: Making HTTP request on http://slis-two.lis.fsu.edu/~G634-16/index.htm Header line: HTTP/1.1 404 Not Found Header line: Date: Sat, 01 Dec 2001 05:40:30 GMT Header line: Server: Apache/1.3.14 (Unix) Header line: Transfer-Encoding: chunked Header line: Content-Type: text/html; charset=iso-8859-1 No modification time returned: assuming now Retrieving document /~G634-16/index.htm on host: slis-two.lis.fsu.edu:80 Http version : HTTP/1.1 Server : HTTP/1.1 Status Code : 404 Reason : Not Found Access Time : Sat, 01 Dec 2001 05:40:30 GMT Modification Time : Sat, 01 Dec 2001 05:40:30 GMT Content-type : text/html; charset=iso-8859-1 Transfer-encoding : chunked Request time: 0 secs not found pick: slis-two.lis.fsu.edu, # servers = 1 > slis-two.lis.fsu.edu supports HTTP persistent connections (infinite) ht://dig End Time: Sat Dec 1 00:40:30 2001 Deleted, not found: ID: 2 URL: http://slis-two.lis.fsu.edu/~G634-1/ Deleted, not found: ID: 3 URL: http://slis-two.lis.fsu.edu/~G634-16/index.htm Preamble text: Postamble text: Note: This message will be sent again if you do not change or take away the notification of the above mentioned HTML page. Find out more about the notification service at http://www.htdig.org/meta.html Cheers! ht://Dig Notification Service Thank you very much, -Ted Rogers _______________________________________________ htdig-general mailing list <[EMAIL PROTECTED]> To unsubscribe, send a message to <[EMAIL PROTECTED]> with a subject of unsubscribe FAQ: http://htdig.sourceforge.net/FAQ.html
