Hi, I have a little problem concerning wwwoffle and ht-dig, I'm not sure what the problem is, but I have a theory. The problem started when for no apparent reason, htdig failed to index my wwwoffle cache. Sometimes htdig would succeed and others it won't. And then after some time (I didn't have much time to dive into the problem) htdig no longer was able to build the index. Looking at the log: New server: al-berkeh, 8080 0:0:0:http://al-berkeh:8080/search/start4.html: ++ size = 584 1:1:1:http://al-berkeh:8080/search/start3.html: + size = 497 2:2:1:http://al-berkeh:8080/search/index/: +++ size = 167 3:3:2:http://al-berkeh:8080/search/start2.html: + size = 497 4:4:2:http://al-berkeh:8080/search/index/http/: not found 5:5:2:http://al-berkeh:8080/search/index/ftp/: +++++++++++++++++++++++++++++++++ ++++++++++++++++++++++++++++++++++++++ size = 2539 6:6:2:http://al-berkeh:8080/search/index/finger/: size = 100 As you can see it seems that htdig couldn't find the 'search/index/http/'. The link when used in a browser would give: <html> <head> <meta name="robots" content="noindex"> <title></title> </head> <body> ... </body> </html>
So it seems there's no reason why htdig would say 'not found', but there's a catch. The list is long, and it might take some time for the computer (with a Cyrix 100MHz processor) to deliver it. Could a timeout be the cause of the problem? If so, can this timeout be changed? Fadi Mansour [EMAIL PROTECTED]
