Ronnie Koch <[EMAIL PROTECTED]> writes: > > > I have been using wwwoffle for a couple of years and only recently decided > > > to get the htdig search operational - with minimal success. I upgraded to > > > 2.7a, from source, this week from 2.6d on RedHat 7.2 (Intel). The original > > > cache was xfered from another machine that ran 2.5x and was converted to > > > work with 2.6d (months ago). > > > > > > 0. I can only search the WWWOFFLE FAQ & Welcome pages with htdig.
> Problem resolved. I removed the "Disallow: /index" from robots.txt. > > FWIW > > ht://Dig 3.2.0b3 > wwwoffled version 2.7a > > Thanks - once I realised that */search/index had hidden links the rest was > easy :-) If you needed to remove the "Disallow: /index" line from the robots.txt file then this indicates a bug with ht://Dig. The version of ht://Dig that I use (3.1.6) does not have this problem. None of the URLs that are linked to from the indexing start page http://localhost:8080/search/start4.html use any URLs that start with '/index'. If the robots.txt file is stopping the search then it is a bug with the parsing of that file which is done by the searcher. -- Andrew. ---------------------------------------------------------------------- Andrew M. Bishop [EMAIL PROTECTED] http://www.gedanken.demon.co.uk/ WWWOFFLE users page: http://www.gedanken.demon.co.uk/wwwoffle/version-2.7/user.html
