Re: [htdig] robots.txt not recognized by htdig-3.2.0b5

On Wed, 31 Mar 2004, Rick wrote: > Just installed htdig-3.2.0b5, but it has some > difficulty reading this robots.txt file ... > > User-agent: grub-client > Disallow: / > User-agent: * > Disallow: > > I believe that the robots.txt syntax is correct. > Release 3.1.6 has no

Re: [htdig] indexing htdig

On Tue, 30 Mar 2004, Webmaster wrote: > When indexing... most of the way through it times-out or something... The file > generated is /searchdata/log This file is 500megs sometimes more sometimes less. > With or without that file the search engine works fine. Is thsi a temporary file??

Re: [htdig] robots.txt not recognized by htdig-3.2.0b5

Hello Rick, On Wed, Mar 31, 2004 at 06:50:00AM +0100, Rick wrote: > Hello htdiggers ... > > Just installed htdig-3.2.0b5, but it has some > difficulty reading this robots.txt file ... > > User-agent: grub-client > Disallow: / > User-agent: * >

Re: [htdig] suggesting additional search results

On Tue, 30 Mar 2004, Mark Maxey wrote: > Is it possible with HTDIG to have htdig suggest other search words when > doing a search. > > for instnace, the world intern and then suggest interns > > or for that matter automatically add the word interns to the search > results for intern You might

[htdig] robots.txt not recognized by htdig-3.2.0b5

Hello htdiggers ... Just installed htdig-3.2.0b5, but it has some difficulty reading this robots.txt file ... User-agent: grub-client Disallow: / User-agent: * Disallow: I believe that the robots.txt syntax is correct. Release 3.1.6 has no problem with it. Any id

[htdig] suggesting additional search results

Is it possible with HTDIG to have htdig suggest other search words when doing a search. for instnace, the world intern and then suggest interns or for that matter automatically add the word interns to the search results for intern and if this is possible, what needs to be done in order to achi

[htdig] indexing htdig

Hi all       Having a problem when indexing...could not find answer in FAQ.       When indexing... most of the way through it times-out or something...  The file generated is /searchdata/log  This file is 500megs sometimes more sometimes less.  With or without that file the search engine wor

Re: Fwd: [htdig] query parameters should be ignored by extension filter?

According to Toby Thain: > >> David Adams wrote: > >> > >>> Toby, > >>> > >>> Did you have a valid_extensions: statement originally? If you did, > >>> then > > it > >>> might be worthwhile trying without it, > >> > >> No, I had no valid_extensions originally. The query URLs were ignored > >> rega

Re: [htdig] query parameters should be ignored by extension filter? - PATCH for 3.2.0b5

According to me: > Last week, I wrote: > > According to David Adams: > > > I am also using ht://Dig version 3.1.6 and for me it IS indexing URLs like > > > > > > http://www.soton.ac.uk/~lopsoc/gallery.php?gallery=sorcerer1&photo=CNV00023.jpg > > > > > > even though I have .jpg in my bad_extension

Re: [htdig] query parameters should be ignored by extension filter? - PATCH for 3.1.6

Last week, I wrote: > According to David Adams: > > I am also using ht://Dig version 3.1.6 and for me it IS indexing URLs like > > > > http://www.soton.ac.uk/~lopsoc/gallery.php?gallery=sorcerer1&photo=CNV00023.jpg > > > > even though I have .jpg in my bad_extensions: list. > > Actually, I find

[htdig] Accents Problem

Hello People, I'am using htdig to index my site (http://www.npaschoalotto.com.br) but the site contains characters with accents and others special character like "ç". Reading the FAQ, i did htfuzy accents and added accents:0.9 in htdig.conf. But they'r not working properl