On Thu, Nov 25, 1999 at 12:18:11AM -0600, Geoff Hutchison wrote:
> Hi,
>
> I was referred to your remarks on ht://Dig in the context of picking
> a search engine for the Debian pages. I don't know what version you
> were looking at when you made your remarks about ht://Dig, but for
> one it does support local indexing (and has for over a year).
>
Thanks for the response. It appeared that development on ht://Dig had
stalled (this was well over a year ago) so I didn't reevaluate it.
> One suggestion is that if you're trying it out, you'll want to use
> the unstable package or compile it yourself. The "stable" version is
> quite buggy in comparison with more recent versions. If you want to
> see details about what's changed in recent versions, see
> <http://www.htdig.org/RELEASE.html>
>
> I'll also reply to your requirements:
[snip]
Sounds like some good work is being done.
My biggest concern is still speed. The Debian mailing list archives
contain over 160000 files (> 1.6GB). The last time I tried indexing
this was with 3.0.8b2. Do you think it can handle this? I'm guessing
the most efficient way to handle updates is to reindex the current
month each day, and then merge that with the index for everything
before that.
Another requirement I should have included in the list is the ability
to restrict searches to files with a certain extensions. This is
to handle multiple languages (the web site has (parts) translated into
15 different langauge). Someone wanting only Spanish, would recieve
only files ending in .es.html .
I'm downloading htdig-3.2.0-dev-112199.tar.gz right now and will take
a look at it soon (probably within a week).
BTW, I'll bug the Debian maintainer to package 3.1.3.
--
James (Jay) Treacy
[EMAIL PROTECTED]
------------------------------------
To unsubscribe from the htdig3-dev mailing list, send a message to
[EMAIL PROTECTED]
You'll receive a message confirming the unsubscription.
