I have finally been able to get to look at htdig and immediately ran into
a problem. When searching locally, it finds files using links. This breaks
in our case because we use content negotiation, so htdig doesn't find
any files.
In case you aren't familiar with content negotiation, it is a mechanism
which allows a web server to decide which version of a file to send.
for example, a link to foo may choose to return any of foo.en.html,
foo.de.html or foo.fr.html depending on what the client sends as
the preferred language. I am hoping that htdig will be able to index
all the possible responses.
If this isn't possible, I guess we'll have to go through a server to
index the main part of the site and index the mailing lists separately.
--
James (Jay) Treacy
[EMAIL PROTECTED]
------------------------------------
To unsubscribe from the htdig3-dev mailing list, send a message to
[EMAIL PROTECTED]
You will receive a message to confirm this.