I have a sneaking suspicion that these questions have been raised before,
but I've gone through the FAQ and documents on the site, as well as Google
Groups, and I really haven't found definitive answers.  So if these are well
known problems, just point me to the URLs please.

My basic problem is that I want to spider secure urls (https://).  I gather
that htdig 3.1.6 can handle https url's if ssl has been included in the
make. I also gather that there was (or is) some sort of OpenSSL patch for
3.1.6, and that the ssl implementation on version 3.2 is unreliable if not
broken.

So if anyone could point me to some answers to the following questions, I
would really appreciate it.

 - Does the current stable htDig really support indexing https urls and is
there any special requirements to set this up, other than pointing to the
urls in htdig.conf?

 - Does the makefile for building 3.1.6 have to be modified to support https
urls?  Is this documented somewhere?

 - What's the story on this OpenSSL patch?

 - Will this ssl-enabled htdig fail if the certificate information does not
match the site url (not untypical when dealing with a self generated
certificate.)?

 - One of the emails I researched referenced an external script,
'handler.pl' that was used to get around problems with https sites.  Does
anyone know anything about it or where to get it?

Some background on our system:

The machine is an Sun Enterprise 250
OS is Solaris
Current version of OpenSSL is 0.9.6b (and we're moving to upgrade that)
There is an htDig 3.1.6 version installed on this machine, but it is not
clear from reviewing the make log that the part of the compile that linked
to OpenSSL was completed successfully.

Any help gratefully accepted.  We've been using htDig on several non-secure
internal sites and everyone has had a lot of praise for it.  This request is
the result of moving one of those sites to a secured external machine so
that it's content can be accessed by employees and partners outside of our
corporate firewall.

Regards,

John

Charles John Pedersen
Sr. Systems Engineer
SRI International
Menlo Park, CA 94025
650-859-5913





-------------------------------------------------------
This SF.NET email is sponsored by: FREE  SSL Guide from Thawte
are you planning your Web Server Security? Click here to get a FREE
Thawte SSL guide and find the answers to all your  SSL security issues.
http://ads.sourceforge.net/cgi-bin/redirect.pl?thaw0026en
_______________________________________________
htdig-general mailing list <[EMAIL PROTECTED]>
To unsubscribe, send a message to <[EMAIL PROTECTED]> with a 
subject of unsubscribe
FAQ: http://htdig.sourceforge.net/FAQ.html

Reply via email to