> How is the password protection implemented? If it's via server-side
> passwords (e.g. the browser throws up a dialog box) this should work.
> If it's via some sort of CGI, it's not easy to do--you'll have to
> figure out some way to authenticate the htdig robot to the CGI.
Easiest way is often to hack the CGI script to allow the crawler's IP.
Slightly less secure is hacking the CGI script to allow the crawler's
'browser type'.
DS
------------------------------------
To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED]
You will receive a message to confirm this.
