What have people found is a good a exclude_urls setting ?
I found one system here had a cgi type directory called chbin
which I needed to go and exclude. I'm sure there must be some others out
there with all these ASP, Cold Fusion type things.
Is there a correct procedure for going "oh hell" stopping the
htdig, adding the exclude and re-running, I've seen some funny DB errors
being printed out. (I'm still working out what the check database
commands are). Cool program.
'C' ya ...
A.R. Internet, Sydney, Australia. Voice 02-9809-5333 Fax 02-9809-9199
Internet - SLIP/PPP Accounts $24.95/$34.95 a Month or $2.50 per hour.
FULL Internet connection. (ftp, irc, telnet, www). No Setup Fee. 56k
Web Page http://www.ar.com.au Telnet to the BBS telnet://bbs.ar.com.au
------------------------------------
To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED] containing the single word "unsubscribe" in
the SUBJECT of the message.
