While watching verbore output during htdig, I noticed that the process is often processing urls like http:/foo.bar/doc/?M=D, http:/foo.bar/doc/?D=A, http:/foo.bar/doc/?N=A, and http:/foo.bar/doc/?N=D. This appears to be creating a significant amount of duplication and I would like to prevent this from happening. Is there a fix or some other config option I need to deal with? Thanks in advance. Tim ------------------------------------ To unsubscribe from the htdig mailing list, send a message to [EMAIL PROTECTED] You will receive a message to confirm this. List archives: <http://www.htdig.org/mail/menu.html> FAQ: <http://www.htdig.org/FAQ.html>
