On Wed, 1 Dec 2004, Andre wrote:
Can htdig skip url with characters like ' ? = * ' when it is crawling ?
You might check to see whether either of the following attributes is helpful for what you are trying to accomplish.
http://www.htdig.org/attrs.html#bad_querystr http://www.htdig.org/attrs.html#exclude_urls
Jim
-------------------------------------------------------
SF email is sponsored by - The IT Product Guide
Read honest & candid reviews on hundreds of IT Products from real users.
Discover which products truly live up to the hype. Start reading now. http://productguide.itmanagersjournal.com/
_______________________________________________
ht://Dig general mailing list: <[EMAIL PROTECTED]>
ht://Dig FAQ: http://htdig.sourceforge.net/FAQ.html
List information (subscribe/unsubscribe, etc.)
https://lists.sourceforge.net/lists/listinfo/htdig-general
