On Mon, 22 Nov 2004, Andre wrote:
When I use the attributes "local_urls_only: true "and " local_urls:" the crawler follows the link in the index.html file or it fetches all the files in the directory ?
htdig indexes by following links.
If htdig follows the link , how can I index my local file system ?
Take a look at http://www.htdig.org/FAQ.html#q5.25. This FAQ covers a couple possibilities for indexing unlinked files.
Jim
-------------------------------------------------------
SF email is sponsored by - The IT Product Guide
Read honest & candid reviews on hundreds of IT Products from real users.
Discover which products truly live up to the hype. Start reading now. http://productguide.itmanagersjournal.com/
_______________________________________________
ht://Dig general mailing list: <[EMAIL PROTECTED]>
ht://Dig FAQ: http://htdig.sourceforge.net/FAQ.html
List information (subscribe/unsubscribe, etc.)
https://lists.sourceforge.net/lists/listinfo/htdig-general
