> start_url: http://www.indiainfo.com/
> limit_urls_to: indiainfo.com
> You should put *all* your hosts on *.indiainfo.com
> in the start_url
> directive and set limit_urls_to to ${start_url}
>
>
strange, it was always working for me. Infact when I
index I see it indexing all the other domains of
indiainfo.com also.
I suspected that it was not indexing the whole thing
because the number of files had increased.
bgm
__________________________________________________
Do You Yahoo!?
Bid and sell for free at http://auctions.yahoo.com
------------------------------------
To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED] containing the single word unsubscribe in
the SUBJECT of the message.
