The only thing my inexperienced mind could think of is a meta tag to exclude those you 
dont want indexed.

At 7:45 PM -0500 3/15/99, Seri Sandeep wrote:
>Hi,
>
>I want to index only html files. Having limit_url_to set to html
>and limit normalised set to ${start_url} almost worked.
>The only problem was some servers (all?) interpret a URL ending
>in a / as /index.html and many authors use this to skip the
>index.html. Any ideas about how to get around this?
>
>Thanks,
>Sandeep
>
>------------------------------------
>To unsubscribe from the htdig mailing list, send a message to
>[EMAIL PROTECTED] containing the single word "unsubscribe" in
>the SUBJECT of the message.



------------------------------------
To unsubscribe from the htdig mailing list, send a message to
[EMAIL PROTECTED] containing the single word "unsubscribe" in
the SUBJECT of the message.

Reply via email to