On 25/03/2004 15:36, Rupert Jones wrote:
Perhaps I should've articulated a little more.

8-)


I don't want to use META robots since that will prevent Search Engines from
indexing the site.

I thought about creating a custom htdig-robots.txt file specifically for
htdig.

Can't you make the .php sensitive to the user-agent string and deliver the appropriate META directive?


regards, Malcolm.


------------------------------------------------------- This SF.Net email is sponsored by: IBM Linux Tutorials Free Linux tutorial presented by Daniel Robbins, President and CEO of GenToo technologies. Learn everything from fundamentals to system administration.http://ads.osdn.com/?ad_id=1470&alloc_id=3638&op=click _______________________________________________ ht://Dig general mailing list: <[EMAIL PROTECTED]> ht://Dig FAQ: http://htdig.sourceforge.net/FAQ.html List information (subscribe/unsubscribe, etc.) https://lists.sourceforge.net/lists/listinfo/htdig-general

Reply via email to