Hi,I'd like to have a robots.txt on a site that has the following apache httpd config:
<Location /> SetHandler perl-script PerlHandler RT::Mason </Location>But if I install a robots.txt to the DocumentRoot and test it via wget I just download the front page of the site, as its handled by perl-script. It it possible to have a robots.txt in this situation?
thanks for any tips, Andy.