Hi, sorry, but this did not work. As now when I type the http://domain.com/robots.txt the page returned is from within my cms application and not from the default
I am using the python framework itools (http://www.hforge.org) and this has in its URI a semi-column i.e. http://www.hforge.org/;view Can I call my robots.txt file anything? Cheers Norman On Thu, Jan 22, 2009 at 6:40 PM, Bob Ionescu <[email protected]> wrote: > 2009/1/22 Norman Khine <[email protected]>: >> Is there a way I can put a robots.txt file to reside outside of the >> rewrite, so that if a the bots look for http://domain.com/robots.txt >> the rewrite does not push it to the >> localhost:12080/companies/robots.txt > > Just exclude the specific path: > > RewriteCond $1 !=robots.txt > RewriteRule ^/(.*) http://localhost:12080/companies/$1 [P] > > Bob > > --------------------------------------------------------------------- > The official User-To-User support forum of the Apache HTTP Server Project. > See <URL:http://httpd.apache.org/userslist.html> for more info. > To unsubscribe, e-mail: [email protected] > " from the digest: [email protected] > For additional commands, e-mail: [email protected] > > --------------------------------------------------------------------- The official User-To-User support forum of the Apache HTTP Server Project. See <URL:http://httpd.apache.org/userslist.html> for more info. To unsubscribe, e-mail: [email protected] " from the digest: [email protected] For additional commands, e-mail: [email protected]
