The three saddest letters in the english language: IIS
-----Original Message----- From: Barney Boisvert [mailto:bboisv...@gmail.com] Sent: Wednesday, May 27, 2009 11:18 AM To: cf-talk Subject: Re: Dynamic robots.txt Use mod_rewrite to rewrite robots.txt to robots.txt.cfm internally and have it generate whatever it needs. We don't generate any robots.txt files dynamically, we generate several static versions (robots_something.txt, robots_or_other.txt, etc.), and then use mod_rewrite with RewriteCond checks to serve back the correct one for each request to robots.txt. Doing dynamic generation would be just as easy, we just couldn't scale it sufficiently with that mechanism. Just ensure you return text/plain as your content type. cheers, barneyb On Wed, May 27, 2009 at 6:41 AM, Andy Matthews <amatth...@dealerskins.com> wrote: > > We have an application which delivers about 2000 websites. This is > really nice for lots of things, but not so nice for items such as > robots.txt where we might want unique values. Reviewing the spec for > robots.txt it requires that sitemap references be absolute paths > (while everything else can be root relative). As a hard coded file we obviously can't do this. > > A coworker had the idea to "delete" our robots.txt file and use our > 404 handler to toss that request to ColdFusion, and write in the > absolute path to our sitemap each time the file is requested. > > 1) Can this be done reliably? > 2) Is anyone out there doing this already and could answer these questions? > > Andy Matthews > Senior Web Developer > > www.dealerskins.com > > P Please consider the environment before printing this e-mail. > > Total customer satisfaction is my number 1 priority! If you are not > completely satisfied with the service I have provided, please let me > know right away so I can correct the problem, or notify my manager > Aaron West at aw...@dealerskins.com. > > > > > ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~| Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:322829 Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=11502.10531.4
