On Wed, May 27, 2009 at 8:17 PM, Michael Dinowitz wrote:
I've gone the route of rewriting IIS's 404 handler in the past and I highly
suggest against it. Mapping .txt to CF would work, but that means every .txt
file will be handled, not just robots.txt.
So don't put *.txt in your web.xml, but
We have an application which delivers about 2000 websites. This is really
nice for lots of things, but not so nice for items such as robots.txt where
we might want unique values. Reviewing the spec for robots.txt it requires
that sitemap references be absolute paths (while everything else can be
Another solution is to assign files with extension .txt to CF as well.
Then CF will be able to generate correct paths.
Unless you have very large other txt files that would then been parsed
by CF as well and consume too much time.
Matthews [mailto:amatth...@dealerskins.com]
Sent: Wednesday, May 27, 2009 8:41 AM
To: cf-talk
Subject: Dynamic robots.txt
We have an application which delivers about 2000 websites. This is really
nice for lots of things, but not so nice for items such as robots.txt where
we might want unique values
Use mod_rewrite to rewrite robots.txt to robots.txt.cfm internally and
have it generate whatever it needs. We don't generate any robots.txt
files dynamically, we generate several static versions
(robots_something.txt, robots_or_other.txt, etc.), and then use
mod_rewrite with RewriteCond checks
The three saddest letters in the english language:
IIS
-Original Message-
From: Barney Boisvert [mailto:bboisv...@gmail.com]
Sent: Wednesday, May 27, 2009 11:18 AM
To: cf-talk
Subject: Re: Dynamic robots.txt
Use mod_rewrite to rewrite robots.txt to robots.txt.cfm internally and have
language:
IIS
-Original Message-
From: Barney Boisvert [mailto:bboisv...@gmail.com]
Sent: Wednesday, May 27, 2009 11:18 AM
To: cf-talk
Subject: Re: Dynamic robots.txt
Use mod_rewrite to rewrite robots.txt to robots.txt.cfm internally and have
it generate whatever it needs. We don't
: Barney Boisvert [mailto:bboisv...@gmail.com]
Sent: Wednesday, May 27, 2009 11:18 AM
To: cf-talk
Subject: Re: Dynamic robots.txt
Use mod_rewrite to rewrite robots.txt to robots.txt.cfm internally and have
it generate whatever it needs. We don't generate any robots.txt files
dynamically, we
A coworker had the idea to delete our robots.txt file and use our 404
handler to toss that request to ColdFusion, and write in the absolute path
to our sitemap each time the file is requested.
1) Can this be done reliably?
2) Is anyone out there doing this already and could answer these
[mailto:bboisv...@gmail.com]
Sent: Wednesday, May 27, 2009 11:28 AM
To: cf-talk
Subject: Re: Dynamic robots.txt
Ha! I've never used it, but isapi_rewrite
(http://www.isapirewrite.com/) is pretty equivalent; it should let you do
the same thing. They have a free version that is probably sufficient
I've gone the route of rewriting IIS's 404 handler in the past and I highly
suggest against it. Mapping .txt to CF would work, but that means every .txt
file will be handled, not just robots.txt. What I do for my clients is use
the ionic isapi to watch for any call to robots.txt and then redirect
I second Michael's suggestion of IIRF, http://www.codeplex.com/IIRF - it's
pretty good.
Now, back to the original question, how to make a dynamic robots.txt file.
Why not generate it? Throw together a script that generates the content of
your file, then write it to the web root of your web
http://www.packtpub.com/learning-ext-js/book
_
http://blog.cutterscrossing.com
On 5/27/2009 2:43 PM, Nathan Strutz wrote:
I second Michael's suggestion of IIRF, http://www.codeplex.com/IIRF - it's
pretty good.
Now, back to the original question, how to make a dynamic
Strutz wrote:
I second Michael's suggestion of IIRF, http://www.codeplex.com/IIRF -
it's
pretty good.
Now, back to the original question, how to make a dynamic robots.txt
file.
Why not generate it? Throw together a script that generates the content
of
your file, then write
14 matches
Mail list logo
