Thanks, Ron. That gives me some good ideas. One thing I didn't mention is
that multiple web sites use the template (located on another domain).
So I have something like:
Page on www.domain1.com links to www.domain0.com/redirect.cfm?...
Page on www.domain2.com links to www.domain0.com/redirect.cfm?...
Page on www.domain3.com links to www.domain0.com/redirect.cfm?...
Page on www.domain4.com links to www.domain0.com/redirect.cfm?...
Page on www.domain5.com links to www.domain0.com/redirect.cfm?...
Since domain0.com needs to be indexed, I'm thinking that I should create a
sub-directory and tell the robots not to go in there.
Thanks again,
Jim
- Original Message -
From: Ron Hornbaker [EMAIL PROTECTED]
To: CF-Talk [EMAIL PROTECTED]
Sent: Monday, December 10, 2001 4:43 PM
Subject: RE: Keep search engine spyders from following links
Use the disallow feature in robots.txt, and make those links all have a
similar path. We do something similar at http://bookcrossing.com/ for the
links to Amazon... here is our robots.txt file:
http://bookcrossing.com/robots.txt
More info on robots.txt can be found here:
http://www.searchengineworld.com/robots/robots_tutorial.htm
-Ron
-Original Message-
From: Jim McAtee [mailto:[EMAIL PROTECTED]]
Sent: Monday, December 10, 2001 4:28 PM
To: CF-Talk
Subject: OT: Keep search engine spyders from following links
On a couple of web pages, I run links to outside web sites through a CF
template that records the click-through along with some browser
and referer
stats in a table, then redirects the browser to the target URL.
Is there
any way to prevent search engine spyders from following these
links? If I'm
not mistaken, there's no way to use a robots.txt to prevent
this behavior,
or is there?
~~
Get the mailserver that powers this list at http://www.coolfusion.com
FAQ: http://www.thenetprofits.co.uk/coldfusion/faq
Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/
Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists
