Thanks, Ron. That gives me some good ideas. One thing I didn't mention is that multiple web sites use the template (located on another domain).
So I have something like: Page on www.domain1.com links to www.domain0.com/redirect.cfm?... Page on www.domain2.com links to www.domain0.com/redirect.cfm?... Page on www.domain3.com links to www.domain0.com/redirect.cfm?... Page on www.domain4.com links to www.domain0.com/redirect.cfm?... Page on www.domain5.com links to www.domain0.com/redirect.cfm?... Since domain0.com needs to be indexed, I'm thinking that I should create a sub-directory and tell the robots not to go in there. Thanks again, Jim ----- Original Message ----- From: "Ron Hornbaker" <[EMAIL PROTECTED]> To: "CF-Talk" <[EMAIL PROTECTED]> Sent: Monday, December 10, 2001 4:43 PM Subject: RE: Keep search engine spyders from following links > Use the "disallow" feature in robots.txt, and make those links all have a > similar path. We do something similar at http://bookcrossing.com/ for the > links to Amazon... here is our robots.txt file: > > http://bookcrossing.com/robots.txt > > More info on robots.txt can be found here: > > http://www.searchengineworld.com/robots/robots_tutorial.htm > > -Ron > > > > -----Original Message----- > > From: Jim McAtee [mailto:[EMAIL PROTECTED]] > > Sent: Monday, December 10, 2001 4:28 PM > > To: CF-Talk > > Subject: OT: Keep search engine spyders from following links > > > > > > On a couple of web pages, I run links to outside web sites through a CF > > template that records the click-through along with some browser > > and referer > > stats in a table, then redirects the browser to the target URL. > > Is there > > any way to prevent search engine spyders from following these > > links? If I'm > > not mistaken, there's no way to use a robots.txt to prevent > > this behavior, > > or is there? > ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Get the mailserver that powers this list at http://www.coolfusion.com FAQ: http://www.thenetprofits.co.uk/coldfusion/faq Archives: http://www.mail-archive.com/cf-talk@houseoffusion.com/ Unsubscribe: http://www.houseoffusion.com/index.cfm?sidebar=lists
