Re: Search Engines CFID/CFTOKEN

2004-03-19 Thread Thomas Chiverton
On Friday 19 Mar 2004 13:22 pm, Brad Roberts wrote: append cfid/cftoken to every url.However, I don't want search engines to index my sites with a cfid/cftoken.Any way around this? Check the browser string and do something different if it's a spider. -- Tom Chiverton Advanced ColdFusion

RE: Search Engines CFID/CFTOKEN

2004-03-19 Thread Brad Roberts
comprise a list of the top crawlers, and if so, any suggestions on a list of (popular) words to test against? -Brad -Original Message- From: Thomas Chiverton [mailto:[EMAIL PROTECTED] Sent: Friday, March 19, 2004 8:40 AM To: CF-Talk Subject: Re: Search Engines CFID/CFTOKEN On Friday 19 Mar