I've thought about that... but, what's the best way to implement it?
Maybe...

<cfif findNoCase(cgi.user_agent, "google")>
  don't append cfid/cftoken
<cfelse>
  append cfid/cftoken
</cfif>

Without keeping a massive list of search engine UA's, is there a another way
to check for spiders?  Or, would you just comprise a list of the top
crawlers, and if so, any suggestions on a list of (popular) words to test
against?

-Brad
  -----Original Message-----
  From: Thomas Chiverton [mailto:[EMAIL PROTECTED]
  Sent: Friday, March 19, 2004 8:40 AM
  To: CF-Talk
  Subject: Re: Search Engines & CFID/CFTOKEN

  On Friday 19 Mar 2004 13:22 pm, Brad Roberts wrote:
  > append cfid/cftoken to every url.  However, I don't want search engines
to
  > index my sites with a cfid/cftoken.  Any way around this?

  Check the browser string and do something different if it's a spider.

  --
  Tom Chiverton
  Advanced ColdFusion Programmer

  Tel: +44(0)1749 834997
  email: [EMAIL PROTECTED]
  BlueFinger Limited
  Underwood Business Park
  Wookey Hole Road, WELLS. BA5 1AF
  Tel: +44 (0)1749 834900
  Fax: +44 (0)1749 834901
  web: www.bluefinger.com
  Company Reg No: 4209395 Registered Office: 2 Temple Back East, Temple
  Quay, BRISTOL. BS1 6EG.
  *** This E-mail contains confidential information for the addressee
  only. If you are not the intended recipient, please notify us
  immediately. You should not use, disclose, distribute or copy this
  communication if received in error. No binding contract will result from
  this e-mail until such time as a written document is signed on behalf of
  the company. BlueFinger Limited cannot accept responsibility for the
  completeness or accuracy of this message as it has been transmitted over
  public networks.***
[Todays Threads] [This Message] [Subscription] [Fast Unsubscribe] [User Settings]

Reply via email to