RE: How to stop bots indexing my dev sites

2008-02-13 Thread Rick Faircloth
lder. I've used them for files, but not folders/directories. Rick > -Original Message- > From: Will Swain [mailto:[EMAIL PROTECTED] > Sent: Wednesday, February 13, 2008 11:59 AM > To: CF-Talk > Subject: RE: How to stop bots indexing my dev sites > > Do you put

RE: How to stop bots indexing my dev sites

2008-02-13 Thread Will Swain
Do you put it up in the client's webspace, under their domain? I just put all clients dev work under a single folder in my domain, and use the robots.txt file to exclude that folder. Will -Original Message- From: Rick Faircloth [mailto:[EMAIL PROTECTED] Sent: 13 February 2008 15:57

RE: How to stop bots indexing my dev sites

2008-02-13 Thread Brad Wood
I'm half joking, but it would probably work... Associate .txt files with CF and make your robots.txt dynamic. :) A more plausible solution might be to protect the entire folder the dev site is in with .htaccess or something so someone out there can't just hit it with out a token login. ~Brad --