PROTECTED]
Subject: RE: [wdvltalk] (Possible OT) To Robots or not, that is the
question...
IMHO, there is no harm in having a robot file. It's just a guide for the
robots to follow. Spiders don't need to follow it, but the main 'bots do. I
see it as more of a "you don't need
]
Sent: Thursday, December 09, 2004 10:25 AM
To: [EMAIL PROTECTED]
Subject: RE: [wdvltalk] (Possible OT) To Robots or not, that is the
question...
Well, if it were that easy then of course I would do it. However, I know
that with some good comes bad, and I'm curious about the bad. I thoug
bject: RE: [wdvltalk] (Possible OT) To Robots or not, that is the
question...
Do you want to be in Google?
If you don't allow them to index your site you will not be listed.
Cheryl D. Wise
Certified Professional Web Developer
Microsoft FrontPage MVP
http://wiserways.com
-Original Message
Do you want to be in Google?
If you don't allow them to index your site you will not be listed.
Cheryl D. Wise
Certified Professional Web Developer
Microsoft FrontPage MVP
http://wiserways.com
-Original Message-
From: Todd Richards
Hey gang -
I have had the good old "robots.txt" fi
