Bill Ricker wrote:
> My syslog tells me I have currentlt 303 hits from googlebot
Are any of them for robots.txt? Just curious.
There have been rumors of fake Googlebot spiders for awhile.
I've never investigated them, so I don't know the reality of them.
Just something to consider.
--
Da
On Dec 13, 2006, at 2:53 PM, Kevin D. Clark wrote:
http://www.google.com/support/webmasters/bin/answer.py?
answer=35237&topic=8475
That's a handy link. I used the webmaster tools and my Google account
to link them together and verify the configuration of several
robots.txt as well as see s
Who : All of us, including you
What : Favorite utility, web sites, man pages, debugging techniques
Where: Martha's Exchange
Day : Thur 21 December **Next Week**
Time : 6:00 PM for grub, 7:30 PM for discussion
:: Overview
Due to the holidays, no formal presentation is scheduled. Instead,
> My syslog tells me I have currentlt 303 hits from googlebot
Are any of them for robots.txt? Just curious.
Good question! The follow-up is, is robots.txt 444 or 600 ?
Maybe you can see it and Google can't.
Or maybe it's the other robots.txt.
If this is the same host as your email, which i