Re: robots.txt problem with google?

2006-12-14 Thread Dan Jenkins
Bill Ricker wrote: > My syslog tells me I have currentlt 303 hits from googlebot Are any of them for robots.txt? Just curious. There have been rumors of fake Googlebot spiders for awhile. I've never investigated them, so I don't know the reality of them. Just something to consider. -- Da

Re: robots.txt problem with google?

2006-12-14 Thread Ted Roche
On Dec 13, 2006, at 2:53 PM, Kevin D. Clark wrote: http://www.google.com/support/webmasters/bin/answer.py? answer=35237&topic=8475 That's a handy link. I used the webmaster tools and my Google account to link them together and verify the configuration of several robots.txt as well as see s

[GNHLUG] MerriLUG Nashua, Thur 21 December, "I had a Secret!" - Swap-fest

2006-12-14 Thread Jim Kuzdrall
Who  : All of us, including you What : Favorite utility, web sites, man pages, debugging techniques Where: Martha's Exchange Day  : Thur 21 December **Next Week** Time : 6:00 PM for grub, 7:30 PM for discussion :: Overview Due to the holidays, no formal presentation is scheduled. Instead,

Re: robots.txt problem with google?

2006-12-14 Thread Bill Ricker
> My syslog tells me I have currentlt 303 hits from googlebot Are any of them for robots.txt? Just curious. Good question! The follow-up is, is robots.txt 444 or 600 ? Maybe you can see it and Google can't. Or maybe it's the other robots.txt. If this is the same host as your email, which i