Ok I have been getting some really weird hits on my websites and they don't
contain a IP or host in the log.
. - - [02/Jan/2006:01:59:37 -0800] GET /robots.txt HTTP/1.0 200 54 -
Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)
Has anyone else been getting these as well? And does anyone
The missing IP/Host of course. I have never seen this before and I
know it didn't come from anything I do here. This just started to happen.
Scott
On Mon 2 January 2006 12:59, Gerry Danen wrote:
Scott, what's the mystery, the missing IP or the GET robots.txt?
Gerry
On 1/2/06, Scott
:
Does it happen with real visitors also, or just bots?
On 1/2/06, Scott Grayban [EMAIL PROTECTED] wrote:
The missing IP/Host of course. I have never seen this before and I
know it didn't come from anything I do here. This just started to happen.
Scott
On Mon 2 January 2006 12:59
in it.
You want to pursue this off-list?
Gerry
On 1/2/06, Scott Grayban [EMAIL PROTECTED] wrote:
Looks like only bots. I have a few hits of robots.txt getting hit first
then
it crawls the site but thats but I have more hits to the robots.txtwithout
a
crawl.
It almost feels virus
