[EMAIL PROTECTED] (Russell Coker) wrote in message news:<[EMAIL PROTECTED]>... > I have a nasty web spider with an agent name of "LinkWalker" downloading > everything on my site (including .tgz files). Does anyone know anything > about it?
It's apparantly a link-validation robot operated by a company called SevenTwentyFour Incorporated, see: http://www.seventwentyfour.com/tech.html I found your post while searching for information on this robot while tracking its spoor through our HTTP logs here. > I've added the following to my firewall setup to stop further attacks... > > # crappy LinkWalker - evil spider that downloads every file including .tgz on > # the site > iptables -A INPUT -j logitrej -p tcp -s 209.167.50.25 -d 0.0.0.0/0 --dport www We were hit from 209.167.50.22; if you want to use iptables to block this spider, I'd block all of NETBLK-NET-SEVEN24AUU1, 209.167.50.16 - 209.167.50.31. Personally, I think this is a rogue organization -- there was an entry from this spider in our logs coming from a Seven24 IP with a HTTP referrer of www.adultinterracialsexvideos.com/interracialsex/interracialgroupsexsen.html. Needless to say, we do not run an adult web site and that referrer site does NOT have a link to us. Likely Seven24 is trying to clutter people's logs with references as a form of advertising. -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]