On Tue, Oct 13, 2009 at 6:44 PM, abhishek jain <abhishek.netj...@gmail.com>wrote:
> > I found the ip was 75.101.221.99 and the useragent was "ia_archiver (+ > http://www.alexa.com/site/help/webmasters; craw...@alexa.com) > > Can anyone suggest what to do now, have someone else faced a similar > problem > before, > AFAIK, the Alexa crawler must be determining your website statistics like page views per day, number of visitors etc. to determine your page rank, website rank etc. Check out www.alexa.com for more information. And if you want to block robots to your website, modify your robots.txt file. I dont know the exact settings.. just search for them. -- Regards Chirag Anand Junior Systems Architect E2E Networks | <http://www.e2enetworks.com> chirag.an...@e2enetworks.com Blog :http://techfreaks4u.com/blog anything weird is worth a try... _______________________________________________ ilugd mailinglist -- ilugd@lists.linux-delhi.org http://frodo.hserus.net/mailman/listinfo/ilugd Archives at: http://news.gmane.org/gmane.user-groups.linux.delhi http://www.mail-archive.com/ilugd@lists.linux-delhi.org/
