Hello - Got to the bottom of this.
- My HOSTEXCLUDE file was working and correctly excluding hosts. - I needed a BROWEXCLUDE for each of the lines of my ROBOTINCLUDE - I was using ROBOTINCLUDE as opposed to ROBOTEXCLUDE. So, I have now got statistics with no (or at least very few) robots in them, with which I am pleased. Many thanks, Hamish > -----Original Message----- > From: [EMAIL PROTECTED] > [mailto:[EMAIL PROTECTED] On Behalf Of > Hamish Symington > Sent: 26 August 2005 11:43 > To: Support for analog web log analyzer > Subject: RE: [analog-help] Hostexclude / OS report / Request > report/Robot-type question > > > > > > My hostexcludes file is along the lines of > > > > > > HOSTEXCLUDE 38.118.73.250* > > > HOSTEXCLUDE 111.111.111.111* > > > etc... > > > > > > I reckon that this list of hostexcludes should exclude > all requests > > > from > > > > > > robots from *all* of my reports. > > > > > > However, if I look at Operating System Report, I get about 75% of > > > requests coming from 'Known robots' > > > > > > What is listed in your logfiles -- numerical IP addresses or > > resolved names? > > If you have resolved names in your logfiles, you need to use > > resolved names > > in the HOSTEXCLUDE commands too. > > > They're numeric. Two sample lines from the logfile (one from > a bot, one > from a person): > > #Fields: date time s-computername s-ip cs-method cs-uri-stem > cs-uri-query s-port cs-username c-ip cs(User-Agent) cs(Cookie) > cs(Referer) sc-status sc-substatus sc-win32-status sc-bytes cs-bytes > time-taken > 2005-08-26 00:08:28 BABBAGE 131.111.25.53 GET /companies/clp/ - 80 - > 38.118.73.250 > Dumbot(version+0.1+beta+-+http://www.dumbfind.com/dumbot.html) > - - 200 0 > 0 9257 475 375 > 2005-08-26 00:10:10 BABBAGE 131.111.25.53 GET > /staff/transferring/in/ - > 80 - 80.41.15.230 > Mozilla/4.0+(compatible;+MSIE+6.0;+Windows+NT+5.1;+SV1;+Tiscal > i+IEAK+6.0 > +October+2001+NN-HB-028E;+.NET+CLR+1.1.4322) - - 200 0 0 7700 511 250 > > I've made sure that the tickboxes in the IIS logfile options specified > in the Analog setup are all ticked (as you can probably tell from this > sample). > > Hamish > > +------------------------------------------------------------- > ----------- > | TO UNSUBSCRIBE from this list: > | http://lists.meer.net/mailman/listinfo/analog-help > | > | Analog Documentation: http://analog.cx/docs/Readme.html > | List archives: http://www.analog.cx/docs/mailing.html#listarchives > | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general > +------------------------------------------------------------- > ----------- > +------------------------------------------------------------------------ | TO UNSUBSCRIBE from this list: | http://lists.meer.net/mailman/listinfo/analog-help | | Analog Documentation: http://analog.cx/docs/Readme.html | List archives: http://www.analog.cx/docs/mailing.html#listarchives | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general +------------------------------------------------------------------------
