RE: [analog-help] analog vs. webtrends - anybody done any exhaustive comparison on data accuracy?
I struggled for a long long time to reconcile analog and webtrends, and eventually succeeded (within 5%). are you sure webtrends is counting 302 redirects? I'm pretty sure ours doesn't. maybe you have to specify the status codes in the webtrends filters. I'm not sure what kind of filtering you do, but ours is rather detailed, so it took some effort to make sure that the filters of both apps had the same criteria even though the filtering logic is very different. for starters, analog filters are sequential and more configurable, while webtrends works do-all-includes-first-then-all-excludes, certainly less flexible. and watch out for the internal settings of each webtrends filter; I orignally didn't take into account how the ANDs and the ORs of those settings. > -Original Message- > From: Dave Atkins [mailto:[EMAIL PROTECTED]] > Sent: Tuesday, February 20, 2001 6:27 PM > To: [EMAIL PROTECTED] > Subject: [analog-help] analog vs. webtrends - anybody done any > exhaustive comparison on data accuracy? > > > I think we all have a webtrends story to tell...but basically > my problem now > is that we started using analog and when we run webtrends on > the same data, > we get different results--sometimes big differences like > 700,000 vs. 900,000 > page views for a site. I was wondering if anyone had done a > comparison and > identified the differences in how the two products work, to > help justify a > decision to abandon webtrends. > > For example, in the case above, I tracked down the problem to > discoving that > analog discards all 302 redirects while webtrends appears to > count them if > the referer fails. This could happen, for example, if you > have a lot of > .shtml pages supporting a legacy system where the .shtml > redirects stale > links to new dynamic pages AND you are using a caching product like > SpiderCache to cache your dynamic pages. What happens in the > log files is > that you see an entry for a page like: > product_12345.shtml with a 302 code and then, in some cases, > you see a hit > to showproduct.asp?productID=12345 with a code 200. This is the normal > behavior. But if the showproduct.asp page is cached > externally or running on > another server, there will never be the followup request in > your server log. > At least this is what I could figure out so far. > > My conclusion is that analog is discarding all 302s > (reasonable behavior) > but webtrends must "care" if the referer actually succeeds. > If there is no > subsequent 200 from the same IP address, the original 302 is > counted. That > seems a little too "smart" for the likes of webtrends, but it > is the only > way I can explain my discrepancies. When I look at the file > types report > from both WT and analog, I see many more .shtml types recorded by > webtrends...not quite a 1:1 of course, but that is how I > started looking > into the .shtml files as the possible culprit. > > Anyway, I just wondered if anyone had a document summarizing > the differences > which would help me as I have to explain why if we use > analog, it means > fewer page views which means that 18 people (the site > managers) are going to > be coming after me! > > Dave Atkins > > -- > -- > This is the analog-help mailing list. To unsubscribe from this > mailing list, send mail to [EMAIL PROTECTED] > with "unsubscribe" in the main BODY OF THE MESSAGE. > List archived at > http://www.mail-archive.com/analog-help@lists.isite.net/ > -- > -- > This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
RE: [analog-help] can't get the views that I want??? Help please.
I have become very familiar with the config files and running separate reports for various things...is there any easy way to combine the reports into a useful interface, for example, by using Report Magic? I looked at www.reportmagic.com, but before I download it and try it out, I wondered if this was the right approach. I need to produce daily and monthly reports for 20 different websites. Right now, I just name the reports with names like audio_M0102.html for Feb 2001 audio website...then audio_D010201.html would be Feb 1 daily... But this is kind of un-navigable when you have a listing of 600+ files. Basically, I want the webtrends reporting interface so that users can easily click through to a particular report. But do I need to write a perl script myself, or is this easy to do with some other product like reportmagic? I've thought about putting the reports in directories, but I'd rather not do the work of writing the interface if it already has been done! :) Analog is great at doing single reports...just need some way to index those reports so that users can get to the one they want. Jeffrey M Watson wrote: > I am running analog on my logfiles which are in the MICROSOFT-NA LOGFORMAT. > > the path to my logfiles is like this: "S:\Merl\logs\W3SVC2\in*.log" and > "S:\Merl\logs\W3SVC1\in*.log" > > > I want to be able to see evreything for /marketing only, but can not figure > out how to do this. "One run. One report." Each view you are requesting will probably require its own configuration file and produce its own set of reports. To get everything in /marketing use a configuration setting like FILEINCLUDE /marketing/* (this assumes no previous FILEINCLUDE or FILEEXCLUDE). See docs/include.html for details. > I would like to show this information on a daily basis. e.g. see how many > page requests there were in every day for the last month and have them > ordered in order of greatest to smallest. Is there a way to do this? The Daily Report shows traffic on a daily basis. To enable the daily report use FULLDAILY ON or (for 4.90Beta) DAILYREP ON See docs/output.html#replist for a list of all report commands. You can see this in any report configuration. If you don't have page views listed, create a custom columns setting that shows them, something like: FULLDAILYCOLS PRBd or DAILYREPCOLS PRBd See docs/timereps.html#timeCOLS for details. > Also, how do I configure it so that I can see all requests for a certain > file type (eg. *.mp3) ??? Again, you can do this by setting up a specific configuration file that includes FILEINCLUDE *.mp3 The same warnings apply as above. -- Jeremy Wadsack Wadsack-Allen Digital Group This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/ This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
Re: [analog-help] can't get the views that I want??? Help please.
Dave Atkins wrote: > I have become very familiar with the config files and running separate > reports for various things...is there any easy way to combine the reports > into a useful interface, for example, by using Report Magic? I looked at > www.reportmagic.com, but before I download it and try it out, I wondered if > this was the right approach. > > I need to produce daily and monthly reports for 20 different websites. Right > now, I just name the reports with names like audio_M0102.html for Feb 2001 > audio website...then audio_D010201.html would be Feb 1 daily... But this is > kind of un-navigable when you have a listing of 600+ files. Basically, I > want the webtrends reporting interface so that users can easily click > through to a particular report. But do I need to write a perl script myself, > or is this easy to do with some other product like reportmagic? I've thought > about putting the reports in directories, but I'd rather not do the work of > writing the interface if it already has been done! :) There's a reportmagic mailing list that might be the better place to ask such a question, but nonetheless Report Magic will create one report file (or set of report files) for each Analog report you create. It has no ability to provide navigation between separate report sets (for periods of time or websites, for example). However, it would not be too complicated to write a script that produces this interface: You could create a list or set of lists that allow each site to navigate their reports. Then make an index.html page is their stats directory (or whatever) that is a frameset containing the navigation panel and the report magic reports in another frame. Other users have asked for this type of thing and I'm sure you could easily make it work for Analog or Report Magic. If do get this working and were to contribute it back, by requesting it posted on the Analog Helper Applications page and Report Magic Add-Ons pages, I'm sure many users would appreciate it. Good luck, -- Jeremy Wadsack Wadsack-Allen Digital Group This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
[analog-help] analog vs. webtrends - anybody done any exhaustive comparison on data accuracy?
I think we all have a webtrends story to tell...but basically my problem now is that we started using analog and when we run webtrends on the same data, we get different results--sometimes big differences like 700,000 vs. 900,000 page views for a site. I was wondering if anyone had done a comparison and identified the differences in how the two products work, to help justify a decision to abandon webtrends. For example, in the case above, I tracked down the problem to discoving that analog discards all 302 redirects while webtrends appears to count them if the referer fails. This could happen, for example, if you have a lot of .shtml pages supporting a legacy system where the .shtml redirects stale links to new dynamic pages AND you are using a caching product like SpiderCache to cache your dynamic pages. What happens in the log files is that you see an entry for a page like: product_12345.shtml with a 302 code and then, in some cases, you see a hit to showproduct.asp?productID=12345 with a code 200. This is the normal behavior. But if the showproduct.asp page is cached externally or running on another server, there will never be the followup request in your server log. At least this is what I could figure out so far. My conclusion is that analog is discarding all 302s (reasonable behavior) but webtrends must "care" if the referer actually succeeds. If there is no subsequent 200 from the same IP address, the original 302 is counted. That seems a little too "smart" for the likes of webtrends, but it is the only way I can explain my discrepancies. When I look at the file types report from both WT and analog, I see many more .shtml types recorded by webtrends...not quite a 1:1 of course, but that is how I started looking into the .shtml files as the possible culprit. Anyway, I just wondered if anyone had a document summarizing the differences which would help me as I have to explain why if we use analog, it means fewer page views which means that 18 people (the site managers) are going to be coming after me! Dave Atkins This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
Re: [analog-help] can't get the views that I want??? Help please.
Jeffrey M Watson wrote: > I am running analog on my logfiles which are in the MICROSOFT-NA LOGFORMAT. > > the path to my logfiles is like this: "S:\Merl\logs\W3SVC2\in*.log" and > "S:\Merl\logs\W3SVC1\in*.log" > > > I want to be able to see evreything for /marketing only, but can not figure > out how to do this. "One run. One report." Each view you are requesting will probably require its own configuration file and produce its own set of reports. To get everything in /marketing use a configuration setting like FILEINCLUDE /marketing/* (this assumes no previous FILEINCLUDE or FILEEXCLUDE). See docs/include.html for details. > I would like to show this information on a daily basis. e.g. see how many > page requests there were in every day for the last month and have them > ordered in order of greatest to smallest. Is there a way to do this? The Daily Report shows traffic on a daily basis. To enable the daily report use FULLDAILY ON or (for 4.90Beta) DAILYREP ON See docs/output.html#replist for a list of all report commands. You can see this in any report configuration. If you don't have page views listed, create a custom columns setting that shows them, something like: FULLDAILYCOLS PRBd or DAILYREPCOLS PRBd See docs/timereps.html#timeCOLS for details. > Also, how do I configure it so that I can see all requests for a certain > file type (eg. *.mp3) ??? Again, you can do this by setting up a specific configuration file that includes FILEINCLUDE *.mp3 The same warnings apply as above. -- Jeremy Wadsack Wadsack-Allen Digital Group This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
[analog-help] can't get the views that I want??? Help please.
I am running analog on my logfiles which are in the MICROSOFT-NA LOGFORMAT. the path to my logfiles is like this: "S:\Merl\logs\W3SVC2\in*.log" and "S:\Merl\logs\W3SVC1\in*.log" I want to be able to see evreything for /marketing only, but can not figure out how to do this. I would like to show this information on a daily basis. e.g. see how many page requests there were in every day for the last month and have them ordered in order of greatest to smallest. Is there a way to do this? Also, how do I configure it so that I can see all requests for a certain file type (eg. *.mp3) ??? Thank you for your help in advance! This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
[analog-help] Result of tests
OK, sorry about all the tests this morning. Here's the result, in case anyone's interested. Messages with a subject line containing the string "warning message" are rejected, because the listbot thinks they're bounced messages. This is probably quite sensible, as anyone who remembers our fun with Brian Staubach last September will testify. :) Now that I know what the problem is, I can forward any more such messages to the list manually. -- Stephen Turner http://www.statslab.cam.ac.uk/~sret1/ Statistical Laboratory, Wilberforce Road, Cambridge, CB3 0WB, England "Your account can only be used for a single internet session at any one time and for no more than 24 hours in any one day." (NTL terms of use) This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
RE: [analog-help] warning [Test 9] message
Title: RE: [analog-help] warning [Test 9] message What's the problem? Patrick CAPRON 03.88.14.82.07 [EMAIL PROTECTED] -Message d'origine- De: Stephen Turner [mailto:[EMAIL PROTECTED]] Date: mardi 20 février 2001 14:17 À: analog-help Objet: [analog-help] warning [Test 9] message Test 9. -- Stephen Turner http://www.statslab.cam.ac.uk/~sret1/ Statistical Laboratory, Wilberforce Road, Cambridge, CB3 0WB, England "Your account can only be used for a single internet session at any one time and for no more than 24 hours in any one day." (NTL terms of use) This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
[analog-help] message warning [Test 8]
Test 8 -- Stephen Turner http://www.statslab.cam.ac.uk/~sret1/ Statistical Laboratory, Wilberforce Road, Cambridge, CB3 0WB, England "Your account can only be used for a single internet session at any one time and for no more than 24 hours in any one day." (NTL terms of use) This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
[analog-help] warning [Test 9] message
Test 9. -- Stephen Turner http://www.statslab.cam.ac.uk/~sret1/ Statistical Laboratory, Wilberforce Road, Cambridge, CB3 0WB, England "Your account can only be used for a single internet session at any one time and for no more than 24 hours in any one day." (NTL terms of use) This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
[analog-help] message [Test 7]
Test 7. -- Stephen Turner http://www.statslab.cam.ac.uk/~sret1/ Statistical Laboratory, Wilberforce Road, Cambridge, CB3 0WB, England "Your account can only be used for a single internet session at any one time and for no more than 24 hours in any one day." (NTL terms of use) This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
[analog-help] warning
test 5 -- Stephen Turner http://www.statslab.cam.ac.uk/~sret1/ Statistical Laboratory, Wilberforce Road, Cambridge, CB3 0WB, England "Your account can only be used for a single internet session at any one time and for no more than 24 hours in any one day." (NTL terms of use) This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
[analog-help] Is this list working?
Something seems to be wrong, which is how my password got to the list (I've changed it now, so don't try anything :). This is a test message to investigate. There may be other test messages. Anyway, here's the answer to Marc's question: Marc Fournier wrote: > > I'm using stdin for my logfile, so would like to silence this one if > possible, without affecting any other Warnings that might crop up ... > > analog: Warning D: LOGFORMAT in configuration file /usr/local/etc/analog.cfg > with no subsequent LOGFILE > (For help on all errors and warnings, see docs/errors.html) > > I see the 'DEBUG -D' option in the docs, but is it possible to more finely > tune it, or is that about it? > No, that's the finest grained control you have. -- Stephen Turner http://www.statslab.cam.ac.uk/~sret1/ Statistical Laboratory, Wilberforce Road, Cambridge, CB3 0WB, England "Your account can only be used for a single internet session at any one time and for no more than 24 hours in any one day." (NTL terms of use) This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
No Subject
Approved: wilforce
Received: by lists.isite.net (bulk_mailer v1.12); Mon, 19 Feb 2001 11:01:52
-0800
Received: (from majordom@localhost)
by lists.isite.net (8.9.3/8.9.3) id LAA12909
for analog-help-localoutlist; Mon, 19 Feb 2001 11:01:50 -0800 (PST)
Received: from mobile.hub.org (mobile.acadiau.ca [131.162.137.70])
by lists.isite.net (8.9.3/8.9.3) with ESMTP id LAA12905
for <[EMAIL PROTECTED]>; Mon, 19 Feb 2001 11:01:47 -0800
(PST)
Received: from localhost (scrappy@localhost)
by mobile.hub.org (8.11.1/8.11.1) with ESMTP id f1JJ1k004300
for <[EMAIL PROTECTED]>; Mon, 19 Feb 2001 15:01:46 -0400
(AST)
(envelope-from [EMAIL PROTECTED])
X-Authentication-Warning: mobile.hub.org: scrappy owned process doing -bs
Date: Mon, 19 Feb 2001 15:01:46 -0400 (AST)
From: The Hermit Hacker <[EMAIL PROTECTED]>
To: <[EMAIL PROTECTED]>
Subject: silencing warning message ... ?
Message-ID: <[EMAIL PROTECTED]>
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII
Sender: [EMAIL PROTECTED]
Reply-To: [EMAIL PROTECTED]
Precedence: bulk
I'm using stdin for my logfile, so would like to silence this one if
possible, without affecting any other Warnings that might crop up ...
analog: Warning D: LOGFORMAT in configuration file /usr/local/etc/analog.cfg
with no subsequent LOGFILE
(For help on all errors and warnings, see docs/errors.html)
I see the 'DEBUG -D' option in the docs, but is it possible to more finely
tune it, or is that about it?
Thanks ...
Marc G. Fournier ICQ#7615664 IRC Nick:
Scrappy
Systems Administrator @ hub.org
primary: [EMAIL PROTECTED] secondary:
scrappy@{freebsd|postgresql}.org
--
Stephen Turner http://www.statslab.cam.ac.uk/~sret1/
Statistical Laboratory, Wilberforce Road, Cambridge, CB3 0WB, England
"Your account can only be used for a single internet session at any one
time and for no more than 24 hours in any one day." (NTL terms of use)
