[analog-help] Re: Huge cache files
Stephen Turner <[EMAIL PROTECTED]> writes: > On 22 Nov 1999, Greg Stark wrote: > > > > > I'm experimenting with cache files and it seems like I'm getting huge cache > > files. 61M in fact. That's a lot smaller than the log files, but I had been > > expecting much smaller files. > > > > They have to store every filename and every hostname that's ever visited > you. But you can compress the cache files if you want. That should take it > down to (say) 15 or 20M at a guess. > > > Are there particular parameters I should be setting in analog.cfg to limit > > the amount of data the cache files need to store? > > > > Well, you can use the LOWMEM commands to stop some types of item being > recorded altogether. You can't save just the top (say) 1000 hosts, because > you don't know if they'll still be the top 1000 next month. I understand, but well, is there a way to do it anyways? Or maybe to just save the first three octets of the ip address (in my case) or to exclude the first component of the DNS name? And does the list of filenames do ARGSEXCLUDE before saving the cachefile stats? in which case it should be ok. These are one day's worth of logs, not monthly, btw... -- greg This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe analog-help" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
Re: [analog-help] Re:Configuration problems
Abigail Marshall wrote: > > I am trying to run a report using an alternate configuration file, which > I called 'hourly.cfg'. This file is in the same directory as analog.cfg, > but when I run a command line directive: > > analog -G +ghourly.cfg > > I get this error message: > > Warning F: Failed to open configuration file > hourly.cfg: ignoring it > > Any idea of what might be causing this? > This file needs to be in the directory that you are calling analog from, or alternatively, you can specify the full path name to the config file hourly.cfg James > -Abigail > > This is the analog-help mailing list. To unsubscribe from this > mailing list, send mail to [EMAIL PROTECTED] > with "unsubscribe analog-help" in the main BODY OF THE MESSAGE. > List archived at http://www.mail-archive.com/analog-help@lists.isite.net/ > -- ** * James McMahon * When all else fails ... * * Secure Gateway Environment * Read the destructions.* * [EMAIL PROTECTED] * -- (unknown) * ** This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe analog-help" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
Re: [analog-help] Re:Configuration problems
I am trying to run a report using an alternate configuration file, which I called 'hourly.cfg'. This file is in the same directory as analog.cfg, but when I run a command line directive: analog -G +ghourly.cfg I get this error message: Warning F: Failed to open configuration file hourly.cfg: ignoring it Any idea of what might be causing this? -Abigail This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe analog-help" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
Re: [analog-help] Reports on single domain names
Bob Gonda wrote: > How do I run out reports for a single Web site? Our reports contain > all the > web sites we manage. Depending on how your site is managed, either FILEINCLUDE/FILEXCLUDE or VHOSTINCLUDE/VHOSTEXCLUDE see docs/include.html for details on these commands HTH -- Jeremy Wadsack Digital Media Consultant ___ Wadsack-Allen Digital Group http://www.wadsack-allen.com/digitalgroup/ This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe analog-help" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
Re: [analog-help] IIS Web Proxy Server Log files
Yes, I do mean Microsoft's Proxy Server. Anything you could provide would be great. I'd also be interested in your shell script. I am already pre-processing the logs with a sheall script to remove some unwanted "fluff", so your script could really help a lot. Dennis Wallace Nicoll <[EMAIL PROTECTED]> on 11/22/99 05:01:32 AM Please respond to [EMAIL PROTECTED] To: [EMAIL PROTECTED] cc:(bcc: Dennis Heltzel/RWDOG/NOR/US/Reuters) Subject: Re: [analog-help] IIS Web Proxy Server Log files > Dennis Heltzel schrieb: > > Has anyone successfully used analog to process logs from > > IIS Web Proxy Server ? > Do you actually mean Microsoft's Proxy Server? In earlier replies to the list I posted a variety of LOGFORMATS for MS-Proxy. However, because of the size of logs that were generated, I ended up writing a UNIX shell script to pull out the fields I wanted, and ditch the other 60% of info that MS-Proxy writes into the logfile, and format it as if it was CLF (Common Log Format) with a much simpler set of LOGFORMAT commands. I'll see if I still have the otriginal LOGFORMAT commands and post them to the list later today. Wallace. -- == Wallace Nicoll [EMAIL PROTECTED] City of Edinburgh Council IT Services, Chesser House, 500 Gorgie Road,Phone : 0131 469 5343 Edinburgh, EH11 3YJ, ScotlandFax : 0131 469 5335 [From overseas [P]+441314695343 [F]+441314695335 ] == This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe analog-help" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/ This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe analog-help" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
Re: [analog-help] Error messages
I have an Apache server with separate log files - access_log, referer_log, agent_log, error_log, etc. My configuration file is sets the files as *log - thereby generating reports on all logs. When I run Analog, I get the following error messages: > > /www/analog4.0/analog: Warning M: Logfile /usr/local/etc/httpd/logs/agent_log > contains lines with no file names: page counts may be low > (For help on all errors and warnings, see docs/errors.html) > /www/analog4.0/analog: Warning M: Logfile /usr/local/etc/httpd/logs/agent_log > contains lines with no bytes: byte counts may be low > /www/analog4.0/analog: Warning M: Logfile > /usr/local/etc/httpd/logs/referer_log contains lines with no bytes: byte > counts may be low > /www/analog4.0/analog: Warning R: Turning off empty Failed Referrer Report I am assuming that the reason I get these error messages is that Analog can not parse out the agent & referer logs properly. I just want to know how to fix this. For reference, a line in the agent_log looks like this: Mozilla/4.06 [en]C-gatewaynet (Win98; I) Analog has no problem generating a browser report - its just griping about information it thinks is missing. A line in the referer_log looks like this: http://www.monkey.org/~gus/ -> /index.htm It would be nice to be able to get a Failed Referrer Report, although maybe the problem is that this information is in the access_log, and can't be correlated with the referer_log () -Abigail This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe analog-help" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
[analog-help] favicon ?
Pardon the 'near topic' topic ... the issue of favicon.ico came up a few months back. (shows up in logs and is used by IE in case you missed it) Was wondering if anyone knows of a utility to convert .gif or .jpg to .ico ?? This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe analog-help" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
[analog-help] Reports on single domain names
Title: Reports on single domain names How do I run out reports for a single Web site? Our reports contain all the web sites we manage.
Re: [analog-help] Re: Installation problem, Analog 4.0
Chris Halverson wrote: > Abigail Marshall <[EMAIL PROTECTED]> writes: > > > Another question: is there a way to set up analog to email a text-based > > report, rather than create an HTML file? I want to do both, actually > > Have your script call 'lynx' or 'w3m' on the report and have it email > you. A 'lynx -dump' would do it. Not quite integrated into Analog, but > other tools already exist for this job. > You could also set the OUTPUT ASCII option in an analog config, with OUTFILE - then in a script redirect to your mailer, something like analog +gmail.cfg | mail [EMAIL PROTECTED] HTH, -- Jeremy Wadsack Digital Media Consultant ___ Wadsack-Allen Digital Group http://www.wadsack-allen.com/digitalgroup/ This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe analog-help" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
[analog-help]
Title: How do I run out reports for a single Web site? Our reports contain all the web sites we manage.
Re: [analog-help] User Report in Analog 4.0 (or Rmagic?)
On Mon, 22 Nov 1999, Alejandro Fernandez wrote: > hi, > > I just ran analog coupled with report magic to produce a sample report for a > guinea pig site over here. > > In the user report, I've spotted a lot of differences. For example, some names > are capitalised in the old version, and are not in the new, others are in > different positions. Most alarmingly, the new reports shows less users than the > old one. > > This is important for those who use analog/rmagic to keep track of the amount > of logged-in users on their sites. > > Please mail me for more info on this. I'll be happy to put the reports where > you can see them, or give config info. > Which version were you using before? Usernames were made case insensitive in version 3.2 which could account for all these differences. (By the way, the case sensitivity of usernames will be configurable in 4.01. But insensitive is always right unless they're sensitive on your system _and_ you have two names which differ only in case.) -- Stephen Turner[EMAIL PROTECTED]http://www.statslab.cam.ac.uk/~sret1/ Statistical Laboratory, 16 Mill Lane, Cambridge CB2 1SB, England "As always, it's considered good practice to temporarily disable any virus detection software prior to installing new software." (Netscape) This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe analog-help" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
[analog-help] User Report in Analog 4.0 (or Rmagic?)
hi, I just ran analog coupled with report magic to produce a sample report for a guinea pig site over here. In the user report, I've spotted a lot of differences. For example, some names are capitalised in the old version, and are not in the new, others are in different positions. Most alarmingly, the new reports shows less users than the old one. This is important for those who use analog/rmagic to keep track of the amount of logged-in users on their sites. Please mail me for more info on this. I'll be happy to put the reports where you can see them, or give config info. Thanks! Ale ps: Oh by the way, I'm really happy with the new version, especially the search engine reports! great work! -- Alejandro Fernandez, "Virtual Communities made real" Webmaster Sift Plc., The Mill House, Redcliff Backs, Bristol BS1 6LY e: [EMAIL PROTECTED] t: ++44 117 915 9600 http://www.sift.co.uk This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe analog-help" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
[analog-help] Compile problem
I have installed and compiled analog on my Unix/Apache system but can't compile the cgi program correctly. The resulting cgi script is mostly programming/binary gibberish (as opposed to ascii/cgi). Any ideas? kind regards, bill hollett This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe analog-help" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
Re: [analog-help] Compile problem
On Mon, 22 Nov 1999, bill wrote: > I have installed and compiled analog on my Unix/Apache system but can't > compile the cgi program correctly. > > The resulting cgi script is mostly programming/binary gibberish (as > opposed to ascii/cgi). > That's because it's a CGI _program_ not a CGI _script_. Anyway, in version 4.0 you get a CGI script. You don't need to compile it, and it's in ascii. You might prefer to upgrade. -- Stephen Turner[EMAIL PROTECTED]http://www.statslab.cam.ac.uk/~sret1/ Statistical Laboratory, 16 Mill Lane, Cambridge CB2 1SB, England "As always, it's considered good practice to temporarily disable any virus detection software prior to installing new software." (Netscape) This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe analog-help" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
Re: [analog-help] Huge cache files
On 22 Nov 1999, Greg Stark wrote: > > I'm experimenting with cache files and it seems like I'm getting huge cache > files. 61M in fact. That's a lot smaller than the log files, but I had been > expecting much smaller files. > They have to store every filename and every hostname that's ever visited you. But you can compress the cache files if you want. That should take it down to (say) 15 or 20M at a guess. > Are there particular parameters I should be setting in analog.cfg to limit > the amount of data the cache files need to store? > Well, you can use the LOWMEM commands to stop some types of item being recorded altogether. You can't save just the top (say) 1000 hosts, because you don't know if they'll still be the top 1000 next month. -- Stephen Turner[EMAIL PROTECTED]http://www.statslab.cam.ac.uk/~sret1/ Statistical Laboratory, 16 Mill Lane, Cambridge CB2 1SB, England "As always, it's considered good practice to temporarily disable any virus detection software prior to installing new software." (Netscape) This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe analog-help" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
Re: [analog-help] Getting information on distinct hits
On Mon, 22 Nov 1999, Dave Cundiff wrote: > Hi, > I was wondering if analog was able to show distinct hits on the > file and dir reports. Also if it could do it on the daily, monthly, > hourly and so forth reports. I looked thru the documentation but didn't > see anything that mentioned that. > What do you mean by distinct hits? Number of distinct hosts that have requested it? If so, then no, see FAQ question B14 (in version 4). -- Stephen Turner[EMAIL PROTECTED]http://www.statslab.cam.ac.uk/~sret1/ Statistical Laboratory, 16 Mill Lane, Cambridge CB2 1SB, England "As always, it's considered good practice to temporarily disable any virus detection software prior to installing new software." (Netscape) This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe analog-help" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
Re: [analog-help] documentation ambiguity
On Sun, 21 Nov 1999, Tristan Lawrence wrote: > I am used to using Joshua Cooley's excellent browsers.txt file with > Analog 3 to make the browser report easier to read. > > As I was researching an upgrade to Analog 4, I noticed that there was a > note on the third party applications page to the effect that this file > is "probably not needed" with the new beta versions. > > Since that is sort of vague, I am wondering if anyone out there can clue > me in to whether any advantage to the add-on config files remains. > Well, I can tell you what I meant by it. It was something like "I can't see that this will be needed any more, but I'll be cautious about it in case somebody else can see a reason for keeping it." But if no-one else can, I'll remove it. Anyway, try version 4 without browsers.txt and see if it works for you. -- Stephen Turner[EMAIL PROTECTED]http://www.statslab.cam.ac.uk/~sret1/ Statistical Laboratory, 16 Mill Lane, Cambridge CB2 1SB, England "As always, it's considered good practice to temporarily disable any virus detection software prior to installing new software." (Netscape) This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe analog-help" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
Re: [analog-help] LOGFORMAT help sought.
Analog doesn't analyse the error log. See the FAQ. You should be OK with the rest of the logfiles. -- Stephen Turner[EMAIL PROTECTED]http://www.statslab.cam.ac.uk/~sret1/ Statistical Laboratory, 16 Mill Lane, Cambridge CB2 1SB, England "As always, it's considered good practice to temporarily disable any virus detection software prior to installing new software." (Netscape) This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe analog-help" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
Re: [analog-help] IIS Web Proxy Server Log files
> Dennis Heltzel schrieb: > > Has anyone successfully used analog to process logs from > > IIS Web Proxy Server ? > Do you actually mean Microsoft's Proxy Server? In earlier replies to the list I posted a variety of LOGFORMATS for MS-Proxy. However, because of the size of logs that were generated, I ended up writing a UNIX shell script to pull out the fields I wanted, and ditch the other 60% of info that MS-Proxy writes into the logfile, and format it as if it was CLF (Common Log Format) with a much simpler set of LOGFORMAT commands. I'll see if I still have the otriginal LOGFORMAT commands and post them to the list later today. Wallace. -- == Wallace Nicoll [EMAIL PROTECTED] City of Edinburgh Council IT Services, Chesser House, 500 Gorgie Road,Phone : 0131 469 5343 Edinburgh, EH11 3YJ, ScotlandFax : 0131 469 5335 [From overseas [P]+441314695343 [F]+441314695335 ] == This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe analog-help" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
Re: [analog-help] Re: Installation problem, Analog 4.0
On 21 Nov 1999, Chris Halverson wrote: > Abigail Marshall <[EMAIL PROTECTED]> writes: > > > Another question: is there a way to set up analog to email a text-based > > report, rather than create an HTML file? I want to do both, actually > > Have your script call 'lynx' or 'w3m' on the report and have it email > you. A 'lynx -dump' would do it. Not quite integrated into Analog, but > other tools already exist for this job. > No, there's no need to do that. If you're happy to run analog twice, then the second time use the command OUTPUT ASCII and you will get an ascii report. It will produce much better ascii layout than running lynx on the HTML will. -- Stephen Turner[EMAIL PROTECTED]http://www.statslab.cam.ac.uk/~sret1/ Statistical Laboratory, 16 Mill Lane, Cambridge CB2 1SB, England "As always, it's considered good practice to temporarily disable any virus detection software prior to installing new software." (Netscape) This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe analog-help" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
