[analog-help] Q: Produce stats by running analog every hour?
Dear analog users, Some week ago I posted a question regarding problems producing correct webstats due to the fact that I rotate my access_log once every week. This made me loose statistic history for my site. Even though I got kind responce upon my query, I still haven't manage to solve the problem the way I wanted. Now, I came up with an idea for a possible solution, but since I'm a rookie on analog, I would like to listen to what experienced users have to say before I start to hack around. Here goes: I thought I'd skip using the anlgform.html nor anlgform.pl for producing a report. analog.cfg is configured with the commands I need for my stats. Instead I write a tiny script which executes analog once every hour. Since every execution of analog updates my OUTFILE, all I have to do is to make a link to the outfile.html document. The OUTFILE then supports me with a statistics page which, in it's worst case, is 59 minutes old, or less. Does this sounds like OK? T.I.A /Kjell Siimon /Gothenburg - Sweden This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
[analog-help] Re: Q: Produce stats by running analog every hour?
Kjell Siimon <[EMAIL PROTECTED]> writes: > Some week ago I posted a question regarding problems producing correct > webstats due to the fact that I rotate my access_log once every > week. This made me loose statistic history for my site. Why not have analog analyze the old (rotated) logs too? For the ISP that I run, I rotate the logs for all our virtual hosts nightly and have analog run over all the old ones everynight. Works fine for me. cdh -- Chris D. Halverson Complete Internet Solutions PGP mail accepted, finger for public key http://www.CompleteIS.com/~cdh/ This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
[analog-help] Setting up form Interface Part II
Jeremy: Thanks for your response. Just to be sure that I understand - this is the way I have revised my setup based upon your comments: (Note: This will be tested before it is implemented.) 1) Set up the executables: C:\inetpub\anlgform.exe C:\inetpub\anlgform.cfg C:\secure\analog.exe The anlgform.exe is setup as executable by ISUR_WWW 2) Set up the log files C:\IIS_Logs\websiteA.log C:\IIS_Logs\websiteB.log 3) Set up sites for the form interface. C:\inetpub\websiteA\stats\anlgform.html C:\inetpub\websiteA\stats\analog.cfg C:\inetpub\websiteB\stats\anlgform.html C:\inetpub\websiteB\stats\analog.cfg Where the cfg files would be tailored for the associated web site. The stats directory would be password protected to deter unwanted access. 4) Set up the DNSfile C:\DNSstats\DNSFILE.txt All the websites would use the same dns. Is this more of what your are pointing to? This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
Re: [analog-help] Q: Produce stats by running analog every hour?
Kjell Siimon wrote: > ... problems producing > correct webstats due to the fact that I rotate my access_log once > every week > ... > script which executes analog once every hour. > Since every execution of analog updates my OUTFILE, all I have to do > is to make a link to the outfile.html document. I fail to see how this is going to recover statistical data from your rotated logfiles. Whether you run Analog once a week or once an hour, the report will only contain the data in the logs that it analysed. As Chris said, the easiest solution is to analyse the rotated logs as well (with an additional LOGFORMAT command). If this is not possible, (for space or other reasons), then you should look into cache files. See docs/cache.html for details. HTH, Jeremy Wadsack Wadsack-Allen Digital Group This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
Re: [analog-help] Setting up form Interface Part II
Chuck Schick wrote: > 1) Set up the executables: > > C:\inetpub\anlgform.exe > C:\inetpub\anlgform.cfg > C:\secure\analog.exe > > The anlgform.exe is setup as executable by ISUR_WWW C:\secure\analog.exe will also need to be executable by IUSR_WWW, but because it is (presumably) outside your webspace, no IUSR can access it except through a script of cgi program like anlgform.exe. > Is this more of what your are pointing to? Otherwise everything else looks good. Jeremy Wadsack Wadsack-Allen Digital Group This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
No Subject
Is there a way to force analog to count blank referrers in the referrer report? I've tried to manipulate the results by using REFALIAS (i.e. using reg. expr. change "-" referrer to "http://bookmarks") but can't! It's as if analog ignores the "-" (or "[unknown]") referrer prior to REFALIAS processing. Any help greatly appreciated, = Shahid Get Your Private, Free E-mail from MSN Hotmail at http://www.hotmail.com This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
[analog-help] Blank Referrers
Is there a way to force analog to count blank referrers in the referrer report? I've tried to manipulate the results by using REFALIAS (i.e. using reg. expr. change "-" referrer to "http://bookmarks") but can't! It's as if analog ignores the "-" (or "[unknown]") referrer prior to REFALIAS is processed. Any help greatly appreciated, = Shahid Get Your Private, Free E-mail from MSN Hotmail at http://www.hotmail.com This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
[analog-help] Request Report Question
I am using analog to analyze EZproxy log files. What do I need to do to get a more readable output for long names in the file column like: http://www.morrisville.edu:2048/login?url=http://infotrac.galegroup.com/itwe b/morrisville I would prefer something like EZproxy/infotrac.galegroup.com/itweb/morrisville or EZproxy/ITWEB Any way to do this? ___ Wilfred (Bill) Drew Associate Librarian, Systems and Reference SUNY Morrisville College Library [EMAIL PROTECTED] Home: http://www.morrisville.edu/~drewwe/ Not Just Cows: http://www.morrisville.edu/~drewwe/njc/ Library: http://www.morrisville.edu/library/ Have Laptop -- Will Travel. "We cannot have good libraries until we first have good librarians -- properly educated, professionally recognized, and fairly rewarded." Herbert S. White (Library Journal column, 15 November 1999, pp. 44-45) This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
[analog-help] Using jsp to create the web interface of analog.
Hi, I am trying to create a jsp page as the front end of the analog. This page will use java bean class to execute the analog command. At first I use a main function called my code which will exec analog to do a test. It worked fine. But when I used jsp page to call this bean class, it seems that the process created by runtime.exec(cmd) has been blocked somehow. I don't know why. The code is exactly the same, but why it was blocked when I called it in a jsp page while it is ok if called by my dummy main function. Your help will be highly appreciated. My email address is: [EMAIL PROTECTED] Tiana This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
Re: [analog-help] Request Report Question
"Drew, Bill" wrote: > I am using analog to analyze EZproxy log files. What do I need to do to get > a more readable output for long names in the file column like: > > http://www.morrisville.edu:2048/login?url=http://infotrac.galegroup.com/itwe > b/morrisville > > I would prefer something like > EZproxy/infotrac.galegroup.com/itweb/morrisville > > or EZproxy/ITWEB > > Any way to do this? Use REQOUTPUTALIAS, as described in docs/alias.html. You probably want to use a Regular Expression, like REQOUTPUTALIAS REGEXP:^.*:2048/login[^/]+//(.+)$ "EZproxy/$1" for the former, or for the latter (without the case change), REQOUTPUTALIAS REGEXP:^.*:2048/login[^/]+//[^/]+/([^/]+) "EZproxy/$1" (Of course these both make some assumptions about the kind of data your have in your logs and you may need to modify them a bit.) HTH, Jeremy Wadsack Wadsack-Allen Digital Group This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
Re: [analog-help] Using jsp to create the web interface of analog.
[EMAIL PROTECTED] wrote: > I am trying to create a jsp page as the front end of the analog. This page will > use java bean class to execute the analog command. At first I use a main > function called my code which will exec analog to do a test. It worked fine. But > when I used jsp page to call this bean class, it seems that the process created > by runtime.exec(cmd) has been blocked somehow. I don't know why. The code is > exactly the same, but why it was blocked when I called it in a jsp page while it > is ok if called by my dummy main function. My guess is this is probably a securty feature in JSP to keep you from blithley running local executable content from a web interface where you may be producing security holes. You should look at the form interface to Analog (which works on any platform the JSP page would) and consider incorporating the JSP into anlgform.html, rather than replacing the anlgform.pl with a JSP page. If this doesn't meet your needs there are probably some JSP support forums out there with people highly knowledgable in JSP and bean integration. HTH, Jeremy Wadsack Wadsack-Allen Digital Group This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
Re[2]: [analog-help] Using jsp to create the web interface o
Hello, Jeremy, Thanks a lot. Actually I did send the msg to the jsp-related newsgroup, I haven't receive any response yet. The reason I want to use jsp instead of anlgform.pl is because I don't know how to do perl programming. It might because of the security issue. But it worked fine on other command instead of analog. Anyhow, thanks for your help again. Tiana This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
Re: [analog-help] perennial update of dnscache
On 4/26/00 3:01 AM, Jason Linhart wrote: >On 4/25/00 5:49 PM camccli ([EMAIL PROTECTED]) wrote: > >>I hand edited dnscache to remove all the entries with a negative prefix, >>then ran it against a fresh log. it still runs against everything, and >>the bottom of the file now looks like this: >> >>647325600 63.25.70.187 1cust187.tnt2.columbia.mo.da.uu.net >>537649440 205.188.209.44 cache-dl08.proxy.aol.com >> >>but why is the second set of numbers less than the first??? > >What version of Analog are you running and on what model Macintosh? Very >old versions of Analog used a different format for the dates in the DNS >cache file and might in theory be having a Y2K problem, although we were >already aware of the issues back then and there aren't any known problems >before 2038. The current versions (4.0, 4.1) have been checked more >carefully and are known to be fine for far longer than that. If you are >running Analog 4.x, a date of 647325600 in the DNS cache file means >something around the year 3201. > >It does sound like a hardware problem. >Jason I was running 4.0.3 before I re-downloaded Analog a couple of days ago - then realized what I'd downloaded was 4.1. Ran into the same problem with both. PowerMac 7300, System 8.1. I think it was just a (nasty) coincidence that I pulled my battery right around the one-month DNSGOODHOURS mark... Now I gotta find out how to fix things...! :o Thanks. Cathleen This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
Re: [analog-help] perennial update of dnscache
another question: when the entries in dnscache get the timestamp, on what is that based? on the clock on my computer (where I'm running the program), or on the clock on the server (where it's doing the nslookup)? (but the oddity is that both times are correct, as far as I can determine... and resetting my clock here should have taken care of any time problem here, after I pulled the battery...) because of the security stuff, I haven't run analog on the server to see if everything's ok there. that'll be the next thing I try, when I get the time to ftp the files over there and wait for it to run the lookups. oooh... floating point unit?? (doesn't that do math stuff? or something? grasping at straws here... frankly, I can't remember if this has one!) if this ever gets straightened out, between here and the mac ng I just posted to today, I'll let you all know what it was, and try not to bother too much in the meantime. thanks. This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
Re: [analog-help] perennial update of dnscache
s >when the entries in dnscache get the timestamp, on what is that based? on >the clock on my computer (where I'm running the program), or on the clock >on the server (where it's doing the nslookup)? also, where is the calculation done? does it call the nearest calculator to where it's running (i.e. the one on my machine), or will it call one from the server (whether it's running on the server or not), since it has to get the info from there anyway? thanks, sorry if I'm becoming confused/ing. Cathleen This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
[analog-help] logfile parser for fixed formats
hello analog people, I wrote a couple weeks or so ago asking about how I could parse various logfile formats, to load into a data warehouse. I wasn't a very good C programmer so I picked up Perl to do this, and that helped me understand the C expression matching logic actually. My perl script matches on all the fixed log formats that Stephen matches on, and then writes the following to a new file : 1. a header column : for example: Host Ident Authuser TimeDate Protocol RequestedFile HTTP Code Bytes ReferrerSite Browser 2. each line of the logfile parsed according the the example fields above * the script does not match netscape, webstar, or eclf formats So, like I said I'm not sure how useful other would find this (some might say its pretty simple). I was using it as the prelude to loading each field of data in a logfile, into tables within a data warehouse for historical storage and clickstream analysis. Analog is great, but I wanted to keep the level of data as low as possible, no sums or aggregations needed. I got sidetracked and stopped working on it the other day and so don't have any functionality in this program for parsing out SessionIDs from a URL header (which would be cool) etc. Email if you would like me to send you a copy. Nate [EMAIL PROTECTED] This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
Re: [analog-help] perennial update of dnscache
At 20.32 23/04/2000 -, Cathleen wrote: >I'm running Analog 4.1 on a PowerMac 7300, System 8.1. If my memory is still good, the Mac can synchronize its clock with some time servers on the Net: look into the Control Panel for this option. Bye Marco Bernardini This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
Re: [analog-help] perennial update of dnscache
On 4/26/00 6:24 PM camccli ([EMAIL PROTECTED]) wrote: >>when the entries in dnscache get the timestamp, on what is that based? on >>the clock on my computer (where I'm running the program), or on the clock >>on the server (where it's doing the nslookup)? > >also, where is the calculation done? does it call the nearest calculator >to where it's running (i.e. the one on my machine), or will it call one >from the server (whether it's running on the server or not), since it has >to get the info from there anyway? It all happens on your computer. Analog calls the operating system time routine on your computer to get the time and does some fairly simple math on it before using it to write the DNS cache entries. Your interaction with the server stops the moment the log file is on your local machine. I wonder if your hardware clock is reading back a different random time each time it is read. That would account for things perfectly. Jason - [EMAIL PROTECTED] - Dr. Seuss books . . . can be read and enjoyed on several levels. For example, 'One Fish Two Fish, Red Fish Blue Fish' can be deconstructed as a searing indictment of the narrow-minded binary counting system. -- Peter van der Linden, Expert C Programming, Deep C Secrets This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
Re: [analog-help] perennial update of dnscache ... mac time
marco ... this is very correct and needed if a mac runs as any type of server, in my option. a mac can run a very good server, however, on a mac time has a low pririty. I know this from running a freenix system on a mac. there are a few mac time clients (which come even without nag- or crippleware) which would be a good idea for the mac. and then use the timeserver closest to you. cheers, t. On Thu, Apr 27, 2000 at 05:59:25AM +0200, Marco Bernardini wrote: > At 20.32 23/04/2000 -, Cathleen wrote: > > >I'm running Analog 4.1 on a PowerMac 7300, System 8.1. > > If my memory is still good, the Mac can synchronize its clock with some > time servers on the Net: look into the Control Panel for this option. > > Bye > > Marco Bernardini > -- Buy yourself a computer ... buy yourself frustration This is the analog-help mailing list. To unsubscribe from this mailing list, send mail to [EMAIL PROTECTED] with "unsubscribe" in the main BODY OF THE MESSAGE. List archived at http://www.mail-archive.com/analog-help@lists.isite.net/
