Re: [analog-help] Re: Analog Not Processing All Sites
Since I first posted my question, I have found that the first site that is not being run is in IIS but is not actually hosted on that server yet. Would the DNS pointing to another server stop analog in it's tracks with no errors??? - Original Message - From: "Jeremy Wadsack" <[EMAIL PROTECTED]> To: <[EMAIL PROTECTED]> Sent: Monday, March 15, 2004 11:19 AM Subject: Re: [analog-help] Re: Analog Not Processing All Sites > > > You can use the ERRFILE command in your Analog config file to have > Analog write any errors or warning messages to a file that you can > look at later. This can be very helpful in determining what is > happening when each report is being created. See > http://www.analog.cx/docs/errors.html for details on the command and > error and warning messages. > > -- > > Jeremy Wadsack > Wadsack-Allen Digital Group > > > Chris Murphy <[EMAIL PROTECTED]> (Saturday, March 13, 2004 8:35 PM): > > > I should probably clairify on a the multiple sites issue. > > > We are running a W2K web server. In IIS we have about 150 different > > websites running. Of those 150, only about 60 - 70 of them are getting > > statistics ran. There is one site that the stats stop at every day, but I > > have found no reason that it stops on that particular site, or the one next > > in line. > > > All help is appreciated, > > -Murphy > > > "Chris Murphy" <[EMAIL PROTECTED]> wrote > > in message news:[EMAIL PROTECTED] > >> I'm new to Analog and the last person who worked with it at our campany is > > now > >> gone. > >> > >> I've got Analog 5.32 running on a Windows 2000 Server platform that is > > supposed > >> to be running stats on all of our websites that we host. It runs stats on > > most > >> of the sites, but not all. > >> > >> If anyone has any suggestions, please let me know. > >> > >> Thanks, > >> Chris Murphy > >> > >> + > >> | TO UNSUBSCRIBE from this list: > >> |http://lists.isite.net/listgate/analog-help/unsubscribe.html > >> | > >> | Digest version: http://lists.isite.net/listgate/analog-help-digest/ > >> | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general > >> | List archives: http://www.analog.cx/docs/mailing.html#listarchives > >> + > > + > | TO UNSUBSCRIBE from this list: > |http://lists.isite.net/listgate/analog-help/unsubscribe.html > | > | Digest version: http://lists.isite.net/listgate/analog-help-digest/ > | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general > | List archives: http://www.analog.cx/docs/mailing.html#listarchives > + > > + | TO UNSUBSCRIBE from this list: |http://lists.isite.net/listgate/analog-help/unsubscribe.html | | Digest version: http://lists.isite.net/listgate/analog-help-digest/ | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general | List archives: http://www.analog.cx/docs/mailing.html#listarchives +
Re: [analog-help] .asp and "include" files
Aengus <[EMAIL PROTECTED]> (Tuesday, March 23, 2004 11:29 AM): > Silva, Ro <[EMAIL PROTECTED]> wrote: >> Please excuse me if someone has asked this before. We recently >> changed the pages on our Web site such that the number of hits to the >> following (as an example) does not show up in our analog report: >> http://www.revenue.state.co.us/TPS_Dir/wrap.asp?incl=forms_download >> >> The file would be receiving many hits this time of year. It's our >> Colorado income tax forms page. >> >> The file is actually named forms_download.htm but it does not show up >> in our monthly report. >> >> How can we get counts of these individual htm files? Analog appears >> to be counting only total hits to anything that's in the "wrapper," >> which is listed in the Analog report as /tps_dir/wrap.asp >> >> Our older files that have a .html extension DO show up in the report, >> but these are now redirect pages. Should we go back to naming >> everything .html so the counts will show up again? > First of all, Analog will report on what's in your log files - it > doesn't know anything about how your server is set up. If you have a > look at a section of your log file. It will help you to understand what > Analog is reporting, and why. > You web server should be configured to log arguemnts that are passed to > a script that way. See the Analog documentation for more detail: > http://www.analog.cx/docs/args.html > If you are logging the arguments that you are passing to your wrapper > script, then you can get a quick look at what pages are being called by > using the Search Query report by specifying > INTSEARCHENGINE /TPS_Dir/wrap.asp incl > But if you are also using the Search Engine report to report on external > search engines then you will need to use an alias to get the arguments > into the request report. I'm going to leave it to someone else to post > an example, because the only think I know about regular expressions is > that I always get them wrong! If you just want to see these entries in your Request Report, use the ARGSINCLUDE command like this: ARGSINCLUDE /TPS_Dir/wrap.asp See http://analog.cx/docs/args.html#ARGSINCLUDE for details. IIRC, there are separate Internal Search Query and Search Query reports so if you are tracking search engine results, the INTSEARCHENGINE command above should not interfere with those. -- Jeremy Wadsack Wadsack-Allen Digital Group + | TO UNSUBSCRIBE from this list: |http://lists.isite.net/listgate/analog-help/unsubscribe.html | | Digest version: http://lists.isite.net/listgate/analog-help-digest/ | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general | List archives: http://www.analog.cx/docs/mailing.html#listarchives +
Re: [analog-help] Referer not showing up in report.html
Do you have any EXCLUDE commands that might be removing all entries
with referrers in them?
--
Jeremy Wadsack
Wadsack-Allen Digital Group
Pelle Andersson <[EMAIL PROTECTED]> (Wednesday, March 24, 2004 5:23 AM):
> Hi Analog List!
> I cant see any of the refering sites in my report.html from latest Analog.
> This is my Apache2 conf for logging:
>
> LogFormat "%h %l %u %t \"%r\" %>s %b \"%{Referer}i\" \"%{User-Agent}i\""
> combined
> LogFormat "%h %l %u %t \"%r\" %>s %b" common
> LogFormat "%{Referer}i -> %U" referer
> LogFormat "%{User-agent}i" agent
>
> This is found in Apache logfile:
>
> 192.168.135.205 - - [24/Mar/2004:13:03:14 +0100] "GET / HTTP/1.1" 200 32979
> "http://a-refering-site.xyz/a-pointing_doc.html"; "Mozilla/4.0 (compatible;
> MSIE 6.0; Windows NT 5.1; .NET CLR 1.1.4322)"
>
> My Analog conf:
>
> LOGFORMAT COMBINED
> LOGFILE /var/log/httpd-access.log
> LOGFILE /var/log/httpd-access.log.*.gz
>
> Thanks in advance for any input to a solution.
> Best regards
+
| TO UNSUBSCRIBE from this list:
|http://lists.isite.net/listgate/analog-help/unsubscribe.html
|
| Digest version: http://lists.isite.net/listgate/analog-help-digest/
| Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
| List archives: http://www.analog.cx/docs/mailing.html#listarchives
+
Re: [analog-help] performance problem with RHES 3
You did recompile Analog on the new RHES system, right? Have you tried performance testing the gzip on both systems, in case that is where the bottle neck is? -- Jeremy Wadsack Wadsack-Allen Digital Group Yavor Trapkov <[EMAIL PROTECTED]> (Wednesday, March 24, 2004 5:15 AM): > Hello, I just moved our web server from RH7.3 to RHES 3.1 and I experience a > performance problem with analog, the two servers are the same (2x1.4P3 1.2GB RAM). > We have let say big log files ~30 > milion lines, and I process them compressed > UNCOMPTESS *.gz "gzip -cd" > I tried to use the LOWMEM options and with $LANG=C, but apparently no difference. > Does anyone experienced a similar problem? > Here is PROGRESSFREQ I get from the two servers: > > RH7.3 > /usr/bin/analog: [11:33:03] 50 lines read > /usr/bin/analog: [11:33:08] 100 lines read > /usr/bin/analog: [11:33:13] 150 lines read > /usr/bin/analog: [11:33:17] 200 lines read > /usr/bin/analog: [11:33:22] 250 lines read > /usr/bin/analog: [11:33:27] 300 lines read > /usr/bin/analog: [11:33:32] 350 lines read > /usr/bin/analog: [11:33:37] 400 lines read > /usr/bin/analog: [11:33:42] 450 lines read > /usr/bin/analog: [11:33:47] 500 lines read > /usr/bin/analog: [11:33:52] 550 lines read > /usr/bin/analog: [11:33:57] 600 lines read > /usr/bin/analog: [11:34:02] 650 lines read > /usr/bin/analog: [11:34:07] 700 lines read > /usr/bin/analog: [11:34:12] 750 lines read > /usr/bin/analog: [11:34:17] 800 lines read > /usr/bin/analog: [11:34:22] 850 lines read > /usr/bin/analog: [11:34:27] 900 lines read > /usr/bin/analog: [11:34:32] 950 lines read > /usr/bin/analog: [11:34:37] 1000 lines read > /usr/bin/analog: [11:34:42] 1050 lines read > /usr/bin/analog: [11:34:47] 1100 lines read > /usr/bin/analog: [11:34:52] 1150 lines read > /usr/bin/analog: [11:34:57] 1200 lines read > /usr/bin/analog: [11:35:02] 1250 lines read > /usr/bin/analog: [11:35:07] 1300 lines read > /usr/bin/analog: [11:35:12] 1350 lines read > /usr/bin/analog: [11:35:18] 1400 lines read > /usr/bin/analog: [11:35:23] 1450 lines read > /usr/bin/analog: [11:35:29] 1500 lines read > /usr/bin/analog: [11:35:34] 1550 lines read > /usr/bin/analog: [11:35:39] 1600 lines read > /usr/bin/analog: [11:35:46] 1650 lines read > /usr/bin/analog: [11:35:53] 1700 lines read > /usr/bin/analog: [11:35:59] 1750 lines read > /usr/bin/analog: [11:36:06] 1800 lines read > /usr/bin/analog: [11:36:13] 1850 lines read > /usr/bin/analog: [11:36:20] 1900 lines read > /usr/bin/analog: [11:36:27] 1950 lines read > /usr/bin/analog: [11:36:35] 2000 lines read > /usr/bin/analog: [11:36:43] 2050 lines read > /usr/bin/analog: [11:36:52] 2100 lines read > /usr/bin/analog: [11:37:01] 2150 lines read > /usr/bin/analog: [11:37:12] 2200 lines read > /usr/bin/analog: [11:37:22] 2250 lines read > /usr/bin/analog: [11:37:32] 2300 lines read > /usr/bin/analog: [11:37:43] 2350 lines read > /usr/bin/analog: [11:37:52] 2400 lines read > /usr/bin/analog: [11:38:03] 2450 lines read > /usr/bin/analog: [11:38:19] 2500 lines read > /usr/bin/analog: [11:38:35] 2550 lines read > /usr/bin/analog: [11:38:56] 2600 lines read > real10m10.556s > user5m9.620s > sys 0m48.690s > - > RHES3.1 > /usr/bin/analog: [13:53:02] 50 lines read > /usr/bin/analog: [13:53:07] 100 lines read > /usr/bin/analog: [13:53:12] 150 lines read > /usr/bin/analog: [13:53:16] 200 lines read > /usr/bin/analog: [13:53:22] 250 lines read > /usr/bin/analog: [13:53:29] 300 lines read > /usr/bin/analog: [13:53:46] 350 lines read > /usr/bin/analog: [13:53:58] 400 lines read > /usr/bin/analog: [13:54:08] 450 lines read > /usr/bin/analog: [13:54:28] 500 lines read > /usr/bin/analog: [13:54:45] 550 lines read > /usr/bin/analog: [13:54:55] 600 lines read > /usr/bin/analog: [13:55:09] 650 lines read > /usr/bin/analog: [13:55:52] 700 lines read > /usr/bin/analog: [14:00:27] 750 lines read > /usr/bin/analog: [14:20:35] 800 lines read > Received interrupt signal: exiting > __ > Introducing the New Netscape Internet Service. > Only $9.95 a month -- Sign up today at http://isp.netscape.com/register > Netscape. Just the Net You Need. > New! Netscape Toolbar for Internet Explorer > Search from anywhere on the Web and block those annoying pop-ups. > Download now at http://channels.netscape.com/ns/search/install.jsp > + > | TO UNSUBSCRIBE from this list: > |http://lists.isite.net/listgate/analog-help/unsubscribe.html > | > | Digest version: http://lists.isite.net/listgate/analog-help-digest/ > | Usenet version: news://new
Re: [analog-help] analog --> maillog2commonlog + postfix
Raúl Pintor <[EMAIL PROTECTED]> (Tuesday, March 23, 2004 4:49 AM): > I have tried to get stats from postfix logs using maillog2commonlog, but > it seems to return nothing. > I do: > bash$ ./maillog2commonlog postfix < posfix_log_archive > and after a time processing the log, I get the prompt again and nothing in > the stdout. I tried catch the output too, and I get nothing. I have probed > that it works in my Debian Woody, with sendmail logs, and works very > well!, but with postfix it seems to I'm doing something wrong, can > somebody help me? Likely the postfix logs are in a slightly different format than the sendmail logs and the maillog2commonlog script is dropping unrecognized lines. You might be able to modify the source to work with your postfix logs. -- Jeremy Wadsack Wadsack-Allen Digital Group + | TO UNSUBSCRIBE from this list: |http://lists.isite.net/listgate/analog-help/unsubscribe.html | | Digest version: http://lists.isite.net/listgate/analog-help-digest/ | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general | List archives: http://www.analog.cx/docs/mailing.html#listarchives +
Re: [analog-help] corrupt logfile lines....
Savin, Jill <[EMAIL PROTECTED]> wrote: > I've just downloaded and configued and tried out analog, and I get > this error message in report.html While it's creating report.html, Analog will display warnings and errors that will alert you to potential problems. If you aren't seeing them on the screen, then add the ERRFILE directive to your analog.cfg file, so that they will be captured to a file. > Successful requests: 0 > Corrupt logfile lines: 35,129 If they're all corrupt, then your Analog isn't recognizing the format of your logfile. You often don't need to specify a LOGFORMAT, but if Analog can't recognize the log files without one, then you'll have to specify a LOGFORMAT. If you have specified a LOGFORMAT, then it's not right. http://www.analog.cx/docs/logfmt.html > any idea where to start troubleshooting? http://www.analog.cx/docs/debug.html Aengus + | TO UNSUBSCRIBE from this list: |http://lists.isite.net/listgate/analog-help/unsubscribe.html | | Digest version: http://lists.isite.net/listgate/analog-help-digest/ | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general | List archives: http://www.analog.cx/docs/mailing.html#listarchives +
[analog-help] corrupt logfile lines....
I've just downloaded and configued and tried out analog, and I get this error message in report.html Successful requests: 0 Corrupt logfile lines: 35,129 any idea where to start troubleshooting? + | TO UNSUBSCRIBE from this list: |http://lists.isite.net/listgate/analog-help/unsubscribe.html | | Digest version: http://lists.isite.net/listgate/analog-help-digest/ | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general | List archives: http://www.analog.cx/docs/mailing.html#listarchives +
[analog-help] Referer not showing up in report.html
Hi Analog List!
I cant see any of the refering sites in my report.html from latest Analog.
This is my Apache2 conf for logging:
LogFormat "%h %l %u %t \"%r\" %>s %b \"%{Referer}i\" \"%{User-Agent}i\""
combined
LogFormat "%h %l %u %t \"%r\" %>s %b" common
LogFormat "%{Referer}i -> %U" referer
LogFormat "%{User-agent}i" agent
This is found in Apache logfile:
192.168.135.205 - - [24/Mar/2004:13:03:14 +0100] "GET / HTTP/1.1" 200 32979
"http://a-refering-site.xyz/a-pointing_doc.html"; "Mozilla/4.0 (compatible;
MSIE 6.0; Windows NT 5.1; .NET CLR 1.1.4322)"
My Analog conf:
LOGFORMAT COMBINED
LOGFILE /var/log/httpd-access.log
LOGFILE /var/log/httpd-access.log.*.gz
Thanks in advance for any input to a solution.
Best regards
+
| TO UNSUBSCRIBE from this list:
|http://lists.isite.net/listgate/analog-help/unsubscribe.html
|
| Digest version: http://lists.isite.net/listgate/analog-help-digest/
| Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
| List archives: http://www.analog.cx/docs/mailing.html#listarchives
+
[analog-help] performance problem with RHES 3
Hello, I just moved our web server from RH7.3 to RHES 3.1 and I experience a performance problem with analog, the two servers are the same (2x1.4P3 1.2GB RAM). We have let say big log files ~30 milion lines, and I process them compressed UNCOMPTESS *.gz "gzip -cd" I tried to use the LOWMEM options and with $LANG=C, but apparently no difference. Does anyone experienced a similar problem? Here is PROGRESSFREQ I get from the two servers: RH7.3 /usr/bin/analog: [11:33:03] 50 lines read /usr/bin/analog: [11:33:08] 100 lines read /usr/bin/analog: [11:33:13] 150 lines read /usr/bin/analog: [11:33:17] 200 lines read /usr/bin/analog: [11:33:22] 250 lines read /usr/bin/analog: [11:33:27] 300 lines read /usr/bin/analog: [11:33:32] 350 lines read /usr/bin/analog: [11:33:37] 400 lines read /usr/bin/analog: [11:33:42] 450 lines read /usr/bin/analog: [11:33:47] 500 lines read /usr/bin/analog: [11:33:52] 550 lines read /usr/bin/analog: [11:33:57] 600 lines read /usr/bin/analog: [11:34:02] 650 lines read /usr/bin/analog: [11:34:07] 700 lines read /usr/bin/analog: [11:34:12] 750 lines read /usr/bin/analog: [11:34:17] 800 lines read /usr/bin/analog: [11:34:22] 850 lines read /usr/bin/analog: [11:34:27] 900 lines read /usr/bin/analog: [11:34:32] 950 lines read /usr/bin/analog: [11:34:37] 1000 lines read /usr/bin/analog: [11:34:42] 1050 lines read /usr/bin/analog: [11:34:47] 1100 lines read /usr/bin/analog: [11:34:52] 1150 lines read /usr/bin/analog: [11:34:57] 1200 lines read /usr/bin/analog: [11:35:02] 1250 lines read /usr/bin/analog: [11:35:07] 1300 lines read /usr/bin/analog: [11:35:12] 1350 lines read /usr/bin/analog: [11:35:18] 1400 lines read /usr/bin/analog: [11:35:23] 1450 lines read /usr/bin/analog: [11:35:29] 1500 lines read /usr/bin/analog: [11:35:34] 1550 lines read /usr/bin/analog: [11:35:39] 1600 lines read /usr/bin/analog: [11:35:46] 1650 lines read /usr/bin/analog: [11:35:53] 1700 lines read /usr/bin/analog: [11:35:59] 1750 lines read /usr/bin/analog: [11:36:06] 1800 lines read /usr/bin/analog: [11:36:13] 1850 lines read /usr/bin/analog: [11:36:20] 1900 lines read /usr/bin/analog: [11:36:27] 1950 lines read /usr/bin/analog: [11:36:35] 2000 lines read /usr/bin/analog: [11:36:43] 2050 lines read /usr/bin/analog: [11:36:52] 2100 lines read /usr/bin/analog: [11:37:01] 2150 lines read /usr/bin/analog: [11:37:12] 2200 lines read /usr/bin/analog: [11:37:22] 2250 lines read /usr/bin/analog: [11:37:32] 2300 lines read /usr/bin/analog: [11:37:43] 2350 lines read /usr/bin/analog: [11:37:52] 2400 lines read /usr/bin/analog: [11:38:03] 2450 lines read /usr/bin/analog: [11:38:19] 2500 lines read /usr/bin/analog: [11:38:35] 2550 lines read /usr/bin/analog: [11:38:56] 2600 lines read real10m10.556s user5m9.620s sys 0m48.690s - RHES3.1 /usr/bin/analog: [13:53:02] 50 lines read /usr/bin/analog: [13:53:07] 100 lines read /usr/bin/analog: [13:53:12] 150 lines read /usr/bin/analog: [13:53:16] 200 lines read /usr/bin/analog: [13:53:22] 250 lines read /usr/bin/analog: [13:53:29] 300 lines read /usr/bin/analog: [13:53:46] 350 lines read /usr/bin/analog: [13:53:58] 400 lines read /usr/bin/analog: [13:54:08] 450 lines read /usr/bin/analog: [13:54:28] 500 lines read /usr/bin/analog: [13:54:45] 550 lines read /usr/bin/analog: [13:54:55] 600 lines read /usr/bin/analog: [13:55:09] 650 lines read /usr/bin/analog: [13:55:52] 700 lines read /usr/bin/analog: [14:00:27] 750 lines read /usr/bin/analog: [14:20:35] 800 lines read Received interrupt signal: exiting __ Introducing the New Netscape Internet Service. Only $9.95 a month -- Sign up today at http://isp.netscape.com/register Netscape. Just the Net You Need. New! Netscape Toolbar for Internet Explorer Search from anywhere on the Web and block those annoying pop-ups. Download now at http://channels.netscape.com/ns/search/install.jsp + | TO UNSUBSCRIBE from this list: |http://lists.isite.net/listgate/analog-help/unsubscribe.html | | Digest version: http://lists.isite.net/listgate/analog-help-digest/ | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general | List archives: http://www.analog.cx/docs/mailing.html#listarchives +
