Re: [analog-help] Referer not showing up in report.html
I have 3 thoughts.
1. In Apache's httpd.conf , the LogFormat specifies
one or more formats with a nickname for each (a).
The LogFormat doesn't create a log file; CustomLog
creates a log file by using a format nickname specified
in a LogFormat command (b). Or, CustomLog can
specify an explicit format string without a nickname (c).
Does your CustomLog command use a nickname from
the list of LogFormats that you mentioned? If yes, that's
good. If not, what does your CustomLog command specify?
(a) LogFormat "%h %l %u %t \"%r\" %>s %b" common
(b) CustomLog logs/access_log common
(c) CustomLog logs/access_log "%h %l %u %t \"%r\" %>s %b"
2. Analog's documentation reveals that most people
don't need to specify a log format because Analog
can detect the format automatically. Have you tried
running Analog without specifying a format?
(http://www.analog.cx/docs/logfmt.html)
3. Analog's documentation mentions a command that
is specifically for Apache (APACHELOGFORMAT).
Have you tried it? Maybe like this? (Assumes that your
Apache CustomLog command uses "combined" nickname.)
APACHELOGFORMAT ("%h %l %u %t \"%r\" %>s %b \"%{Referer}i\"
\"%{User-Agent}i\"")
or
APACHELOGFORMAT (%h %l %u %t \"%r\" %>s %b \"%{Referer}i\"
\"%{User-Agent}i\")
or
APACHELOGFORMAT (%h %l %u %t \"%r\" %s %b \"%{Referer}i\"
\"%{User-Agent}i\")
(http://www.analog.cx/docs/logfmt.html)
HTH,
-- Duke
Pelle Andersson wrote:
Hi Analog List!
I cant see any of the refering sites in my report.html from latest Analog.
This is my Apache2 conf for logging:
LogFormat "%h %l %u %t \"%r\" %>s %b \"%{Referer}i\" \"%{User-Agent}i\""
combined
LogFormat "%h %l %u %t \"%r\" %>s %b" common
LogFormat "%{Referer}i -> %U" referer
LogFormat "%{User-agent}i" agent
This is found in Apache logfile:
192.168.135.205 - - [24/Mar/2004:13:03:14 +0100] "GET / HTTP/1.1" 200 32979
"http://a-refering-site.xyz/a-pointing_doc.html"; "Mozilla/4.0 (compatible;
MSIE 6.0; Windows NT 5.1; .NET CLR 1.1.4322)"
My Analog conf:
LOGFORMAT COMBINED
LOGFILE /var/log/httpd-access.log
LOGFILE /var/log/httpd-access.log.*.gz
Thanks in advance for any input to a solution.
Best regards
+
| TO UNSUBSCRIBE from this list:
|http://lists.isite.net/listgate/analog-help/unsubscribe.html
|
| Digest version: http://lists.isite.net/listgate/analog-help-digest/
| Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
| List archives: http://www.analog.cx/docs/mailing.html#listarchives
+
Re: [analog-help] Re: Re: Analog Not Processing All Sites
On Thu, 25 Mar 2004, Chris Murphy wrote: > > Thanks for all the help. I've used what you guys have suggested to > troubleshoot some more. > > Now it seems that the problem is involving the amount of time that it takes > for Analog to process each set of log files. The amount of log files that I > have is huge (about 180 MB and smaller) and it can take analog up to 12 > hours to process the largest site. > > So...is there a way to automatically delete log files every month or so? > 180MB is not that big, if that's the total volume of data you're processing. Have you got DNS lookups turned on? If so, turn them off. Otherwise, if it's slow because it's thrashing, investigate the *LOWMEM options. Of course, you can delete your logfiles on a schedule. Analog doesn't do that though. It never changes the contents of the logfiles, only reads them. -- Stephen Turner, Cambridge, UKhttp://homepage.ntlworld.com/adelie/stephen/ "The internet is a reflection of our society. If we do not like what we see, the problem is not to fix the mirror, we have to fix society." (Vint Cerf) + | TO UNSUBSCRIBE from this list: |http://lists.isite.net/listgate/analog-help/unsubscribe.html | | Digest version: http://lists.isite.net/listgate/analog-help-digest/ | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general | List archives: http://www.analog.cx/docs/mailing.html#listarchives +
[analog-help] Re: Re: Analog Not Processing All Sites
Thanks for all the help. I've used what you guys have suggested to troubleshoot some more. Now it seems that the problem is involving the amount of time that it takes for Analog to process each set of log files. The amount of log files that I have is huge (about 180 MB and smaller) and it can take analog up to 12 hours to process the largest site. So...is there a way to automatically delete log files every month or so? - Original Message - From: "Stephen Turner" Newsgroups: gmane.comp.web.analog.general Sent: Thursday, March 25, 2004 10:28 AM Subject: Re: Re: Analog Not Processing All Sites > On Wed, 24 Mar 2004, Chris Murphy wrote: > > > Since I first posted my question, I have found that the first site that is > > not being run is in IIS but is not actually hosted on that server yet. > > Would the DNS pointing to another server stop analog in it's tracks with no > > errors??? > > > > Sounds to me like a fault in the script or batch file that's controlling > analog. Each analog run should be entirely independent, but maybe the > script's giving up when it encounters a single failure. > > -- > Stephen Turner, Cambridge, UK http://homepage.ntlworld.com/adelie/stephen/ > "The internet is a reflection of our society. If we do not like what we see, > the problem is not to fix the mirror, we have to fix society." (Vint Cerf) > + > | TO UNSUBSCRIBE from this list: > |http://lists.isite.net/listgate/analog-help/unsubscribe.html > | > | Digest version: http://lists.isite.net/listgate/analog-help-digest/ > | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general > | List archives: http://www.analog.cx/docs/mailing.html#listarchives > + > + | TO UNSUBSCRIBE from this list: |http://lists.isite.net/listgate/analog-help/unsubscribe.html | | Digest version: http://lists.isite.net/listgate/analog-help-digest/ | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general | List archives: http://www.analog.cx/docs/mailing.html#listarchives +
RE: [analog-help] newbie question
Thanks for the replies. I'm viewing the analog site reports via Ensim WebAppliance. It appears that a weekly log file is generated named week(x).html in the same directory as analog.cfg. In addition to these files, there's a "cache" file, and "running" file. Although LOGFILE is set to "none", I believe it logs the current day's data in one of these 2 files until the end of the week, when that week's data is written to week(x).html. I hope this clears up the question some. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Aengus Sent: Thursday, March 25, 2004 1:53 PM To: [EMAIL PROTECTED] Subject: Re: [analog-help] newbie question Chris Edwards <[EMAIL PROTECTED]> wrote: > hello, ive been scouring the docs, but could really use some help > troubleshooting this one... my analog.cfg is posted below. problem is > the daily summary stats are being zeroed out each day, and are added > to the next day. i am at a loss! any hints would be appreciated! I don't understand your description of the problem - Analog will report on the contents of whatever log files you tell it to report on. Are you telling it to report on a single days logs, or on all the logs in a directory? Aengus +--- +- | TO UNSUBSCRIBE from this list: |http://lists.isite.net/listgate/analog-help/unsubscribe.html | | Digest version: http://lists.isite.net/listgate/analog-help-digest/ | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general | List archives: http://www.analog.cx/docs/mailing.html#listarchives +--- +- + | TO UNSUBSCRIBE from this list: |http://lists.isite.net/listgate/analog-help/unsubscribe.html | | Digest version: http://lists.isite.net/listgate/analog-help-digest/ | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general | List archives: http://www.analog.cx/docs/mailing.html#listarchives +
Re: [analog-help] corrupt logfile lines....
Can you post a couple of sample lines (or email me off list with a log file) and I will try and build a LOGFORMAT command for you. SC *** REPLY SEPARATOR *** On 24/03/2004 at 10:18 Savin, Jill wrote: >I've just downloaded and configued and tried out analog, and I get this >error message in report.html > >Successful requests: 0 >Corrupt logfile lines: 35,129 > >any idea where to start troubleshooting? >+ >| TO UNSUBSCRIBE from this list: >|http://lists.isite.net/listgate/analog-help/unsubscribe.html >| >| Digest version: http://lists.isite.net/listgate/analog-help-digest/ >| Usenet version: news://news.gmane.org/gmane.comp.web.analog.general >| List archives: http://www.analog.cx/docs/mailing.html#listarchives >+ + | TO UNSUBSCRIBE from this list: |http://lists.isite.net/listgate/analog-help/unsubscribe.html | | Digest version: http://lists.isite.net/listgate/analog-help-digest/ | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general | List archives: http://www.analog.cx/docs/mailing.html#listarchives +
Re: [analog-help] newbie question
The command "LOGFILE none" seems to specify only one file, called "none". If you're overwriting that file every day, that'll be the problem. SC *** REPLY SEPARATOR *** On 25/03/2004 at 18:52 Aengus wrote: >Chris Edwards <[EMAIL PROTECTED]> wrote: >> hello, ive been scouring the docs, but could really use some help >> troubleshooting this one... my analog.cfg is posted below. problem is >> the daily summary stats are being zeroed out each day, and are added >> to the next day. i am at a loss! any hints would be appreciated! > >I don't understand your description of the problem - Analog will report >on the contents of whatever log files you tell it to report on. Are you >telling it to report on a single days logs, or on all the logs in a >directory? > >Aengus > >+ >| TO UNSUBSCRIBE from this list: >|http://lists.isite.net/listgate/analog-help/unsubscribe.html >| >| Digest version: http://lists.isite.net/listgate/analog-help-digest/ >| Usenet version: news://news.gmane.org/gmane.comp.web.analog.general >| List archives: http://www.analog.cx/docs/mailing.html#listarchives >+ + | TO UNSUBSCRIBE from this list: |http://lists.isite.net/listgate/analog-help/unsubscribe.html | | Digest version: http://lists.isite.net/listgate/analog-help-digest/ | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general | List archives: http://www.analog.cx/docs/mailing.html#listarchives +
Re: [analog-help] newbie question
Chris Edwards <[EMAIL PROTECTED]> wrote: > hello, ive been scouring the docs, but could really use some help > troubleshooting this one... my analog.cfg is posted below. problem is > the daily summary stats are being zeroed out each day, and are added > to the next day. i am at a loss! any hints would be appreciated! I don't understand your description of the problem - Analog will report on the contents of whatever log files you tell it to report on. Are you telling it to report on a single days logs, or on all the logs in a directory? Aengus + | TO UNSUBSCRIBE from this list: |http://lists.isite.net/listgate/analog-help/unsubscribe.html | | Digest version: http://lists.isite.net/listgate/analog-help-digest/ | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general | List archives: http://www.analog.cx/docs/mailing.html#listarchives +
[analog-help] newbie question
hello, ive been scouring the docs, but could really use some help
troubleshooting this one... my analog.cfg is posted below. problem is
the daily summary stats are being zeroed out each day, and are added to
the next day. i am at a loss! any hints would be appreciated!
# Configuration file for analog 4.03
# Extra options used for generating the log data for OpCenterWeb
CACHEOUTFILE none
DNS NONE
#WARNINGS OFF
#APACHELOGFORMAT ("%h %l %u %t \"%r\" %>s %b \"%{User-Agent}i\"")
#LOGFORMAT (%S %l %j [%d/%M/%Y:%h:%n:%j] \"%j%w%r%wHTTP%j\" %c %b
\"%B\")
LOGFORMAT COMBINED
LOGFILE none
OUTPUT COMPUTER
OUTFILE -
GENERAL ON
MONTHLY ON
MONTHCOLS RrPp
WEEKLY OFF
FULLDAILY OFF
DAILY ON
DAYCOLS RrPp
FULLHOURLY OFF
HOURLY ON
HOURCOLS RrPp
QUARTER OFF
FIVE OFF
HOST OFF
HOSTCOLS RrPp
HOSTFLOOR 1:r
ORGANISATION OFF
ORGCOLS RrPp
ORGFLOOR 1:r
DOMAIN OFF
DOMCOLS RrPp
DOMSORTBY REQUESTS
DOMFLOOR 1:r
SUBDOMFLOOR 1:r
SUBDOMSORTBY REQUESTS
REQUEST OFF
DIRECTORY ON
DIRCOLS Rrb
FILETYPE ON
TYPECOLS Rrb
SIZE OFF
PROCTIME OFF
REDIR OFF
FAILURE ON
FAILCOLS Rr
REFERER ON
REFSITE ON
SEARCHQUERY OFF
SEARCHWORD ON
REDIRREF OFF
FAILREF OFF
FULLBROWSER OFF
BROWSER ON
BROWFLOOR 1:r
BROWCOLS Rr
BROWSORTBY REQUESTS
SUBBROWSORTBY REQUESTS
SUBBROWFLOOR 1:r
OSREP OFF
VHOST OFF
USER OFF
FAILUSER OFF
STATUS OFF
+
| TO UNSUBSCRIBE from this list:
|http://lists.isite.net/listgate/analog-help/unsubscribe.html
|
| Digest version: http://lists.isite.net/listgate/analog-help-digest/
| Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
| List archives: http://www.analog.cx/docs/mailing.html#listarchives
+
Re: [analog-help] analog --> maillog2commonlog + postfix
Which version of ml2cl? The one distributed with Debian analog, or the one on the analog helper apps page? I think they may be different, and it might be worth trying both. -- Stephen Turner, Cambridge, UKhttp://homepage.ntlworld.com/adelie/stephen/ "The internet is a reflection of our society. If we do not like what we see, the problem is not to fix the mirror, we have to fix society." (Vint Cerf) + | TO UNSUBSCRIBE from this list: |http://lists.isite.net/listgate/analog-help/unsubscribe.html | | Digest version: http://lists.isite.net/listgate/analog-help-digest/ | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general | List archives: http://www.analog.cx/docs/mailing.html#listarchives +
[analog-help] min, max, mean proc time
Hi: Is it possible to report the minimum, maximum, and mean proctime for all pages in a given set of log files? I've searched the mailing list and found numerous references to docs/faq.html#faq128, but that doesn't help. Thanks in advance. W. Jeffrey Rankin Lead Web Application Developer O'NEIL & ASSOCIATES, INC. http://www.oneil.com 495 Byers Rd. Miamisburg, Ohio 45342-3662 Phone: (937) 865-0846 ext. 3504 Fax: (937) 865-5858 E-mail: [EMAIL PROTECTED] Confidentiality Notice The information contained in this e-mail is confidential and intended for use only by the person(s) or organization listed in the address. If you have received this communication in error, please contact the sender at O'Neil & Associates, Inc., immediately. Any copying, dissemination, or distribution of this communication, other than by the intended recipient, is strictly prohibited. + | TO UNSUBSCRIBE from this list: |http://lists.isite.net/listgate/analog-help/unsubscribe.html | | Digest version: http://lists.isite.net/listgate/analog-help-digest/ | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general | List archives: http://www.analog.cx/docs/mailing.html#listarchives +
Re: [analog-help] performance problem with RHES 3
On Thu, 25 Mar 2004, Yavor Trapkov wrote: > - I recompiled analog (from the SRPMS) but the problem remains > - then uncompressed the log file - it became ~6GB and analog gives > > /usr/bin/analog: Warning F: Failed to open logfile > /var/log/www/archive/March_2004.log: ignoring it > > it work however with smaller files, 400MB for example > > are there any limitations about the logfile size > On some OS's you need to explicitly compile applications with big file support in order to allow them to read files greater than 2GB. -- Stephen Turner, Cambridge, UKhttp://homepage.ntlworld.com/adelie/stephen/ "The internet is a reflection of our society. If we do not like what we see, the problem is not to fix the mirror, we have to fix society." (Vint Cerf) + | TO UNSUBSCRIBE from this list: |http://lists.isite.net/listgate/analog-help/unsubscribe.html | | Digest version: http://lists.isite.net/listgate/analog-help-digest/ | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general | List archives: http://www.analog.cx/docs/mailing.html#listarchives +
Re: [analog-help] .asp and "include" files
On Wed, 24 Mar 2004, Jeremy Wadsack wrote: > > If you just want to see these entries in your Request Report, use the > ARGSINCLUDE command like this: > > ARGSINCLUDE /TPS_Dir/wrap.asp > > See http://analog.cx/docs/args.html#ARGSINCLUDE for details. > Actually, I suspect it's just that the REQARGSFLOOR is too high. -- Stephen Turner, Cambridge, UKhttp://homepage.ntlworld.com/adelie/stephen/ "The internet is a reflection of our society. If we do not like what we see, the problem is not to fix the mirror, we have to fix society." (Vint Cerf) + | TO UNSUBSCRIBE from this list: |http://lists.isite.net/listgate/analog-help/unsubscribe.html | | Digest version: http://lists.isite.net/listgate/analog-help-digest/ | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general | List archives: http://www.analog.cx/docs/mailing.html#listarchives +
Re: [analog-help] Re: Analog Not Processing All Sites
On Wed, 24 Mar 2004, Chris Murphy wrote: > Since I first posted my question, I have found that the first site that is > not being run is in IIS but is not actually hosted on that server yet. > Would the DNS pointing to another server stop analog in it's tracks with no > errors??? > Sounds to me like a fault in the script or batch file that's controlling analog. Each analog run should be entirely independent, but maybe the script's giving up when it encounters a single failure. -- Stephen Turner, Cambridge, UKhttp://homepage.ntlworld.com/adelie/stephen/ "The internet is a reflection of our society. If we do not like what we see, the problem is not to fix the mirror, we have to fix society." (Vint Cerf) + | TO UNSUBSCRIBE from this list: |http://lists.isite.net/listgate/analog-help/unsubscribe.html | | Digest version: http://lists.isite.net/listgate/analog-help-digest/ | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general | List archives: http://www.analog.cx/docs/mailing.html#listarchives +
Re: [analog-help] Referer not showing up in report.html
Hi and thanks for your input!
No not what I can see in analog.conf.
Can 'LOGFORMAT COMBINED' find the referer when Apache
logging referers with '\"%{Referer}i\"' ?
Best regards
-Ursprungligt meddelande-
Fran: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] Jeremy Wadsack
Skickat: den 24 mars 2004 17:47
Till: [EMAIL PROTECTED]
Amne: Re: [analog-help] Referer not showing up in report.html
Do you have any EXCLUDE commands that might be removing all entries
with referrers in them?
--
Jeremy Wadsack
Wadsack-Allen Digital Group
Pelle Andersson <[EMAIL PROTECTED]> (Wednesday, March 24, 2004 5:23 AM):
> Hi Analog List!
> I cant see any of the refering sites in my report.html from latest Analog.
> This is my Apache2 conf for logging:
>
> LogFormat "%h %l %u %t \"%r\" %>s %b \"%{Referer}i\" \"%{User-Agent}i\""
> combined
> LogFormat "%h %l %u %t \"%r\" %>s %b" common
> LogFormat "%{Referer}i -> %U" referer
> LogFormat "%{User-agent}i" agent
>
> This is found in Apache logfile:
>
> 192.168.135.205 - - [24/Mar/2004:13:03:14 +0100] "GET / HTTP/1.1" 200
32979
> "http://a-refering-site.xyz/a-pointing_doc.html"; "Mozilla/4.0 (compatible;
> MSIE 6.0; Windows NT 5.1; .NET CLR 1.1.4322)"
>
> My Analog conf:
>
> LOGFORMAT COMBINED
> LOGFILE /var/log/httpd-access.log
> LOGFILE /var/log/httpd-access.log.*.gz
>
> Thanks in advance for any input to a solution.
> Best regards
+
| TO UNSUBSCRIBE from this list:
|http://lists.isite.net/listgate/analog-help/unsubscribe.html
|
| Digest version: http://lists.isite.net/listgate/analog-help-digest/
| Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
| List archives: http://www.analog.cx/docs/mailing.html#listarchives
+
+
| TO UNSUBSCRIBE from this list:
|http://lists.isite.net/listgate/analog-help/unsubscribe.html
|
| Digest version: http://lists.isite.net/listgate/analog-help-digest/
| Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
| List archives: http://www.analog.cx/docs/mailing.html#listarchives
+
Re: [analog-help] analog --> maillog2commonlog + postfix
No, because I have posted a part of an old post. The "owner" of this post is someone who wrote it about year 2001, and we have no notices from him. + | TO UNSUBSCRIBE from this list: |http://lists.isite.net/listgate/analog-help/unsubscribe.html | | Digest version: http://lists.isite.net/listgate/analog-help-digest/ | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general | List archives: http://www.analog.cx/docs/mailing.html#listarchives +
Re: [analog-help] analog --> maillog2commonlog + postfix
Raúl Pintor wrote: The command I used was : "./maillog2commonlog postfix < maillog.1 > mail" I generated another log "mail" which had been coverted. This "mail" file was then used with analog to generate the mailstats. The last couple of weeks the "mail" file contained 0 (zero) info after running the maillog2commonlog. Do you still have your old log files which worked, to confirm that those get processed correctly through the script and verify if the log format may have changed? -- Klaus Johannes Rusch [EMAIL PROTECTED] http://www.atmedia.net/KlausRusch/ + | TO UNSUBSCRIBE from this list: |http://lists.isite.net/listgate/analog-help/unsubscribe.html | | Digest version: http://lists.isite.net/listgate/analog-help-digest/ | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general | List archives: http://www.analog.cx/docs/mailing.html#listarchives +
Re: [analog-help] analog --> maillog2commonlog + postfix
I have seen a question from 2001, this is a part of the text: I previously used the 'maillog2commonlog' prog to generate the mail stats for my site but for the last couple of weeks I have not been able to get the prog to function correctly. Admittedly I have only achieved one successful run of the program to date. I copy the maillog (postfix) file to the mailstat directory and run the maillog2commonlog file, just the same way I did for the successful run the first time but with nil results in the ouput file. The command I used was : "./maillog2commonlog postfix < maillog.1 > mail" I generated another log "mail" which had been coverted. This "mail" file was then used with analog to generate the mailstats. The last couple of weeks the "mail" file contained 0 (zero) info after running the maillog2commonlog. I am no expert with Perl but I have tried to comprehend the code in maillog2commonlog to no avail. Am I using the correct command in the first place or have I just missed something simple. THe system here is RedHat 6.2 with postfix as the mail server. Any assistance would be gratefully received. Thank you. -- Wallace Mills Then, seeing that, it seems to have worked with postfix in the past, at least one time. Now, I'm trying to understand a little bit Perl and manage with the code, and try to do it work for me, but I write some lines in awk, too. I will accept any suggestion about this, it's all a little bit confusing + | TO UNSUBSCRIBE from this list: |http://lists.isite.net/listgate/analog-help/unsubscribe.html | | Digest version: http://lists.isite.net/listgate/analog-help-digest/ | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general | List archives: http://www.analog.cx/docs/mailing.html#listarchives +
Re: [analog-help] analog --> maillog2commonlog + postfix
On Wed, 24 Mar 2004 08:44:12 -0800, Jeremy Wadsack wrote: >Likely the postfix logs are in a slightly different format than the >sendmail logs and the maillog2commonlog script is dropping >unrecognized lines. I believe maillog2commonlog should be able to process postfix mail-logs too. That's what the source code says anyway. /Per Jessen, Zurich + | TO UNSUBSCRIBE from this list: |http://lists.isite.net/listgate/analog-help/unsubscribe.html | | Digest version: http://lists.isite.net/listgate/analog-help-digest/ | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general | List archives: http://www.analog.cx/docs/mailing.html#listarchives +
Re: [analog-help] performance problem with RHES 3
- I recompiled analog (from the SRPMS) but the problem remains - then uncompressed the log file - it became ~6GB and analog gives /usr/bin/analog: Warning F: Failed to open logfile /var/log/www/archive/March_2004.log: ignoring it it work however with smaller files, 400MB for example are there any limitations about the logfile size Thanks Yavor Jeremy Wadsack <[EMAIL PROTECTED]> wrote: > >You did recompile Analog on the new RHES system, right? > >Have you tried performance testing the gzip on both systems, in case >that is where the bottle neck is? > >-- > >Jeremy Wadsack >Wadsack-Allen Digital Group > > >Yavor Trapkov <[EMAIL PROTECTED]> (Wednesday, March 24, 2004 5:15 AM): > >> Hello, I just moved our web server from RH7.3 to RHES 3.1 and I experience a >> performance problem with analog, the two servers are the same (2x1.4P3 1.2GB RAM). >> We have let say big log files ~30 >> milion lines, and I process them compressed >> UNCOMPTESS *.gz "gzip -cd" > >> I tried to use the LOWMEM options and with $LANG=C, but apparently no difference. > >> Does anyone experienced a similar problem? > > >> Here is PROGRESSFREQ I get from the two servers: >> >> RH7.3 >> /usr/bin/analog: [11:33:03] 50 lines read >> /usr/bin/analog: [11:33:08] 100 lines read >> /usr/bin/analog: [11:33:13] 150 lines read >> /usr/bin/analog: [11:33:17] 200 lines read >> /usr/bin/analog: [11:33:22] 250 lines read >> /usr/bin/analog: [11:33:27] 300 lines read >> /usr/bin/analog: [11:33:32] 350 lines read >> /usr/bin/analog: [11:33:37] 400 lines read >> /usr/bin/analog: [11:33:42] 450 lines read >> /usr/bin/analog: [11:33:47] 500 lines read >> /usr/bin/analog: [11:33:52] 550 lines read >> /usr/bin/analog: [11:33:57] 600 lines read >> /usr/bin/analog: [11:34:02] 650 lines read >> /usr/bin/analog: [11:34:07] 700 lines read >> /usr/bin/analog: [11:34:12] 750 lines read >> /usr/bin/analog: [11:34:17] 800 lines read >> /usr/bin/analog: [11:34:22] 850 lines read >> /usr/bin/analog: [11:34:27] 900 lines read >> /usr/bin/analog: [11:34:32] 950 lines read >> /usr/bin/analog: [11:34:37] 1000 lines read >> /usr/bin/analog: [11:34:42] 1050 lines read >> /usr/bin/analog: [11:34:47] 1100 lines read >> /usr/bin/analog: [11:34:52] 1150 lines read >> /usr/bin/analog: [11:34:57] 1200 lines read >> /usr/bin/analog: [11:35:02] 1250 lines read >> /usr/bin/analog: [11:35:07] 1300 lines read >> /usr/bin/analog: [11:35:12] 1350 lines read >> /usr/bin/analog: [11:35:18] 1400 lines read >> /usr/bin/analog: [11:35:23] 1450 lines read >> /usr/bin/analog: [11:35:29] 1500 lines read >> /usr/bin/analog: [11:35:34] 1550 lines read >> /usr/bin/analog: [11:35:39] 1600 lines read >> /usr/bin/analog: [11:35:46] 1650 lines read >> /usr/bin/analog: [11:35:53] 1700 lines read >> /usr/bin/analog: [11:35:59] 1750 lines read >> /usr/bin/analog: [11:36:06] 1800 lines read >> /usr/bin/analog: [11:36:13] 1850 lines read >> /usr/bin/analog: [11:36:20] 1900 lines read >> /usr/bin/analog: [11:36:27] 1950 lines read >> /usr/bin/analog: [11:36:35] 2000 lines read >> /usr/bin/analog: [11:36:43] 2050 lines read >> /usr/bin/analog: [11:36:52] 2100 lines read >> /usr/bin/analog: [11:37:01] 2150 lines read >> /usr/bin/analog: [11:37:12] 2200 lines read >> /usr/bin/analog: [11:37:22] 2250 lines read >> /usr/bin/analog: [11:37:32] 2300 lines read >> /usr/bin/analog: [11:37:43] 2350 lines read >> /usr/bin/analog: [11:37:52] 2400 lines read >> /usr/bin/analog: [11:38:03] 2450 lines read >> /usr/bin/analog: [11:38:19] 2500 lines read >> /usr/bin/analog: [11:38:35] 2550 lines read >> /usr/bin/analog: [11:38:56] 2600 lines read > >> real10m10.556s >> user5m9.620s >> sys 0m48.690s >> - > > >> RHES3.1 >> /usr/bin/analog: [13:53:02] 50 lines read >> /usr/bin/analog: [13:53:07] 100 lines read >> /usr/bin/analog: [13:53:12] 150 lines read >> /usr/bin/analog: [13:53:16] 200 lines read >> /usr/bin/analog: [13:53:22] 250 lines read >> /usr/bin/analog: [13:53:29] 300 lines read >> /usr/bin/analog: [13:53:46] 350 lines read >> /usr/bin/analog: [13:53:58] 400 lines read >> /usr/bin/analog: [13:54:08] 450 lines read >> /usr/bin/analog: [13:54:28] 500 lines read >> /usr/bin/analog: [13:54:45] 550 lines read >> /usr/bin/analog: [13:54:55] 600 lines read >> /usr/bin/analog: [13:55:09] 650 lines read >> /usr/bin/analog: [13:55:52] 700 lines read >> /usr/bin/analog: [14:00:27] 750 lines read >> /usr/bin/analog: [14:20:35] 800 lines read >> Received interrupt signal: exiting > > > >> __ >> Introducing the New Netscape Internet Service. >> Only $9.95 a month -- Sign up today at http://isp.netscape.com/regis
