Re: [analog-help] performance problem with RHES 3
- I recompiled analog (from the SRPMS) but the problem remains - then uncompressed the log file - it became ~6GB and analog gives /usr/bin/analog: Warning F: Failed to open logfile /var/log/www/archive/March_2004.log: ignoring it it work however with smaller files, 400MB for example are there any limitations about the logfile size Thanks Yavor Jeremy Wadsack [EMAIL PROTECTED] wrote: You did recompile Analog on the new RHES system, right? Have you tried performance testing the gzip on both systems, in case that is where the bottle neck is? -- Jeremy Wadsack Wadsack-Allen Digital Group Yavor Trapkov [EMAIL PROTECTED] (Wednesday, March 24, 2004 5:15 AM): Hello, I just moved our web server from RH7.3 to RHES 3.1 and I experience a performance problem with analog, the two servers are the same (2x1.4P3 1.2GB RAM). We have let say big log files ~30 milion lines, and I process them compressed UNCOMPTESS *.gz gzip -cd I tried to use the LOWMEM options and with $LANG=C, but apparently no difference. Does anyone experienced a similar problem? Here is PROGRESSFREQ I get from the two servers: RH7.3 /usr/bin/analog: [11:33:03] 50 lines read /usr/bin/analog: [11:33:08] 100 lines read /usr/bin/analog: [11:33:13] 150 lines read /usr/bin/analog: [11:33:17] 200 lines read /usr/bin/analog: [11:33:22] 250 lines read /usr/bin/analog: [11:33:27] 300 lines read /usr/bin/analog: [11:33:32] 350 lines read /usr/bin/analog: [11:33:37] 400 lines read /usr/bin/analog: [11:33:42] 450 lines read /usr/bin/analog: [11:33:47] 500 lines read /usr/bin/analog: [11:33:52] 550 lines read /usr/bin/analog: [11:33:57] 600 lines read /usr/bin/analog: [11:34:02] 650 lines read /usr/bin/analog: [11:34:07] 700 lines read /usr/bin/analog: [11:34:12] 750 lines read /usr/bin/analog: [11:34:17] 800 lines read /usr/bin/analog: [11:34:22] 850 lines read /usr/bin/analog: [11:34:27] 900 lines read /usr/bin/analog: [11:34:32] 950 lines read /usr/bin/analog: [11:34:37] 1000 lines read /usr/bin/analog: [11:34:42] 1050 lines read /usr/bin/analog: [11:34:47] 1100 lines read /usr/bin/analog: [11:34:52] 1150 lines read /usr/bin/analog: [11:34:57] 1200 lines read /usr/bin/analog: [11:35:02] 1250 lines read /usr/bin/analog: [11:35:07] 1300 lines read /usr/bin/analog: [11:35:12] 1350 lines read /usr/bin/analog: [11:35:18] 1400 lines read /usr/bin/analog: [11:35:23] 1450 lines read /usr/bin/analog: [11:35:29] 1500 lines read /usr/bin/analog: [11:35:34] 1550 lines read /usr/bin/analog: [11:35:39] 1600 lines read /usr/bin/analog: [11:35:46] 1650 lines read /usr/bin/analog: [11:35:53] 1700 lines read /usr/bin/analog: [11:35:59] 1750 lines read /usr/bin/analog: [11:36:06] 1800 lines read /usr/bin/analog: [11:36:13] 1850 lines read /usr/bin/analog: [11:36:20] 1900 lines read /usr/bin/analog: [11:36:27] 1950 lines read /usr/bin/analog: [11:36:35] 2000 lines read /usr/bin/analog: [11:36:43] 2050 lines read /usr/bin/analog: [11:36:52] 2100 lines read /usr/bin/analog: [11:37:01] 2150 lines read /usr/bin/analog: [11:37:12] 2200 lines read /usr/bin/analog: [11:37:22] 2250 lines read /usr/bin/analog: [11:37:32] 2300 lines read /usr/bin/analog: [11:37:43] 2350 lines read /usr/bin/analog: [11:37:52] 2400 lines read /usr/bin/analog: [11:38:03] 2450 lines read /usr/bin/analog: [11:38:19] 2500 lines read /usr/bin/analog: [11:38:35] 2550 lines read /usr/bin/analog: [11:38:56] 2600 lines read real10m10.556s user5m9.620s sys 0m48.690s - RHES3.1 /usr/bin/analog: [13:53:02] 50 lines read /usr/bin/analog: [13:53:07] 100 lines read /usr/bin/analog: [13:53:12] 150 lines read /usr/bin/analog: [13:53:16] 200 lines read /usr/bin/analog: [13:53:22] 250 lines read /usr/bin/analog: [13:53:29] 300 lines read /usr/bin/analog: [13:53:46] 350 lines read /usr/bin/analog: [13:53:58] 400 lines read /usr/bin/analog: [13:54:08] 450 lines read /usr/bin/analog: [13:54:28] 500 lines read /usr/bin/analog: [13:54:45] 550 lines read /usr/bin/analog: [13:54:55] 600 lines read /usr/bin/analog: [13:55:09] 650 lines read /usr/bin/analog: [13:55:52] 700 lines read /usr/bin/analog: [14:00:27] 750 lines read /usr/bin/analog: [14:20:35] 800 lines read Received interrupt signal: exiting __ Introducing the New Netscape Internet Service. Only $9.95 a month -- Sign up today at http://isp.netscape.com/register Netscape. Just the Net You Need. New! Netscape Toolbar for Internet Explorer Search from anywhere on the Web and block those annoying pop-ups. Download now at
Re: [analog-help] performance problem with RHES 3
On Thu, 25 Mar 2004, Yavor Trapkov wrote: - I recompiled analog (from the SRPMS) but the problem remains - then uncompressed the log file - it became ~6GB and analog gives /usr/bin/analog: Warning F: Failed to open logfile /var/log/www/archive/March_2004.log: ignoring it it work however with smaller files, 400MB for example are there any limitations about the logfile size On some OS's you need to explicitly compile applications with big file support in order to allow them to read files greater than 2GB. -- Stephen Turner, Cambridge, UKhttp://homepage.ntlworld.com/adelie/stephen/ The internet is a reflection of our society. If we do not like what we see, the problem is not to fix the mirror, we have to fix society. (Vint Cerf) + | TO UNSUBSCRIBE from this list: |http://lists.isite.net/listgate/analog-help/unsubscribe.html | | Digest version: http://lists.isite.net/listgate/analog-help-digest/ | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general | List archives: http://www.analog.cx/docs/mailing.html#listarchives +
Re: [analog-help] performance problem with RHES 3
You did recompile Analog on the new RHES system, right? Have you tried performance testing the gzip on both systems, in case that is where the bottle neck is? -- Jeremy Wadsack Wadsack-Allen Digital Group Yavor Trapkov [EMAIL PROTECTED] (Wednesday, March 24, 2004 5:15 AM): Hello, I just moved our web server from RH7.3 to RHES 3.1 and I experience a performance problem with analog, the two servers are the same (2x1.4P3 1.2GB RAM). We have let say big log files ~30 milion lines, and I process them compressed UNCOMPTESS *.gz gzip -cd I tried to use the LOWMEM options and with $LANG=C, but apparently no difference. Does anyone experienced a similar problem? Here is PROGRESSFREQ I get from the two servers: RH7.3 /usr/bin/analog: [11:33:03] 50 lines read /usr/bin/analog: [11:33:08] 100 lines read /usr/bin/analog: [11:33:13] 150 lines read /usr/bin/analog: [11:33:17] 200 lines read /usr/bin/analog: [11:33:22] 250 lines read /usr/bin/analog: [11:33:27] 300 lines read /usr/bin/analog: [11:33:32] 350 lines read /usr/bin/analog: [11:33:37] 400 lines read /usr/bin/analog: [11:33:42] 450 lines read /usr/bin/analog: [11:33:47] 500 lines read /usr/bin/analog: [11:33:52] 550 lines read /usr/bin/analog: [11:33:57] 600 lines read /usr/bin/analog: [11:34:02] 650 lines read /usr/bin/analog: [11:34:07] 700 lines read /usr/bin/analog: [11:34:12] 750 lines read /usr/bin/analog: [11:34:17] 800 lines read /usr/bin/analog: [11:34:22] 850 lines read /usr/bin/analog: [11:34:27] 900 lines read /usr/bin/analog: [11:34:32] 950 lines read /usr/bin/analog: [11:34:37] 1000 lines read /usr/bin/analog: [11:34:42] 1050 lines read /usr/bin/analog: [11:34:47] 1100 lines read /usr/bin/analog: [11:34:52] 1150 lines read /usr/bin/analog: [11:34:57] 1200 lines read /usr/bin/analog: [11:35:02] 1250 lines read /usr/bin/analog: [11:35:07] 1300 lines read /usr/bin/analog: [11:35:12] 1350 lines read /usr/bin/analog: [11:35:18] 1400 lines read /usr/bin/analog: [11:35:23] 1450 lines read /usr/bin/analog: [11:35:29] 1500 lines read /usr/bin/analog: [11:35:34] 1550 lines read /usr/bin/analog: [11:35:39] 1600 lines read /usr/bin/analog: [11:35:46] 1650 lines read /usr/bin/analog: [11:35:53] 1700 lines read /usr/bin/analog: [11:35:59] 1750 lines read /usr/bin/analog: [11:36:06] 1800 lines read /usr/bin/analog: [11:36:13] 1850 lines read /usr/bin/analog: [11:36:20] 1900 lines read /usr/bin/analog: [11:36:27] 1950 lines read /usr/bin/analog: [11:36:35] 2000 lines read /usr/bin/analog: [11:36:43] 2050 lines read /usr/bin/analog: [11:36:52] 2100 lines read /usr/bin/analog: [11:37:01] 2150 lines read /usr/bin/analog: [11:37:12] 2200 lines read /usr/bin/analog: [11:37:22] 2250 lines read /usr/bin/analog: [11:37:32] 2300 lines read /usr/bin/analog: [11:37:43] 2350 lines read /usr/bin/analog: [11:37:52] 2400 lines read /usr/bin/analog: [11:38:03] 2450 lines read /usr/bin/analog: [11:38:19] 2500 lines read /usr/bin/analog: [11:38:35] 2550 lines read /usr/bin/analog: [11:38:56] 2600 lines read real10m10.556s user5m9.620s sys 0m48.690s - RHES3.1 /usr/bin/analog: [13:53:02] 50 lines read /usr/bin/analog: [13:53:07] 100 lines read /usr/bin/analog: [13:53:12] 150 lines read /usr/bin/analog: [13:53:16] 200 lines read /usr/bin/analog: [13:53:22] 250 lines read /usr/bin/analog: [13:53:29] 300 lines read /usr/bin/analog: [13:53:46] 350 lines read /usr/bin/analog: [13:53:58] 400 lines read /usr/bin/analog: [13:54:08] 450 lines read /usr/bin/analog: [13:54:28] 500 lines read /usr/bin/analog: [13:54:45] 550 lines read /usr/bin/analog: [13:54:55] 600 lines read /usr/bin/analog: [13:55:09] 650 lines read /usr/bin/analog: [13:55:52] 700 lines read /usr/bin/analog: [14:00:27] 750 lines read /usr/bin/analog: [14:20:35] 800 lines read Received interrupt signal: exiting __ Introducing the New Netscape Internet Service. Only $9.95 a month -- Sign up today at http://isp.netscape.com/register Netscape. Just the Net You Need. New! Netscape Toolbar for Internet Explorer Search from anywhere on the Web and block those annoying pop-ups. Download now at http://channels.netscape.com/ns/search/install.jsp + | TO UNSUBSCRIBE from this list: |http://lists.isite.net/listgate/analog-help/unsubscribe.html | | Digest version: http://lists.isite.net/listgate/analog-help-digest/ | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general | List archives:
