Re: [Mimedefang] MIMEDefang embedded perl stability issues
Chris Gauch said: The embedded perl interpreter definitely minimizes the memory usage by the MD slaves, but I don't really notice an overall improvement in total memory usage when using the embedded perl option. All 1.5GB of RAM is still used up entirely, and I have the same number of min/max slaves that I used when I went over this item a few month's ago. It uses less memory but does not show using less memory, depending on how ou measure memory used. I was not using the embedded perl interpreter. I also use a RAM disk for the /var/spool/MIMEDefang directory, and have that set at 128MB. Maybe I'm doing something wrong here, but I haven't found much documentation on the embedded perl interpreter, other than it improves throughput and reduces memory usage. Any insight would be appreciated. What OS and version of perl are you using. I would reccomend you use at least 5.8 if you are using the embedded perl version. How many slaves do you run? What is your mail volume? What is your max message size you accept? Could you add some delay to your cron jobs, so they don't all start at the same time? What is your maximum sendmail processes? The embedded perl should decrease memory usage, and increase startup time on pre-forked slaves. I noticed signifigant memory savings on my 6 slave system. Do you have a decent amount of memory in reserve, or are you generally allocating all of your memory? -- Luke Computer Science System Administrator Security Administrator,College of Engineering Montana State University-Bozeman,Montana ___ Visit http://www.mimedefang.org and http://www.canit.ca MIMEDefang mailing list [EMAIL PROTECTED] http://lists.roaringpenguin.com/mailman/listinfo/mimedefang
Re: [Mimedefang] MIMEDefang embedded perl stability issues
duh, didn't see any of the previous posts, until just now. I guess I never do a reread, always a restart, that would explain why I never saw the error. Dave, Should the default mimedefang-filter have use strict in it, in the default install? Would that solve some problems? -- Luke Computer Science System Administrator Security Administrator,College of Engineering Montana State University-Bozeman,Montana ___ Visit http://www.mimedefang.org and http://www.canit.ca MIMEDefang mailing list [EMAIL PROTECTED] http://lists.roaringpenguin.com/mailman/listinfo/mimedefang
Re: [Mimedefang] MIMEDefang embedded perl stability issues
Hi, Should the default mimedefang-filter have use strict in it, in the default install? Would that solve some problems? It can fix some unpropper written code which makes troubles in the reload szenario ... Martin ___ Visit http://www.mimedefang.org and http://www.canit.ca MIMEDefang mailing list [EMAIL PROTECTED] http://lists.roaringpenguin.com/mailman/listinfo/mimedefang
RE: [Mimedefang] MIMEDefang embedded perl stability issues
From: Martin Blapp [mailto:[EMAIL PROTECTED]
Should the default mimedefang-filter have use strict in it, in the
default install?
Would that solve some problems?
It can fix some unpropper written code which makes troubles in the
reload szenario ...
*ALL* production Perl code should live under use strict - or have a very
good reason why not!
I almost wish
use strict;
was the default, and could only be turned off by a specific
no strict;
with a mandatory
# turning off stricture because (can't think of a reason right now...)
To use strict or not use strict is the subject of an ongoing religious war.
Flame me at will. :)
[EMAIL PROTECTED] 805.964.4554 x902
Hispanic Business Inc./HireDiversity.com Software Engineer
perl -emap{y/a-z/l-za-k/;print}shift Jjhi pcdiwtg Ptga wprztg,
___
Visit http://www.mimedefang.org and http://www.canit.ca
MIMEDefang mailing list
[EMAIL PROTECTED]
http://lists.roaringpenguin.com/mailman/listinfo/mimedefang
RE: [Mimedefang] MIMEDefang embedded perl stability issues
David, The patch appears to have taken care of the issue. I applied the patch (according to directions) on Friday and no crashes during the weekend. - Chris -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of David F. Skoll Sent: Friday, June 25, 2004 11:15 AM To: [EMAIL PROTECTED] Subject: RE: [Mimedefang] MIMEDefang embedded perl stability issues On Fri, 25 Jun 2004, Chris Gauch wrote: Yep -- just realized that -- see my previous email about doing a mimedefang reread in a cron.daily script. Hopefully removing that reread command will fix the issue! Could you see if 2.44-BETA-1 fixes it? I applied a patch from Martin Blapp: http://lists.roaringpenguin.com/pipermail/mimedefang/2004-June/022707.html -- David. ___ Visit http://www.mimedefang.org and http://www.canit.ca MIMEDefang mailing list [EMAIL PROTECTED] http://lists.roaringpenguin.com/mailman/listinfo/mimedefang ___ Visit http://www.mimedefang.org and http://www.canit.ca MIMEDefang mailing list [EMAIL PROTECTED] http://lists.roaringpenguin.com/mailman/listinfo/mimedefang
[Mimedefang] MIMEDefang embedded perl stability issues
A couple weeks ago I opted to use the MIMEDefang embedded perl interpreter (by turning on MX_EMBED_PERL=yes in the MD init script), however, I have noticed some stability problems when using the embedded interpreter. Every morning at 5am the MD multiplexor essentially craps out, requiring MIMEDefang, clamd, and sendmail to be restarted. I didn't see much in the log files indicating what was causing the multiplexor to die off, but I do know that the daily CRON jobs run at around 4-5am every night. The embedded perl interpreter definitely minimizes the memory usage by the MD slaves, but I don't really notice an overall improvement in total memory usage when using the embedded perl option. All 1.5GB of RAM is still used up entirely, and I have the same number of min/max slaves that I used when I was not using the embedded perl interpreter. I also use a RAM disk for the /var/spool/MIMEDefang directory, and have that set at 128MB. Maybe I'm doing something wrong here, but I haven't found much documentation on the embedded perl interpreter, other than it improves throughput and reduces memory usage. Any insight would be appreciated. - Chris ___ Visit http://www.mimedefang.org and http://www.canit.ca MIMEDefang mailing list [EMAIL PROTECTED] http://lists.roaringpenguin.com/mailman/listinfo/mimedefang
Re: [Mimedefang] MIMEDefang embedded perl stability issues
On Fri, 25 Jun 2004, Chris Gauch wrote: A couple weeks ago I opted to use the MIMEDefang embedded perl interpreter (by turning on MX_EMBED_PERL=yes in the MD init script), however, I have noticed some stability problems when using the embedded interpreter. Every morning at 5am the MD multiplexor essentially craps out, What OS are you on? I don't observe this. The embedded perl interpreter definitely minimizes the memory usage by the MD slaves, but I don't really notice an overall improvement in total memory usage when using the embedded perl option. All 1.5GB of RAM is still used up entirely, That's normal under Linux. It uses memory aggressively to do file system caching. -- David. ___ Visit http://www.mimedefang.org and http://www.canit.ca MIMEDefang mailing list [EMAIL PROTECTED] http://lists.roaringpenguin.com/mailman/listinfo/mimedefang
RE: [Mimedefang] MIMEDefang embedded perl stability issues
I'm on Redhat Linux 9 for the OS, latest kernel, etc. (through RHN update). MIMEDefang version is 2.43, Spamassassin 2.63, and ClamAV 0.72. This problem was fairly consistent when using the embedded perl interpreter, the MD multiplexor would crash at almost the exact same time every morning (around 4-5am). I don't encounter the problem when I'm not using embedded perl. - Chris -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of David F. Skoll Sent: Friday, June 25, 2004 10:02 AM To: [EMAIL PROTECTED] Subject: Re: [Mimedefang] MIMEDefang embedded perl stability issues On Fri, 25 Jun 2004, Chris Gauch wrote: A couple weeks ago I opted to use the MIMEDefang embedded perl interpreter (by turning on MX_EMBED_PERL=yes in the MD init script), however, I have noticed some stability problems when using the embedded interpreter. Every morning at 5am the MD multiplexor essentially craps out, What OS are you on? I don't observe this. The embedded perl interpreter definitely minimizes the memory usage by the MD slaves, but I don't really notice an overall improvement in total memory usage when using the embedded perl option. All 1.5GB of RAM is still used up entirely, That's normal under Linux. It uses memory aggressively to do file system caching. -- David. ___ Visit http://www.mimedefang.org and http://www.canit.ca MIMEDefang mailing list [EMAIL PROTECTED] http://lists.roaringpenguin.com/mailman/listinfo/mimedefang ___ Visit http://www.mimedefang.org and http://www.canit.ca MIMEDefang mailing list [EMAIL PROTECTED] http://lists.roaringpenguin.com/mailman/listinfo/mimedefang
Re: [Mimedefang] MIMEDefang embedded perl stability issues
Hi, noticed some stability problems when using the embedded interpreter. Every morning at 5am the MD multiplexor essentially craps out, We had the same issue. We found that unproper handling with global variables was the cause. So use 'use strinct' in mimedefang-filter and be careful with global variables. Defined them in the class qw(). Then the errors may stop. Martin ___ Visit http://www.mimedefang.org and http://www.canit.ca MIMEDefang mailing list [EMAIL PROTECTED] http://lists.roaringpenguin.com/mailman/listinfo/mimedefang
Re: [Mimedefang] MIMEDefang embedded perl stability issues
I would check your crontab to see what is running at 5AM. This sounds more like the box running out or ram or something. A couple weeks ago I opted to use the MIMEDefang embedded perl interpreter (by turning on MX_EMBED_PERL=yes in the MD init script), however, I have noticed some stability problems when using the embedded interpreter. Every morning at 5am the MD multiplexor essentially craps out, requiring MIMEDefang, clamd, and sendmail to be restarted. I didn't see much in the log files indicating what was causing the multiplexor to die off, but I do know that the daily CRON jobs run at around 4-5am every night. Any insight would be appreciated. ___ Visit http://www.mimedefang.org and http://www.canit.ca MIMEDefang mailing list [EMAIL PROTECTED] http://lists.roaringpenguin.com/mailman/listinfo/mimedefang
Re: [Mimedefang] MIMEDefang embedded perl stability issues
I would check your crontab to see what is running at 5AM. This sounds more like the box running out or ram or something. Are you doing a mimedefang reload at this time ? Martin ___ Visit http://www.mimedefang.org and http://www.canit.ca MIMEDefang mailing list [EMAIL PROTECTED] http://lists.roaringpenguin.com/mailman/listinfo/mimedefang
RE: [Mimedefang] MIMEDefang embedded perl stability issues
The only item of doubt is a rulesdujour script that runs in cron.daily -- this updates a number of my spamassassin rules. I placed a /etc/init.d/mimedefang reread command in that script so that the multiplexor reread the configuration after a rules update, I suppose that is the source of the problems (afterall, the server does deal with a large volume of email, and is quite underpowered). I removed the reread command in the script and have re-enabled the embedded interpreter. - Chris -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Kevin A. McGrail Sent: Friday, June 25, 2004 10:24 AM To: [EMAIL PROTECTED] Subject: Re: [Mimedefang] MIMEDefang embedded perl stability issues I would check your crontab to see what is running at 5AM. This sounds more like the box running out or ram or something. A couple weeks ago I opted to use the MIMEDefang embedded perl interpreter (by turning on MX_EMBED_PERL=yes in the MD init script), however, I have noticed some stability problems when using the embedded interpreter. Every morning at 5am the MD multiplexor essentially craps out, requiring MIMEDefang, clamd, and sendmail to be restarted. I didn't see much in the log files indicating what was causing the multiplexor to die off, but I do know that the daily CRON jobs run at around 4-5am every night. Any insight would be appreciated. ___ Visit http://www.mimedefang.org and http://www.canit.ca MIMEDefang mailing list [EMAIL PROTECTED] http://lists.roaringpenguin.com/mailman/listinfo/mimedefang ___ Visit http://www.mimedefang.org and http://www.canit.ca MIMEDefang mailing list [EMAIL PROTECTED] http://lists.roaringpenguin.com/mailman/listinfo/mimedefang
RE: [Mimedefang] MIMEDefang embedded perl stability issues
Yep -- just realized that -- see my previous email about doing a mimedefang reread in a cron.daily script. Hopefully removing that reread command will fix the issue! -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Martin Blapp Sent: Friday, June 25, 2004 10:34 AM To: [EMAIL PROTECTED] Subject: Re: [Mimedefang] MIMEDefang embedded perl stability issues I would check your crontab to see what is running at 5AM. This sounds more like the box running out or ram or something. Are you doing a mimedefang reload at this time ? Martin ___ Visit http://www.mimedefang.org and http://www.canit.ca MIMEDefang mailing list [EMAIL PROTECTED] http://lists.roaringpenguin.com/mailman/listinfo/mimedefang ___ Visit http://www.mimedefang.org and http://www.canit.ca MIMEDefang mailing list [EMAIL PROTECTED] http://lists.roaringpenguin.com/mailman/listinfo/mimedefang
Re: [Mimedefang] MIMEDefang embedded perl stability issues
Yeah, you might want to tail -f your maillog and then do a reread and see if your mimedefang is even capable of a reread on your platform with embedded perl. It is not on mine. Regards, KAM The only item of doubt is a rulesdujour script that runs in cron.daily -- this updates a number of my spamassassin rules. I placed a /etc/init.d/mimedefang reread command in that script so that the multiplexor reread the configuration after a rules update, I suppose that is the source of the problems (afterall, the server does deal with a large volume of email, and is quite underpowered). I removed the reread command in the script and have re-enabled the embedded interpreter. ___ Visit http://www.mimedefang.org and http://www.canit.ca MIMEDefang mailing list [EMAIL PROTECTED] http://lists.roaringpenguin.com/mailman/listinfo/mimedefang
RE: [Mimedefang] MIMEDefang embedded perl stability issues
Yep -- just realized that -- see my previous email about doing a mimedefang reread in a cron.daily script. Hopefully removing that reread command will fix the issue! Hi, We had exactly the same issue. Add: use strict; to your mimedefang filter and the problem will stop after you have fixed all the error messages. Martin ___ Visit http://www.mimedefang.org and http://www.canit.ca MIMEDefang mailing list [EMAIL PROTECTED] http://lists.roaringpenguin.com/mailman/listinfo/mimedefang
RE: [Mimedefang] MIMEDefang embedded perl stability issues
On Fri, 25 Jun 2004, Chris Gauch wrote: Yep -- just realized that -- see my previous email about doing a mimedefang reread in a cron.daily script. Hopefully removing that reread command will fix the issue! Could you see if 2.44-BETA-1 fixes it? I applied a patch from Martin Blapp: http://lists.roaringpenguin.com/pipermail/mimedefang/2004-June/022707.html -- David. ___ Visit http://www.mimedefang.org and http://www.canit.ca MIMEDefang mailing list [EMAIL PROTECTED] http://lists.roaringpenguin.com/mailman/listinfo/mimedefang
RE: [Mimedefang] MIMEDefang embedded perl stability issues
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Add: use strict; to your mimedefang filter and the problem will stop after you have fixed all the error messages. This is not true in all cases. This is the same problem I'm having. I can't do a reread. I've been using use strict in my filter as long as I remember. David, I still haven't gotten around to running the gdb commands you suggested in the other thread a few days back. I hope to get to that soon if I have time. Richard Laager -BEGIN PGP SIGNATURE- Version: PGP 8.0.2 Comment: If you don't know what this is, you can safely ignore it. iQA/AwUBQNyAn231OrleHxvOEQKfRACgj5TPGIzWaCxGWxh70+zjfwChHwIAmwWe UtEhskBtvRFI+dFgAnnrDUM3 =Q1lK -END PGP SIGNATURE- ___ Visit http://www.mimedefang.org and http://www.canit.ca MIMEDefang mailing list [EMAIL PROTECTED] http://lists.roaringpenguin.com/mailman/listinfo/mimedefang
RE: [Mimedefang] MIMEDefang embedded perl stability issues
Hi, This is not true in all cases. This is the same problem I'm having. I can't do a reread. I've been using use strict in my filter as long as I remember. Have run run mimedefang.pl -f mimedefang-filter /tmp as test ? Are there still any warnings ? Martin ___ Visit http://www.mimedefang.org and http://www.canit.ca MIMEDefang mailing list [EMAIL PROTECTED] http://lists.roaringpenguin.com/mailman/listinfo/mimedefang
