Re: perl hogging my memory?
hey, feel free to edit around that FAQ too, Matt ;) Right now I think that question really *is* the most FA'd Q. --j. Matt Kettler writes: Woot!! Thank you Justin and the rest of the Wiki crew for putting that up! I was getting tired of writing the Are you using sa-blacklist.cf? email over, and over again. Justin Mason wrote: have you looked at http://wiki.apache.org/spamassassin/OutOfMemoryProblems ? note especially the 'Heavyweight custom rules' section. --j. Evan Platt writes: Ok, I've googled and obviously I'm not finding the right solution.. But had to reinstall spamassassin on my os/x 10.4 box. Followed http://developer.apple.com/server/fighting_spam.html . But, my system is running out of memory, and it looks like Perl / spamassassin is the cause . I've omitted everything but the Perl and Spamassassin related entries: Load Avg: 1.97, 1.36, 0.78 CPU usage: 84.4% user, 15.6% sys, 0.0% idle SharedLibs: num = 106, resident = 3.54M code, 364K data, 780K LinkEdit MemRegions: num = 4984, resident = 217M + 1.37M private, 236M shared PhysMem: 44.7M wired, 307M active, 153M inactive, 506M used, 5.54M free VM: 4.00G + 79.0M 50554(137) pageins, 65232(79) pageouts PID COMMAND %CPU TIME #TH #PRTS #MREGS RPRVT RSHRD RSIZE VSIZE 448 spamc0.0% 0:00.00 11518 128K 268K- 396K 27.7M 447 procmail 0.0% 0:00.00 1 816 8K- 364K- 176K 26.7M 445 procmail 0.0% 0:00.02 11516 8K- 364K- 412K 26.7M 416 perl35.1% 0:10.60 110 391 30.4M 233M- 94.2M 391M 394 spamc0.0% 0:00.00 1151888K 268K- 356K 27.7M 393 procmail 0.0% 0:00.00 1 816 8K 316K- 172K 26.7M 391 procmail 0.0% 0:00.02 11516 8K 316K- 364K 26.7M 378 perl10.1% 0:48.50 110 388 150M+ 207M- 217M+ 391M 377 perl44.7% 1:18.63 110 388 26.3M 233M- 72.8M 391M 271 perl 0.0% 0:00.12 11043 1.93M 284K 1.07M 29.1M 65 perl 0.0% 3:41.24 115 387 1.43M- 233M- 56.9M- 391M So what did I do wrong that's causing a Perl process to take up 391 megs? Obviously, I'm only guessing it's spamassassin related, but that's the only thing I can think of using perl. And I see a few google reference to spamassassin and perl. Any other information I can provide, please let me know. Thanks. Evan
Re: perl hogging my memory?
I definitely have to say that between OutOfMemoryProblems and TrustPath we've probably covered about 20% of the problems on the list :) Justin Mason wrote: hey, feel free to edit around that FAQ too, Matt ;) Right now I think that question really *is* the most FA'd Q. --j.
R: perl hogging my memory?
I dream of a amavis+spamassassin system developed in C++ language and with separate rule compiler and matching daemon... Also, this thing of running a perl regex matching for each (enabled) rule is a bit brain damaged... Why not invert the flow and build something like flex + bison, ie: a grammar parser: you feed it with your text, and it replies with the hitten rules. Well, just an idea. PS: brain damage is just an eufemism: it actually works! giampaolo I definitely have to say that between OutOfMemoryProblems and TrustPath we've probably covered about 20% of the problems on the list :) Justin Mason wrote: hey, feel free to edit around that FAQ too, Matt ;) Right now I think that question really *is* the most FA'd Q. --j.
perl hogging my memory?
Ok, I've googled and obviously I'm not finding the right solution.. But had to reinstall spamassassin on my os/x 10.4 box. Followed http://developer.apple.com/server/fighting_spam.html . But, my system is running out of memory, and it looks like Perl / spamassassin is the cause . I've omitted everything but the Perl and Spamassassin related entries: Load Avg: 1.97, 1.36, 0.78 CPU usage: 84.4% user, 15.6% sys, 0.0% idle SharedLibs: num = 106, resident = 3.54M code, 364K data, 780K LinkEdit MemRegions: num = 4984, resident = 217M + 1.37M private, 236M shared PhysMem: 44.7M wired, 307M active, 153M inactive, 506M used, 5.54M free VM: 4.00G + 79.0M 50554(137) pageins, 65232(79) pageouts PID COMMAND %CPU TIME #TH #PRTS #MREGS RPRVT RSHRD RSIZE VSIZE 448 spamc0.0% 0:00.00 11518 128K 268K- 396K 27.7M 447 procmail 0.0% 0:00.00 1 816 8K- 364K- 176K 26.7M 445 procmail 0.0% 0:00.02 11516 8K- 364K- 412K 26.7M 416 perl35.1% 0:10.60 110 391 30.4M 233M- 94.2M 391M 394 spamc0.0% 0:00.00 1151888K 268K- 356K 27.7M 393 procmail 0.0% 0:00.00 1 816 8K 316K- 172K 26.7M 391 procmail 0.0% 0:00.02 11516 8K 316K- 364K 26.7M 378 perl10.1% 0:48.50 110 388 150M+ 207M- 217M+ 391M 377 perl44.7% 1:18.63 110 388 26.3M 233M- 72.8M 391M 271 perl 0.0% 0:00.12 11043 1.93M 284K 1.07M 29.1M 65 perl 0.0% 3:41.24 115 387 1.43M- 233M- 56.9M- 391M So what did I do wrong that's causing a Perl process to take up 391 megs? Obviously, I'm only guessing it's spamassassin related, but that's the only thing I can think of using perl. And I see a few google reference to spamassassin and perl. Any other information I can provide, please let me know. Thanks. Evan
Re: perl hogging my memory?
At 11:56 AM 10/3/2006, you wrote: have you looked at http://wiki.apache.org/spamassassin/OutOfMemoryProblems ? note especially the 'Heavyweight custom rules' section. Thanks much.. That was more or less it total 23996 56 70_sare_adult.cf48 70_sare_genlsubj3.cf 8 70_sare_header_x264_x30.cf 4 70_sare_html_eng.cf 96 70_sare_specific.cf12 70_sc_top200.cf 4708 blacklist-uri.cf 4 70_sare_bayes_poison_nxm.cf 32 70_sare_genlsubj_eng.cf 8 70_sare_header_x30.cf 4 70_sare_html_x30.cf 20 70_sare_spoof.cf 16 71_sare_bml_pre25x.cf 16652 blacklist.cf 24 70_sare_evilnum0.cf 8 70_sare_genlsubj_x30.cf 8 70_sare_highrisk.cf 156 70_sare_obfu.cf 28 70_sare_unsub.cf 20 71_sare_redirect_pre3.0.0.cf 108 bogus-virus-warnings.cf 4 70_sare_evilnum1.cf376 70_sare_header.cf 108 70_sare_html.cf52 70_sare_obfu0.cf20 70_sare_uri0.cf16 72_sare_bml_post25x.cf 4 init.pre 8 70_sare_evilnum2.cf124 70_sare_header0.cf 28 70_sare_html0.cf 108 70_sare_obfu1.cf24 70_sare_uri1.cf16 72_sare_redirect_post3.0.0.cf 4 local.cf 184 70_sare_genlsubj.cf144 70_sare_header1.cf 40 70_sare_html1.cf8 70_sare_obfu2.cf12 70_sare_uri3.cf12 99_sare_fraud_post25x.cf 8 random.cf 48 70_sare_genlsubj0.cf 108 70_sare_header2.cf 24 70_sare_html2.cf 16 70_sare_obfu3.cf 8 70_sare_uri_eng.cf 12 99_sare_fraud_pre25x.cf 56 tripwire.cf 76 70_sare_genlsubj1.cf88 70_sare_header3.cf 20 70_sare_html3.cf 16 70_sare_oem.cf 52 70_sare_whitelist.cf0 RulesDuJour/ 4 v310.pre 20 70_sare_genlsubj2.cf 8 70_sare_header_eng.cf 40 70_sare_html4.cf 20 70_sare_random.cf 40 70_sare_whitelist_pre30.cf 16 antidrug.cf4 v312.pre Removed blacklist-uri.cf and blacklist.cf Thanks. :) Evan
Re: perl hogging my memory?
Woot!! Thank you Justin and the rest of the Wiki crew for putting that up! I was getting tired of writing the Are you using sa-blacklist.cf? email over, and over again. Justin Mason wrote: have you looked at http://wiki.apache.org/spamassassin/OutOfMemoryProblems ? note especially the 'Heavyweight custom rules' section. --j. Evan Platt writes: Ok, I've googled and obviously I'm not finding the right solution.. But had to reinstall spamassassin on my os/x 10.4 box. Followed http://developer.apple.com/server/fighting_spam.html . But, my system is running out of memory, and it looks like Perl / spamassassin is the cause . I've omitted everything but the Perl and Spamassassin related entries: Load Avg: 1.97, 1.36, 0.78 CPU usage: 84.4% user, 15.6% sys, 0.0% idle SharedLibs: num = 106, resident = 3.54M code, 364K data, 780K LinkEdit MemRegions: num = 4984, resident = 217M + 1.37M private, 236M shared PhysMem: 44.7M wired, 307M active, 153M inactive, 506M used, 5.54M free VM: 4.00G + 79.0M 50554(137) pageins, 65232(79) pageouts PID COMMAND %CPU TIME #TH #PRTS #MREGS RPRVT RSHRD RSIZE VSIZE 448 spamc0.0% 0:00.00 11518 128K 268K- 396K 27.7M 447 procmail 0.0% 0:00.00 1 816 8K- 364K- 176K 26.7M 445 procmail 0.0% 0:00.02 11516 8K- 364K- 412K 26.7M 416 perl35.1% 0:10.60 110 391 30.4M 233M- 94.2M 391M 394 spamc0.0% 0:00.00 1151888K 268K- 356K 27.7M 393 procmail 0.0% 0:00.00 1 816 8K 316K- 172K 26.7M 391 procmail 0.0% 0:00.02 11516 8K 316K- 364K 26.7M 378 perl10.1% 0:48.50 110 388 150M+ 207M- 217M+ 391M 377 perl44.7% 1:18.63 110 388 26.3M 233M- 72.8M 391M 271 perl 0.0% 0:00.12 11043 1.93M 284K 1.07M 29.1M 65 perl 0.0% 3:41.24 115 387 1.43M- 233M- 56.9M- 391M So what did I do wrong that's causing a Perl process to take up 391 megs? Obviously, I'm only guessing it's spamassassin related, but that's the only thing I can think of using perl. And I see a few google reference to spamassassin and perl. Any other information I can provide, please let me know. Thanks. Evan
