Re: large unicode email nails CPU
Jason Haar wrote: On 08/04/2009 02:03 PM, Michael Scheidell wrote: Here's an example: http://pastebin.com/m75f39d72 pretty cool. does a similar thing here on a 64bit amd core running freebsd., perl 5.8.9, (but it only took 52 seconds) but thats about 45 seconds more then it should. we are averaging 3 to 7 seconds per email to parse them. you running compiled rules? Nope. I run the compile nightly, my sa-update does something like this: nice sa-update /dev/null sa-compile /dev/null (which is why I get the 'resize not found' error), spamd restart. in my spamassassin -D it verified it was using compiled rules. this might be a good benchmark test for speed. (however, yes, this unicode email did take 10x longer that it should to parse.) _ This email has been scanned and certified safe by SpammerTrap(r). For Information please see http://www.secnap.com/products/spammertrap/ _
Re: large unicode email nails CPU
--On Tuesday, August 04, 2009 2:17 PM +1200 Jason Haar jason.h...@trimble.co.nz wrote: strace shows spamd running around looking for unicore/lib/gc_sc files - which is related to unicode stuff. I don't know if that's the problem - but that's all I could find. This looks like a good candidate to open a Bugzilla for.
Re: large unicode email nails CPU
On 08/05/2009 06:46 AM, Kenneth Porter wrote: This looks like a good candidate to open a Bugzilla for. Done. Anyone else with any new details should add to the ticket https://issues.apache.org/SpamAssassin/show_bug.cgi?id=6170 -- Cheers Jason Haar Information Security Manager, Trimble Navigation Ltd. Phone: +64 3 9635 377 Fax: +64 3 9635 417 PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1
Re: large unicode email nails CPU
Jason Haar wrote: Hi there We're got a few people subscribed to Serbian mailing-lists, and one in particular is having difficulty getting email to us - spamc/spamd times out and is never able to process the message. While it is running, spamd takes 100% of the CPU for 1.5+minutes. Here's an example: http://pastebin.com/m75f39d72 pretty cool. does a similar thing here on a 64bit amd core running freebsd., perl 5.8.9, (but it only took 52 seconds) but thats about 45 seconds more then it should. we are averaging 3 to 7 seconds per email to parse them. you running compiled rules? -- Michael Scheidell, CTO Phone: 561-999-5000, x 1259 *| *SECNAP Network Security Corporation * Certified SNORT Integrator * 2008-9 Hot Company Award Winner, World Executive Alliance * Five-Star Partner Program 2009, VARBusiness * Best Anti-Spam Product 2008, Network Products Guide * King of Spam Filters, SC Magazine 2008 _ This email has been scanned and certified safe by SpammerTrap(r). For Information please see http://www.secnap.com/products/spammertrap/ _
Re: large unicode email nails CPU
On 08/04/2009 02:03 PM, Michael Scheidell wrote: Here's an example: http://pastebin.com/m75f39d72 pretty cool. does a similar thing here on a 64bit amd core running freebsd., perl 5.8.9, (but it only took 52 seconds) but thats about 45 seconds more then it should. we are averaging 3 to 7 seconds per email to parse them. you running compiled rules? Nope. -- Cheers Jason Haar Information Security Manager, Trimble Navigation Ltd. Phone: +64 3 9635 377 Fax: +64 3 9635 417 PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1
