>On Thu, 5 Dec 2019 17:07:05 +0100
>Matus UHLAR - fantomas wrote:
>>seems some big mails were too long to scan, and SA even got killed.
>>
>>[2146809.213586] Out of memory: Kill process 3660 (spamassassin)
>>score 365 or sacrifice child [2146809.213613] Killed process 3660
>>(spamassassin) total-vm:2960664kB, anon-rss:2921892kB, file-rss:0kB,
>>shmem-rss:0kB [2146809.270342] oom_reaper: reaped process 3660
>>(spamassassin), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB
>>
>>I see the mail body contains nearly 20MB uuencoded text (don't ask).

On 05.12.19 17:21, RW wrote:
>In rawbody rules the text is broken into chunks of 1024 to 2048 bytes,
>so the worst case isn't all that much worst than with {0,1000}.
>
>Also  /m means that .* wont cross a line boundary in the decoded text
>and  ^ can match in the middle of the chunk. This make the average
>processing  time less sensitive to any upper limit on .*.

On Fri, Dec 06, 2019 at 10:23:15AM +0100, Matus UHLAR - fantomas wrote:
so it is not the quantifiers who cause SA taking too much of memory?

any idea how to debug that?

On 06.12.19 13:16, Henrik K wrote:
Scanning a generic 20MB will normally eat ~700MB memory.  3GB implies
something is bugging.  Feel free to send a sample if you can.

I'm afraid I can't provide clients' file.

I can only repeat:
- the mail is 20424329 bytes
- the mail contains single uuencoded .rar file inline.

-rw-rw-rw- 1 root root 14818832 Dec  9 10:50 'redacted.rar'

I have tried to run it again, it took about 20minutes to scan and memory
usage slowly increased up to:

 PID USER      PR  NI    VIRT    RES    SHR S  %CPU  %MEM     TIME+ COMMAND
1924 amavis    20   0 3916332   2.8g   1468 D   1.0  72.2   3:08.08 spamassassin

note the "amavis" is the spamassassin command line client running under
amavis user to use amavis' bayes database:

amavis    1924 24.8 72.9 3916332 2923964 ?     D    10:23   3:08 /usr/bin/perl 
-T -w /usr/bin/spamassassin -x

-rw------- 1 amavis amavis 10584064 Dec  9 10:45 bayes_seen
-rw------- 1 amavis amavis 10760192 Dec  9 10:45 bayes_toks

I have tried to attach the proces using strace, after a while it produced
output (only 2 rules hit), and exited.  I hope this didn't cause premature
exit of the SA client.

--
Matus UHLAR - fantomas, uh...@fantomas.sk ; http://www.fantomas.sk/
Warning: I wish NOT to receive e-mail advertising to this address.
Varovanie: na tuto adresu chcem NEDOSTAVAT akukolvek reklamnu postu.
How does cat play with mouse? cat /dev/mouse

Reply via email to