Re: [sr-dev] High memory consumption during load tests

2020-04-09 Thread Andrey Deykunov 
Thank you Henning.  I theorized it and you proved my point.
We're using 5.3.1.

Andrey

чт, 9 апр. 2020 г. в 09:59, Henning Westerholt :

> Hello,
>
>
>
> Please also give the Kamailio version that you are using, just to sort out
> eventual already fixed memory leaks.
>
>
>
> About the question regarding the 2GB memory mapping – according to your
> configuration this should be shared memory (not assuming a memory leak in
> system memory because of a library etc..). So, it should be not 2GB per
> process, but 2GB in total.
>
>
>
> And the memory is also not completely used, only 855MB of it:
>
>
>
> shmem:real_used_size = 855.574.648
>
>
>
> Maximum private per process memory is according to your cfg 12 MB.
>
>
>
> Cheers,
>
>
>
> Henning
>
>
>
> --
>
> Henning Westerholt – https://skalatan.de/blog/
>
> Kamailio services – https://gilawa.com
>
>
>
>
>
> *From:* sr-dev  *On Behalf Of *Andrey
> Deykunov
> *Sent:* Wednesday, April 8, 2020 12:19 PM
> *To:* Kamailio (SER) - Development Mailing List  >
> *Subject:* [sr-dev] High memory consumption during load tests
>
>
>
> Hi,
>
>
>
> I've noticed more than 14 Gb RSS memory consumption during load test (8000
> WSS clients send registrations):
>
>
>
>
>
> […]
>
>
>
>
>
> # ps aux | grep kamailio
>
> hpbx 15948  0.0  0.1 2232328 22920 ?   S01:40   0:00
> /var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P
> /var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
> hpbx 15949  1.8  3.8 2232460 789212 ?  S01:40   1:23
> /var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P
> /var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
> hpbx 15950  1.8  3.8 2232460 790164 ?  S01:40   1:22
> /var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P
> /var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
> hpbx 15951  1.7  3.8 2232460 790656 ?  S01:40   1:22
> /var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P
> /var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
> hpbx 15952  1.8  3.8 2232460 790180 ?  S01:40   1:22
> /var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P
> /var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
> hpbx 15953  1.7  3.8 2232460 788192 ?  S01:40   1:22
> /var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P
> /var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
> hpbx 15954  1.8  3.8 2232460 789484 ?  S01:40   1:22
> /var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P
> /var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
> hpbx 15955  1.7  3.8 2232460 789640 ?  S01:40   1:22
> /var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P
> /var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
> hpbx 15959  1.8  3.8 2232460 788104 ?  S01:40   1:22
> /var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P
> /var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
> hpbx 15960  0.0  0.0 2232328 8272 ?S01:40   0:00
> /var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P
> /var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
> hpbx 15961  0.0  0.0 2232328 8272 ?S01:40   0:00
> /var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P
> /var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
> hpbx 15963  0.0  0.0 2232328 8272 ?S01:40   0:00
> /var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P
> /var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
> hpbx 15964  0.0  0.0 2232328 8272 ?S01:40   0:00
> /var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P
> /var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
> hpbx 15966  0.0  0.0 2232328 8272 ?S01:40   0:00
> /var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P
> /var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
> hpbx 15968  0.0  0.0 2232328 8272 ?S01:40   0:00
> /var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P
> /var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
> hpbx 15969  0.0  0.0 2232328 8272 ?S01:40   0:00
> /var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P
> /var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
> hpbx 15971  0.0  0.0 2232328 8272 ?S01:40   0:00
> /var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P
> /var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
> hpbx 15972  0.0  0.0 2232328 8152 ?S01:40   0:00
> /var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P
> /var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
> hpbx 15973  0.0  0.0 2232328 8152 ?S01:40   0:02
> /var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P
> /var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
> hpbx 15975  0.0  0.0 2232328 8156 ?S01:40   0:00
> /var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P
> /var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
> hpbx 15977

Re: [sr-dev] High memory consumption during load tests

2020-04-09 Thread Henning Westerholt 
Hello,

Please also give the Kamailio version that you are using, just to sort out 
eventual already fixed memory leaks.

About the question regarding the 2GB memory mapping – according to your 
configuration this should be shared memory (not assuming a memory leak in 
system memory because of a library etc..). So, it should be not 2GB per 
process, but 2GB in total.

And the memory is also not completely used, only 855MB of it:

shmem:real_used_size = 855.574.648

Maximum private per process memory is according to your cfg 12 MB.

Cheers,

Henning

--
Henning Westerholt – https://skalatan.de/blog/
Kamailio services – https://gilawa.com


From: sr-dev  On Behalf Of Andrey Deykunov
Sent: Wednesday, April 8, 2020 12:19 PM
To: Kamailio (SER) - Development Mailing List 
Subject: [sr-dev] High memory consumption during load tests

Hi,

I've noticed more than 14 Gb RSS memory consumption during load test (8000 WSS 
clients send registrations):


[…]


# ps aux | grep kamailio
hpbx 15948  0.0  0.1 2232328 22920 ?   S01:40   0:00 
/var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P 
/var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
hpbx 15949  1.8  3.8 2232460 789212 ?  S01:40   1:23 
/var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P 
/var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
hpbx 15950  1.8  3.8 2232460 790164 ?  S01:40   1:22 
/var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P 
/var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
hpbx 15951  1.7  3.8 2232460 790656 ?  S01:40   1:22 
/var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P 
/var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
hpbx 15952  1.8  3.8 2232460 790180 ?  S01:40   1:22 
/var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P 
/var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
hpbx 15953  1.7  3.8 2232460 788192 ?  S01:40   1:22 
/var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P 
/var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
hpbx 15954  1.8  3.8 2232460 789484 ?  S01:40   1:22 
/var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P 
/var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
hpbx 15955  1.7  3.8 2232460 789640 ?  S01:40   1:22 
/var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P 
/var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
hpbx 15959  1.8  3.8 2232460 788104 ?  S01:40   1:22 
/var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P 
/var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
hpbx 15960  0.0  0.0 2232328 8272 ?S01:40   0:00 
/var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P 
/var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
hpbx 15961  0.0  0.0 2232328 8272 ?S01:40   0:00 
/var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P 
/var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
hpbx 15963  0.0  0.0 2232328 8272 ?S01:40   0:00 
/var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P 
/var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
hpbx 15964  0.0  0.0 2232328 8272 ?S01:40   0:00 
/var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P 
/var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
hpbx 15966  0.0  0.0 2232328 8272 ?S01:40   0:00 
/var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P 
/var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
hpbx 15968  0.0  0.0 2232328 8272 ?S01:40   0:00 
/var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P 
/var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
hpbx 15969  0.0  0.0 2232328 8272 ?S01:40   0:00 
/var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P 
/var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
hpbx 15971  0.0  0.0 2232328 8272 ?S01:40   0:00 
/var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P 
/var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
hpbx 15972  0.0  0.0 2232328 8152 ?S01:40   0:00 
/var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P 
/var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
hpbx 15973  0.0  0.0 2232328 8152 ?S01:40   0:02 
/var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P 
/var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
hpbx 15975  0.0  0.0 2232328 8156 ?S01:40   0:00 
/var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P 
/var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
hpbx 15977  4.8  4.0 2232428 835908 ?  S01:40   3:43 
/var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P 
/var/run/kamailio/kamailio.pid -f /var/lib/ums/etc/sipp/sipp.cfg
hpbx 15979  0.0  2.5 2232452 517192 ?  S01:40   0:00 
/var/lib/ums/sbin/kamailio -m 2048 -M 12 -x qm -P 
/var/run/kamailio/kamailio.pid -f