Re: [SR-Users] out of memory Error
Hello, ok, so the issue was in acc_radius module. Can you make a pull request with this patch via github project: - https://github.com/kamailio/kamailio/pulls Cheers, Daniel On 30/09/15 15:59, ycaner wrote: > Hello Daniel ; > > After changes some codes , it is solved. Here is diff for checking. > > diff --git a/modules/acc_radius/acc_radius_mod.c > b/modules/acc_radius/acc_radius_mod.c > index b1843d6..2bc0acc 100644 > --- a/modules/acc_radius/acc_radius_mod.c > +++ b/modules/acc_radius/acc_radius_mod.c > @@ -49,6 +49,7 @@ > #include "../../lib/kcore/radius.h" > #include "../../modules/acc/acc_api.h" > #include "acc_radius_mod.h" > +#include "../../modules/acc/acc_extra.h" > > MODULE_VERSION > > @@ -329,6 +330,8 @@ int acc_radius_send_request(struct sip_msg *req, > acc_info_t *inf) > uint32_t av_type; > int offset; > int i; > +int m=0; > +int o=0; > > send=NULL; > > @@ -353,8 +356,11 @@ int acc_radius_send_request(struct sip_msg *req, > acc_info_t *inf) > ADD_RAD_AVPAIR( RA_TIME_STAMP, &av_type, -1); > > /* add extra also */ > - attr_cnt += accb.get_extra_attrs(rad_extra, req, inf->varr+attr_cnt, > - inf->iarr+attr_cnt, inf->tarr+attr_cnt); > + o = accb.get_extra_attrs(rad_extra, req, inf->varr+attr_cnt, > +inf->iarr+attr_cnt, inf->tarr+attr_cnt); > + > +attr_cnt += o; > +m = attr_cnt; > > /* add the values for the vector - start from 1 instead of > * 0 to skip the first value which is the METHOD as string */ > @@ -388,10 +394,14 @@ int acc_radius_send_request(struct sip_msg *req, > acc_info_t *inf) > goto error; > } > rc_avpair_free(send); > + /*dont forget free memory allocated by extra2strar */ > +free_strar_mem( &(inf->tarr[m-o]), &(inf->varr[m-o]), o, m); > return 1; > > error: > rc_avpair_free(send); > +/* free memory allocated by extra2strar */ > +free_strar_mem( &(inf->tarr[m-o]), &(inf->varr[m-o]), o, m); > return -1; > } > > > > > > > -- > View this message in context: > http://sip-router.1086192.n5.nabble.com/out-of-memory-Error-tp141866p141948.html > Sent from the Users mailing list archive at Nabble.com. > > ___ > SIP Express Router (SER) and Kamailio (OpenSER) - sr-users mailing list > sr-users@lists.sip-router.org > http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users -- Daniel-Constantin Mierla http://twitter.com/#!/miconda - http://www.linkedin.com/in/miconda Book: SIP Routing With Kamailio - http://www.asipto.com Kamailio Advanced Training, Sep 28-30, 2015, in Berlin - http://asipto.com/u/kat ___ SIP Express Router (SER) and Kamailio (OpenSER) - sr-users mailing list sr-users@lists.sip-router.org http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users
Re: [SR-Users] out of memory Error
Hello Daniel ; After changes some codes , it is solved. Here is diff for checking. diff --git a/modules/acc_radius/acc_radius_mod.c b/modules/acc_radius/acc_radius_mod.c index b1843d6..2bc0acc 100644 --- a/modules/acc_radius/acc_radius_mod.c +++ b/modules/acc_radius/acc_radius_mod.c @@ -49,6 +49,7 @@ #include "../../lib/kcore/radius.h" #include "../../modules/acc/acc_api.h" #include "acc_radius_mod.h" +#include "../../modules/acc/acc_extra.h" MODULE_VERSION @@ -329,6 +330,8 @@ int acc_radius_send_request(struct sip_msg *req, acc_info_t *inf) uint32_t av_type; int offset; int i; +int m=0; +int o=0; send=NULL; @@ -353,8 +356,11 @@ int acc_radius_send_request(struct sip_msg *req, acc_info_t *inf) ADD_RAD_AVPAIR( RA_TIME_STAMP, &av_type, -1); /* add extra also */ - attr_cnt += accb.get_extra_attrs(rad_extra, req, inf->varr+attr_cnt, - inf->iarr+attr_cnt, inf->tarr+attr_cnt); + o = accb.get_extra_attrs(rad_extra, req, inf->varr+attr_cnt, +inf->iarr+attr_cnt, inf->tarr+attr_cnt); + +attr_cnt += o; +m = attr_cnt; /* add the values for the vector - start from 1 instead of * 0 to skip the first value which is the METHOD as string */ @@ -388,10 +394,14 @@ int acc_radius_send_request(struct sip_msg *req, acc_info_t *inf) goto error; } rc_avpair_free(send); + /*dont forget free memory allocated by extra2strar */ +free_strar_mem( &(inf->tarr[m-o]), &(inf->varr[m-o]), o, m); return 1; error: rc_avpair_free(send); +/* free memory allocated by extra2strar */ +free_strar_mem( &(inf->tarr[m-o]), &(inf->varr[m-o]), o, m); return -1; } -- View this message in context: http://sip-router.1086192.n5.nabble.com/out-of-memory-Error-tp141866p141948.html Sent from the Users mailing list archive at Nabble.com. ___ SIP Express Router (SER) and Kamailio (OpenSER) - sr-users mailing list sr-users@lists.sip-router.org http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users
Re: [SR-Users] out of memory Error
Hello Daniel; I think i found the mem leak. after debuggin memory in acc_radius_send_request at /root/kamailio-4.3.2/modules/acc_radius/acc_radius_mod.c , after allocing with get_extra_attrs as using extra2strar , don't free in acc_radius_send_request. i will do some test and write results. 2(18158) DEBUG: acc [acc_logic.c:644]: tmcb_func(): acc callback called for t(0x7ff29cc3c9a8) event type 512, reply code 200 2(18158) DEBUG: [mem/f_malloc.c:431]: fm_malloc(): fm_malloc(0x7ff2b2550010, 10) called from acc: acc_extra.c: extra2strar(265) 2(18158) DEBUG: [mem/f_malloc.c:506]: fm_malloc(): fm_malloc(0x7ff2b2550010, 16) returns address 0x7ff2b2699620 2(18158) DEBUG: [mem/f_malloc.c:431]: fm_malloc(): fm_malloc(0x7ff2b2550010, 12) called from acc: acc_extra.c: extra2strar(265) 2(18158) DEBUG: [mem/f_malloc.c:506]: fm_malloc(): fm_malloc(0x7ff2b2550010, 16) returns address 0x7ff2b25de960 2(18158) DEBUG: [mem/f_malloc.c:431]: fm_malloc(): fm_malloc(0x7ff2b2550010, 12) called from acc: acc_extra.c: extra2strar(265) 2(18158) DEBUG: [mem/f_malloc.c:506]: fm_malloc(): fm_malloc(0x7ff2b2550010, 16) returns address 0x7ff2b25fd618 2(18158) DEBUG: [mem/f_malloc.c:431]: fm_malloc(): fm_malloc(0x7ff2b2550010, 15) called from acc: acc_extra.c: extra2strar(265) 2(18158) DEBUG: [mem/f_malloc.c:506]: fm_malloc(): fm_malloc(0x7ff2b2550010, 16) returns address 0x7ff2b25fdb08 2(18158) DEBUG: [mem/f_malloc.c:431]: fm_malloc(): fm_malloc(0x7ff2b2550010, 12) called from acc: acc_extra.c: extra2strar(265) 2(18158) DEBUG: [mem/f_malloc.c:506]: fm_malloc(): fm_malloc(0x7ff2b2550010, 16) returns address 0x7ff2b25fd880 2(18158) DEBUG: [mem/f_malloc.c:431]: fm_malloc(): fm_malloc(0x7ff2b2550010, 1) called from acc: acc_extra.c: extra2strar(265) 2(18158) DEBUG: [mem/f_malloc.c:506]: fm_malloc(): fm_malloc(0x7ff2b2550010, 8) returns address 0x7ff2b2638078 2(18158) DEBUG: [mem/f_malloc.c:431]: fm_malloc(): fm_malloc(0x7ff2b2550010, 19) called from acc: acc_extra.c: extra2strar(265) 2(18158) DEBUG: [mem/f_malloc.c:506]: fm_malloc(): fm_malloc(0x7ff2b2550010, 24) returns address 0x7ff2b25fd6d8 2(18158) DEBUG: [mem/f_malloc.c:431]: fm_malloc(): fm_malloc(0x7ff2b2550010, 1) called from acc: acc_extra.c: extra2strar(265) 2(18158) DEBUG: [mem/f_malloc.c:506]: fm_malloc(): fm_malloc(0x7ff2b2550010, 8) returns address 0x7ff2b263b0c8 2(18158) DEBUG: [mem/f_malloc.c:431]: fm_malloc(): fm_malloc(0x7ff2b2550010, 12) called from acc: acc_extra.c: extra2strar(265) 2(18158) DEBUG: [mem/f_malloc.c:506]: fm_malloc(): fm_malloc(0x7ff2b2550010, 16) returns address 0x7ff2b2699538 2(18158) DEBUG: [mem/f_malloc.c:431]: fm_malloc(): fm_malloc(0x7ff2b2550010, 2) called from acc: acc_extra.c: extra2strar(265) 2(18158) DEBUG: [mem/f_malloc.c:506]: fm_malloc(): fm_malloc(0x7ff2b2550010, 8) returns address 0x7ff2b2632860 2(18158) DEBUG: [mem/f_malloc.c:431]: fm_malloc(): fm_malloc(0x7ff2b2550010, 1) called from acc: acc_extra.c: extra2strar(265) 2(18158) DEBUG: [mem/f_malloc.c:506]: fm_malloc(): fm_malloc(0x7ff2b2550010, 8) returns address 0x7ff2b262f440 2(18158) DEBUG: [mem/f_malloc.c:431]: fm_malloc(): fm_malloc(0x7ff2b2550010, 6) called from acc: acc_extra.c: extra2strar(265) 2(18158) DEBUG: [mem/f_malloc.c:506]: fm_malloc(): fm_malloc(0x7ff2b2550010, 8) returns address 0x7ff2b2605d60 2(18158) DEBUG: [mem/f_malloc.c:431]: fm_malloc(): fm_malloc(0x7ff2b2550010, 1) called from acc: acc_extra.c: extra2strar(265) 2(18158) DEBUG: [mem/f_malloc.c:506]: fm_malloc(): fm_malloc(0x7ff2b2550010, 8) returns address 0x7ff2b2607c30 2(18158) DEBUG: [mem/f_malloc.c:431]: fm_malloc(): fm_malloc(0x7ff2b2550010, 1) called from acc: acc_extra.c: extra2strar(265) 2(18158) DEBUG: [mem/f_malloc.c:506]: fm_malloc(): fm_malloc(0x7ff2b2550010, 8) returns address 0x7ff2b2601fa8 2(18158) DEBUG: [mem/f_malloc.c:431]: fm_malloc(): fm_malloc(0x7ff2b2550010, 2) called from acc: acc_extra.c: extra2strar(265) 2(18158) DEBUG: [mem/f_malloc.c:506]: fm_malloc(): fm_malloc(0x7ff2b2550010, 8) returns address 0x7ff2b25ffaf8 2(18158) DEBUG: [mem/f_malloc.c:431]: fm_malloc(): fm_malloc(0x7ff2b2550010, 4) called from acc: acc_extra.c: extra2strar(265) 2(18158) DEBUG: [mem/f_malloc.c:506]: fm_malloc(): fm_malloc(0x7ff2b2550010, 8) returns address 0x7ff2b25fd188 2(18158) DEBUG: [mem/f_malloc.c:431]: fm_malloc(): fm_malloc(0x7ff2b2550010, 20) called from acc: acc_extra.c: extra2strar(265) 2(18158) DEBUG: [mem/f_malloc.c:506]: fm_malloc(): fm_malloc(0x7ff2b2550010, 24) returns address 0x7ff2b25de888 2(18158) DEBUG: [mem/f_malloc.c:431]: fm_malloc(): fm_malloc(0x7ff2b2550010, 1) called from acc: acc_extra.c: extra2strar(265) 2(18158) DEBUG: [mem/f_malloc.c:506]: fm_malloc(): fm_malloc(0x7ff2b2550010, 8) returns address 0x7ff2b25f0560 2(18158) DEBUG: [mem/f_malloc.c:431]: fm_malloc(): fm_malloc(0x7ff2b2550010, 5) called from acc: acc_extra.c: extra2strar(265) 2(18158) DEBUG: [mem/f_malloc.c:506]: fm_malloc(): fm_malloc(0x7ff2b2550010,
Re: [SR-Users] out of memory Error
Hello Daniel i did what you wrote here. Here is results; http://pastebin.com/YQFxcnLN And i did some test without acc_radius module. without acc_radius module , there is no out of memory on pkg. it continue 1+ calls instead with acc_radius , it gets out of memory in 2000+ calls. i don't know how to analyze logs but "extra2strar" function has big data. i am gonna run with debug mod for 1 calls and try to analyze it again. Thanks for help. -- View this message in context: http://sip-router.1086192.n5.nabble.com/out-of-memory-Error-tp141866p141938.html Sent from the Users mailing list archive at Nabble.com. ___ SIP Express Router (SER) and Kamailio (OpenSER) - sr-users mailing list sr-users@lists.sip-router.org http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users
Re: [SR-Users] out of memory Error
Hello, hmm, even these logs were not catching the relevant information, the main process is the one logging the used packets, from the others I saw only the free chunks summary. Let's do it again with stopping kamailio when you get out of memory errors. Set children=2 and mem_summary=15 to get all possible logs related to the memory. You can send directly to me all the log messages with memory status and summary printed when kamailio is stopped, because the size can be quite big and the mailing list won't accept it. Cheers, Daniel On 29/09/15 13:10, ycaner wrote: > Hello Daniel; > > i got logs from kamailio. there is 10 pid about kamailio and don't > give dumps for all kamailio pids expects somes. Here is results; > -- Daniel-Constantin Mierla http://twitter.com/#!/miconda - http://www.linkedin.com/in/miconda Book: SIP Routing With Kamailio - http://www.asipto.com ___ SIP Express Router (SER) and Kamailio (OpenSER) - sr-users mailing list sr-users@lists.sip-router.org http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users
Re: [SR-Users] out of memory Error
Hello Daniel; i got logs from kamailio. there is 10 pid about kamailio and don't give dumps for all kamailio pids expects somes. Here is results; root 18323 0.0 0.0 454628 12968 ? S 12:12 0:00 /usr/local/sbin/kamailio -P /var/run/kamailio.pid -m 256 -M 8 -u root -g root root 18333 0.0 0.1 454628 16632 ? S 12:12 0:03 /usr/local/sbin/kamailio -P /var/run/kamailio.pid -m 256 -M 8 -u root -g root root 18334 0.0 0.1 454628 16504 ? S 12:12 0:03 /usr/local/sbin/kamailio -P /var/run/kamailio.pid -m 256 -M 8 -u root -g root root 18335 0.0 0.0 454628 7132 ? S 12:12 0:00 /usr/local/sbin/kamailio -P /var/run/kamailio.pid -m 256 -M 8 -u root -g root root 18337 0.0 0.0 454628 10232 ? S 12:12 0:02 /usr/local/sbin/kamailio -P /var/run/kamailio.pid -m 256 -M 8 -u root -g root root 18339 0.0 0.0 454632 5332 ? S 12:12 0:00 /usr/local/sbin/kamailio -P /var/run/kamailio.pid -m 256 -M 8 -u root -g root root 18341 0.0 0.0 454628 6012 ? S 12:12 0:00 /usr/local/sbin/kamailio -P /var/run/kamailio.pid -m 256 -M 8 -u root -g root root 18344 0.0 0.0 454628 5776 ? S 12:12 0:00 /usr/local/sbin/kamailio -P /var/run/kamailio.pid -m 256 -M 8 -u root -g root root 18346 0.0 0.0 454628 6716 ? S 12:12 0:00 /usr/local/sbin/kamailio -P /var/run/kamailio.pid -m 256 -M 8 -u root -g root root 18348 0.0 0.0 454628 5680 ? S 12:12 0:00 /usr/local/sbin/kamailio -P /var/run/kamailio.pid -m 256 -M 8 -u root -g root Sep 29 13:59:21 localhost /usr/local/sbin/kamailio[18334]: ALERT:[pt.c:531]: mem_dump_pkg_cb(): Memory status (pkg) of process 18334: Sep 29 13:59:21 localhost /usr/local/sbin/kamailio[18334]: ALERT: fm_status: fm_status (0x7f4b67aa8010): Sep 29 13:59:21 localhost /usr/local/sbin/kamailio[18334]: ALERT: fm_status: heap size= 8388608 Sep 29 13:59:21 localhost /usr/local/sbin/kamailio[18334]: ALERT: fm_status: used= 3949448, used+overhead=8384064, free=4544 Sep 29 13:59:21 localhost /usr/local/sbin/kamailio[18334]: ALERT: fm_status: max used (+overhead)= 8388608 Sep 29 13:59:21 localhost /usr/local/sbin/kamailio[18334]: ALERT: fm_status: dumping free list: Sep 29 13:59:21 localhost /usr/local/sbin/kamailio[18334]: ALERT: fm_status: hash = 6 fragments no.: 2, unused: 0#012#011#011 bucket size: 48 - 48 (first 48) Sep 29 13:59:21 localhost /usr/local/sbin/kamailio[18334]: ALERT: fm_status: hash = 7 fragments no.: 1, unused: 0#012#011#011 bucket size: 56 - 56 (first 56) Sep 29 13:59:21 localhost /usr/local/sbin/kamailio[18334]: ALERT: fm_status: hash = 8 fragments no.: 15, unused: 0#012#011#011 bucket size: 64 - 64 (first 64) Sep 29 13:59:21 localhost /usr/local/sbin/kamailio[18334]: ALERT: fm_status: hash = 14 fragments no.: 1, unused: 0#012#011#011 bucket size: 112 - 112 (first 112) Sep 29 13:59:21 localhost /usr/local/sbin/kamailio[18334]: ALERT: fm_status: hash = 29 fragments no.: 1, unused: 0#012#011#011 bucket size: 232 - 232 (first 232) Sep 29 13:59:21 localhost /usr/local/sbin/kamailio[18334]: ALERT: fm_status: hash = 59 fragments no.: 1, unused: 0#012#011#011 bucket size: 472 - 472 (first 472) Sep 29 13:59:21 localhost /usr/local/sbin/kamailio[18334]: ALERT: fm_status: hash = 106 fragments no.: 1, unused: 0#012#011#011 bucket size: 848 - 848 (first 848) Sep 29 13:59:21 localhost /usr/local/sbin/kamailio[18334]: ALERT: fm_status: hash = 221 fragments no.: 1, unused: 0#012#011#011 bucket size: 1768 - 1768 (first 1768) Sep 29 13:59:21 localhost /usr/local/sbin/kamailio[18334]: ALERT: fm_status: TOTAL: 23 free fragments = 4544 free bytes Sep 29 13:59:21 localhost /usr/local/sbin/kamailio[18334]: ALERT: fm_status: - Sep 29 13:59:23 localhost /usr/local/sbin/kamailio[18335]: ALERT: [pt.c:531]: mem_dump_pkg_cb(): Memory status (pkg) of process 18335: Sep 29 13:59:23 localhost /usr/local/sbin/kamailio[18335]: ALERT: fm_status: fm_status (0x7f4b67aa8010): Sep 29 13:59:23 localhost /usr/local/sbin/kamailio[18335]: ALERT: fm_status: heap size= 8388608 Sep 29 13:59:23 localhost /usr/local/sbin/kamailio[18335]: ALERT: fm_status: us
Re: [SR-Users] out of memory Error
Hello, still look like only mem summary from main process, which is not relevant for a worker process. Use the suggestions from my previous email to get the pkg mem summary for a sip worker process. Cheers, Daniel On 29/09/15 10:52, ycaner wrote: > > Hello; > > There is no changes after changin .cfg and ports. here is second summary. > > 0(15002) NOTICE: [main.c:555]: cleanup(): Memory still-in-use > summary (pkg): > 0(15002) NOTICE: fm_status: summarizing all alloc'ed. fragments: > 0(15002) NOTICE: fm_status: count= 1 size=56 bytes from > textops: textops.c: hname_fixup(2208) > 0(15002) NOTICE: fm_status: count= 1 size= 128 bytes from > : mod_fix.c: fixup_pvar_all(270) > 0(15002) NOTICE: fm_status: count= 1 size= 128 bytes from > : switch.c: mk_switch_cond_table(43) > 0(15002) NOTICE: fm_status: count= 1 size= 232 bytes from > : parser/msg_parser.c: get_hdr_field(116) > 0(15002) NOTICE: fm_status: count= 1 size=64 bytes from > : parser/msg_parser.c: parse_headers(326) > 0(15002) NOTICE: fm_status: count= 1 size=56 bytes from > acc: acc_mod.c: acc_register_engine(844) > 0(15002) NOTICE: fm_status: count=19 size= 2128 bytes from > acc: acc_extra.c: parse_acc_extra(127) > 0(15002) NOTICE: fm_status: count= 1 size= 112 bytes from > misc_radius: extra.c: parse_extra_str(83) > 0(15002) NOTICE: fm_status: count= 2 size=32 bytes from > : select.c: register_select_table(448) > 0(15002) NOTICE: fm_status: count= 1 size=24 bytes from > kex: mi_core.c: init_mi_uptime(82) > 0(15002) NOTICE: fm_status: count= 1 size=80 bytes from > : socket_info.c: fix_sock_str(419) > 0(15002) NOTICE: fm_status: count= 1 size=16 bytes from > : name_alias.h: add_alias(93) > 0(15002) NOTICE: fm_status: count= 1 size=32 bytes from > : name_alias.h: add_alias(91) > 0(15002) NOTICE: fm_status: count= 1 size= 32208 bytes from > : dset.c: init_dst_set(83) > 0(15002) NOTICE: fm_status: count= 1 size=40 bytes from > : socket_info.c: fix_hostname(1357) > 0(15002) NOTICE: fm_status: count= 1 size=64 bytes from > : route.c: fix_expr(541) > 0(15002) NOTICE: fm_status: count= 1 size=72 bytes from > : mod_fix.c: fixup_regexp_null(213) > 0(15002) NOTICE: fm_status: count=10 size= 656 bytes from > : cfg.y: mk_case_stm(3718) > 0(15002) NOTICE: fm_status: count= 1 size= 256 bytes from > : switch.c: mk_match_cond_table(94) > 0(15002) NOTICE: fm_status: count= 5 size= 560 bytes from > : sr_module.c: fix_param(1211) > 0(15002) NOTICE: fm_status: count= 3 size= 232 bytes from > : route_struct.c: mk_elem(90) > 0(15002) NOTICE: fm_status: count= 1 size=32 bytes from > : socket_info.c: fix_socket_list(1559) > 0(15002) NOTICE: fm_status: count=24 size= 632 bytes from > textops: textops.c: fixup_method(2278) > 0(15002) NOTICE: fm_status: count= 1 size=72 bytes from > htable: ht_var.c: pv_parse_ht_name(135) > 0(15002) NOTICE: fm_status: count= 2 size=64 bytes from > pv: pv_trans.c: tr_parse_string(2120) > 0(15002) NOTICE: fm_status: count= 3 size= 152 bytes from > pv: pv_trans.c: tr_parse_string(2109) > 0(15002) NOTICE: fm_status: count= 2 size=16 bytes from > : re.c: subst_parser(300) > 0(15002) NOTICE: fm_status: count= 3 size= 432 bytes from > : re.c: subst_parser(290) > 0(15002) NOTICE: fm_status: count= 3 size= 192 bytes from > : re.c: subst_parser(273) > 0(15002) NOTICE: fm_status: count= 3 size=96 bytes from > textops: txt_var.c: tr_txt_parse_re(212) > 0(15002) NOTICE: fm_status: count= 147 size= 14392 bytes from > : sr_module.c: fix_param(1116) > 0(15002) NOTICE: fm_status: count= 9 size= 432 bytes from > pv: pv_svar.c: add_var(58) > 0(15002) NOTICE: fm_status: count= 1 size=32 bytes from > pv: pv_trans.c: tr_parse_string(2245) > 0(15002) NOTICE: fm_status: count= 8 size= 384 bytes from > : pvapi.c: tr_new(1542) > 0(15002) NOTICE: fm_status: count= 9 size= 112 bytes from > pv: pv_svar.c: add_var(65) > 0(15002) NOTICE: fm_status: count= 1 size= 128 bytes from > : rvalue.c: fix_match_rve(3018) > 0(15002) NOTICE: fm_status: count=48 size= 83328 bytes from > : rvalue.c: mk_rval_expr1(2611) > 0(15002) NOTICE: fm_status: count= 213 size= 7688 bytes from > : pvapi.c: pv_parse_format(1057) > 0(15002) NOTICE: fm_status: count= 262 size= 5472 bytes from > : rvalue.c: rval_get_str(1252) > 0(15002) NOTICE: fm_status: count=52 size= 90272 bytes from > : rvalue.c: mk_rval_expr2(2669) > 0(15002) NOTICE: fm_status: count=54 size= 6504 bytes from > xlog: xlog.c: xlog_fixup_helper(449) > 0(15002) NOTICE: fm_status: count= 544 size=136208 bytes from > : route_str
Re: [SR-Users] out of memory Error
Hello; There is no changes after changin .cfg and ports. here is second summary. 0(15002) NOTICE:[main.c:555]: cleanup(): Memory still-in-use summary (pkg): 0(15002) NOTICE: fm_status: summarizing all alloc'ed. fragments: 0(15002) NOTICE: fm_status: count= 1 size= 56 bytes from textops: textops.c: hname_fixup(2208) 0(15002) NOTICE: fm_status: count= 1 size= 128 bytes from : mod_fix.c: fixup_pvar_all(270) 0(15002) NOTICE: fm_status: count= 1 size= 128 bytes from : switch.c: mk_switch_cond_table(43) 0(15002) NOTICE: fm_status: count= 1 size= 232 bytes from : parser/msg_parser.c: get_hdr_field(116) 0(15002) NOTICE: fm_status: count= 1 size= 64 bytes from : parser/msg_parser.c: parse_headers(326) 0(15002) NOTICE: fm_status: count= 1 size= 56 bytes from acc: acc_mod.c: acc_register_engine(844) 0(15002) NOTICE: fm_status: count= 19 size= 2128 bytes from acc: acc_extra.c: parse_acc_extra(127) 0(15002) NOTICE: fm_status: count= 1 size= 112 bytes from misc_radius: extra.c: parse_extra_str(83) 0(15002) NOTICE: fm_status: count= 2 size= 32 bytes from : select.c: register_select_table(448) 0(15002) NOTICE: fm_status: count= 1 size= 24 bytes from kex: mi_core.c: init_mi_uptime(82) 0(15002) NOTICE: fm_status: count= 1 size= 80 bytes from : socket_info.c: fix_sock_str(419) 0(15002) NOTICE: fm_status: count= 1 size= 16 bytes from : name_alias.h: add_alias(93) 0(15002) NOTICE: fm_status: count= 1 size= 32 bytes from : name_alias.h: add_alias(91) 0(15002) NOTICE: fm_status: count= 1 size= 32208 bytes from : dset.c: init_dst_set(83) 0(15002) NOTICE: fm_status: count= 1 size= 40 bytes from : socket_info.c: fix_hostname(1357) 0(15002) NOTICE: fm_status: count= 1 size= 64 bytes from : route.c: fix_expr(541) 0(15002) NOTICE: fm_status: count= 1 size= 72 bytes from : mod_fix.c: fixup_regexp_null(213) 0(15002) NOTICE: fm_status: count= 10 size= 656 bytes from : cfg.y: mk_case_stm(3718) 0(15002) NOTICE: fm_status: count= 1 size= 256 bytes from : switch.c: mk_match_cond_table(94) 0(15002) NOTICE: fm_status: count= 5 size= 560 bytes from : sr_module.c: fix_param(1211) 0(15002) NOTICE: fm_status: count= 3 size= 232 bytes from : route_struct.c: mk_elem(90) 0(15002) NOTICE: fm_status: count= 1 size= 32 bytes from : socket_info.c: fix_socket_list(1559) 0(15002) NOTICE: fm_status: count= 24 size= 632 bytes from textops: textops.c: fixup_method(2278) 0(15002) NOTICE: fm_status: count= 1 size= 72 bytes from htable: ht_var.c: pv_parse_ht_name(135) 0(15002) NOTICE: fm_status: count= 2 size= 64 bytes from pv: pv_trans.c: tr_parse_string(2120) 0(15002) NOTICE: fm_status: count= 3 size= 152 bytes from pv: pv_trans.c: tr_parse_string(2109) 0(15002) NOTICE: fm_status: count= 2 size= 16 bytes from : re.c: subst_parser(300) 0(15002) NOTICE: fm_status: count= 3 size= 432 bytes from : re.c: subst_parser(290) 0(15002) NOTICE: fm_status: count= 3 size= 192 bytes from : re.c: subst_parser(273) 0(15002) NOTICE: fm_status: count= 3 size= 96 bytes from textops: txt_var.c: tr_txt_parse_re(212) 0(15002) NOTICE: fm_status: count= 147 size= 14392 bytes from : sr_module.c: fix_param(1116) 0(15002) NOTICE: fm_status: count= 9 size= 432 bytes from pv: pv_svar.c: add_var(58) 0(15002) NOTICE: fm_status: count= 1 size= 32 bytes from pv: pv_trans.c: tr_parse_string(2245) 0(15002) NOTICE: fm_status: count= 8 size= 384 bytes from : pvapi.c: tr_new(1542) 0(15002) NOTICE: fm_status: count= 9 size= 112 bytes from pv: pv_svar.c: add_var(65) 0(15002) NOTICE: fm_status: count= 1 size= 128 bytes from : rvalue.c: fix_match_rve(3018) 0(15002) NOTICE: fm_status: count= 48 size= 83328 bytes from : rvalue.c: mk_rval_expr1(2611) 0(15002) NOTICE: fm_status: count= 213 size= 7688 bytes from : pvapi.c: pv_parse_format(1057) 0(15002) NOTICE: fm_status: count= 262 size= 5472 bytes from : rvalue.c: rv
Re: [SR-Users] out of memory Error
Hello, so these logs are only from main kamailio process, which doesn't handle sip, so it looks like it has still a lot of pkg. Is there another group of logs for "fm_status: summarizing all alloc'ed. fragments" but for another PID than 11969? If not, then do the test again. When you get out memory logs, identify the PID of the process that wrote the log message, then run: kamcmd cfg.set_now_int core mem_dump_pkg Replace with actual value for PID. Then send some traffic so the process with PID is doing some work. It should print the summary when it receives the first packet. Cheers, Daniel On 29/09/15 10:34, ycaner wrote: > Hello Daniel; > i got summary on "kamailio -E -m 256 -M 8". as you said i did > children 2. after 3000 calls i get this errors. > > in additon , i saw some logs about loops some packets. > Thanks > > 0(11969) NOTICE: [main.c:555]: cleanup(): Memory still-in-use > summary (pkg): > 0(11969) NOTICE: fm_status: summarizing all alloc'ed. fragments: > 0(11969) NOTICE: fm_status: count= 1 size=56 bytes from > textops: textops.c: hname_fixup(2208) > 0(11969) NOTICE: fm_status: count= 1 size= 128 bytes from > : mod_fix.c: fixup_pvar_all(270) > 0(11969) NOTICE: fm_status: count= 1 size= 128 bytes from > : switch.c: mk_switch_cond_table(43) > 0(11969) NOTICE: fm_status: count= 1 size= 232 bytes from > : parser/msg_parser.c: get_hdr_field(116) > 0(11969) NOTICE: fm_status: count= 1 size=64 bytes from > : parser/msg_parser.c: parse_headers(326) > 0(11969) NOTICE: fm_status: count= 1 size=56 bytes from > acc: acc_mod.c: acc_register_engine(844) > 0(11969) NOTICE: fm_status: count=19 size= 2128 bytes from > acc: acc_extra.c: parse_acc_extra(127) > 0(11969) NOTICE: fm_status: count= 1 size= 112 bytes from > misc_radius: extra.c: parse_extra_str(83) > 0(11969) NOTICE: fm_status: count= 2 size=32 bytes from > : select.c: register_select_table(448) > 0(11969) NOTICE: fm_status: count= 1 size=24 bytes from > kex: mi_core.c: init_mi_uptime(82) > 0(11969) NOTICE: fm_status: count= 1 size=80 bytes from > : socket_info.c: fix_sock_str(419) > 0(11969) NOTICE: fm_status: count= 1 size=16 bytes from > : name_alias.h: add_alias(93) > 0(11969) NOTICE: fm_status: count= 1 size=32 bytes from > : name_alias.h: add_alias(91) > 0(11969) NOTICE: fm_status: count= 1 size= 32208 bytes from > : dset.c: init_dst_set(83) > 0(11969) NOTICE: fm_status: count= 1 size=40 bytes from > : socket_info.c: fix_hostname(1357) > 0(11969) NOTICE: fm_status: count= 1 size=64 bytes from > : route.c: fix_expr(541) > 0(11969) NOTICE: fm_status: count=10 size= 656 bytes from > : cfg.y: mk_case_stm(3718) > 0(11969) NOTICE: fm_status: count= 1 size= 256 bytes from > : switch.c: mk_match_cond_table(94) > 0(11969) NOTICE: fm_status: count= 1 size= 168 bytes from > : mod_fix.c: fixup_regexp_null(213) > 0(11969) NOTICE: fm_status: count= 5 size= 560 bytes from > : sr_module.c: fix_param(1211) > 0(11969) NOTICE: fm_status: count= 3 size= 232 bytes from > : route_struct.c: mk_elem(90) > 0(11969) NOTICE: fm_status: count= 1 size=32 bytes from > : socket_info.c: fix_socket_list(1559) > 0(11969) NOTICE: fm_status: count=24 size= 632 bytes from > textops: textops.c: fixup_method(2278) > 0(11969) NOTICE: fm_status: count= 1 size=72 bytes from > htable: ht_var.c: pv_parse_ht_name(135) > 0(11969) NOTICE: fm_status: count= 2 size=64 bytes from > pv: pv_trans.c: tr_parse_string(2120) > 0(11969) NOTICE: fm_status: count= 3 size= 152 bytes from > pv: pv_trans.c: tr_parse_string(2109) > 0(11969) NOTICE: fm_status: count= 2 size=16 bytes from > : re.c: subst_parser(300) > 0(11969) NOTICE: fm_status: count= 3 size= 432 bytes from > : re.c: subst_parser(290) > 0(11969) NOTICE: fm_status: count= 3 size= 192 bytes from > : re.c: subst_parser(273) > 0(11969) NOTICE: fm_status: count= 3 size=96 bytes from > textops: txt_var.c: tr_txt_parse_re(212) > 0(11969) NOTICE: fm_status: count= 9 size= 432 bytes from > pv: pv_svar.c: add_var(58) > 0(11969) NOTICE: fm_status: count= 1 size=32 bytes from > pv: pv_trans.c: tr_parse_string(2245) > 0(11969) NOTICE: fm_status: count= 8 size= 384 bytes from > : pvapi.c: tr_new(1542) > 0(11969) NOTICE: fm_status: count= 1 size= 128 bytes from > : rvalue.c: fix_match_rve(3018) > 0(11969) NOTICE: fm_status: count= 9 size= 112 bytes from > pv: pv_svar.c: add_var(65) > 0(11969) NOTICE: fm_status: count=48 size= 83328 bytes from > : rvalue.c: mk_rval_expr1(2611) > 0(11969) NOTICE: fm_status: count= 211 size= 7624 bytes from > : pvapi.c: pv_parse_format(1057) > 0(11969
Re: [SR-Users] out of memory Error
Hello Daniel; i got summary on "kamailio -E -m 256 -M 8". as you said i did children 2. after 3000 calls i get this errors. in additon , i saw some logs about loops some packets. Thanks 0(11969) NOTICE:[main.c:555]: cleanup(): Memory still-in-use summary (pkg): 0(11969) NOTICE: fm_status: summarizing all alloc'ed. fragments: 0(11969) NOTICE: fm_status: count= 1 size= 56 bytes from textops: textops.c: hname_fixup(2208) 0(11969) NOTICE: fm_status: count= 1 size= 128 bytes from : mod_fix.c: fixup_pvar_all(270) 0(11969) NOTICE: fm_status: count= 1 size= 128 bytes from : switch.c: mk_switch_cond_table(43) 0(11969) NOTICE: fm_status: count= 1 size= 232 bytes from : parser/msg_parser.c: get_hdr_field(116) 0(11969) NOTICE: fm_status: count= 1 size= 64 bytes from : parser/msg_parser.c: parse_headers(326) 0(11969) NOTICE: fm_status: count= 1 size= 56 bytes from acc: acc_mod.c: acc_register_engine(844) 0(11969) NOTICE: fm_status: count= 19 size= 2128 bytes from acc: acc_extra.c: parse_acc_extra(127) 0(11969) NOTICE: fm_status: count= 1 size= 112 bytes from misc_radius: extra.c: parse_extra_str(83) 0(11969) NOTICE: fm_status: count= 2 size= 32 bytes from : select.c: register_select_table(448) 0(11969) NOTICE: fm_status: count= 1 size= 24 bytes from kex: mi_core.c: init_mi_uptime(82) 0(11969) NOTICE: fm_status: count= 1 size= 80 bytes from : socket_info.c: fix_sock_str(419) 0(11969) NOTICE: fm_status: count= 1 size= 16 bytes from : name_alias.h: add_alias(93) 0(11969) NOTICE: fm_status: count= 1 size= 32 bytes from : name_alias.h: add_alias(91) 0(11969) NOTICE: fm_status: count= 1 size= 32208 bytes from : dset.c: init_dst_set(83) 0(11969) NOTICE: fm_status: count= 1 size= 40 bytes from : socket_info.c: fix_hostname(1357) 0(11969) NOTICE: fm_status: count= 1 size= 64 bytes from : route.c: fix_expr(541) 0(11969) NOTICE: fm_status: count= 10 size= 656 bytes from : cfg.y: mk_case_stm(3718) 0(11969) NOTICE: fm_status: count= 1 size= 256 bytes from : switch.c: mk_match_cond_table(94) 0(11969) NOTICE: fm_status: count= 1 size= 168 bytes from : mod_fix.c: fixup_regexp_null(213) 0(11969) NOTICE: fm_status: count= 5 size= 560 bytes from : sr_module.c: fix_param(1211) 0(11969) NOTICE: fm_status: count= 3 size= 232 bytes from : route_struct.c: mk_elem(90) 0(11969) NOTICE: fm_status: count= 1 size= 32 bytes from : socket_info.c: fix_socket_list(1559) 0(11969) NOTICE: fm_status: count= 24 size= 632 bytes from textops: textops.c: fixup_method(2278) 0(11969) NOTICE: fm_status: count= 1 size= 72 bytes from htable: ht_var.c: pv_parse_ht_name(135) 0(11969) NOTICE: fm_status: count= 2 size= 64 bytes from pv: pv_trans.c: tr_parse_string(2120) 0(11969) NOTICE: fm_status: count= 3 size= 152 bytes from pv: pv_trans.c: tr_parse_string(2109) 0(11969) NOTICE: fm_status: count= 2 size= 16 bytes from : re.c: subst_parser(300) 0(11969) NOTICE: fm_status: count= 3 size= 432 bytes from : re.c: subst_parser(290) 0(11969) NOTICE: fm_status: count= 3 size= 192 bytes from : re.c: subst_parser(273) 0(11969) NOTICE: fm_status: count= 3 size= 96 bytes from textops: txt_var.c: tr_txt_parse_re(212) 0(11969) NOTICE: fm_status: count= 9 size= 432 bytes from pv: pv_svar.c: add_var(58) 0(11969) NOTICE: fm_status: count= 1 size= 32 bytes from pv: pv_trans.c: tr_parse_string(2245) 0(11969) NOTICE: fm_status: count= 8 size= 384 bytes from : pvapi.c: tr_new(1542) 0(11969) NOTICE: fm_status: count= 1 size= 128 bytes from : rvalue.c: fix_match_rve(3018) 0(11969) NOTICE: fm_status: count= 9 size= 112 bytes from pv: pv_svar.c: add_var(65) 0(11969) NOTICE: fm_status: count= 48 size= 83328 bytes from : rvalue.c: mk_rval_expr1(2611) 0(11969) NOTICE: fm_status: count= 211 size= 7624 bytes from : pvapi.c: pv_parse_format(1057) 0(11969) NOTICE: fm_status: count= 147 size= 14440 bytes from : sr_module.c: fix
Re: [SR-Users] out of memory Error
Hello,
there are no logs.
You should have followed my suggestions, because mem_summary=15 is
printing a lot of other unnecessary log messages. It is better to use
mem_summary=8 to get a smaller log. Also, the children is quite high,
try with children=2 -- the out of memory should appear sooner.
Also, use -M 8 in order to reduce the time to using all memory.
Cheers,
Daniel
On 29/09/15 08:30, ycaner wrote:
> Hello Daniel;
>
> First of all , Thanks for reply.This project deserve a big award
> because of you. you try to give response any question as you can. i
> hope with my test results help you to make it bigger this project.
>
> Before you reply i set memlog=0 , debug=0 and mem_summary=15 ,
> children 64 ,"SHM_MEMORY=256" , "PKG_MEMORY=32" .i added to results.
> i dont know how to analyse results but i think the problem is "acc:
> acc_extra.c: extra2strar(265)". it increases bytes.
>
>
> Thanks.
>
>
> 29.09.2015 00:31 tarihinde Daniel-Constantin Mierla-6 [via SIP Router]
> yazdı:
>> The free size for private memory/pkg is getting low.
>>
>> Set in kamailio.cfg:
>>
>> memlog=1
>> mem_summary=8
>>
>> Be sure that debug parameter is at least 1.
>>
>> Restart kamailio and run the test again. When you get out of memory,
>> stop kamailio (e.g., using: killall kamailio).
>>
>> Look inside syslog file for the messages printed at the end. For each
>> kamailio process, there should be a pkg summary -- messages can be
>> mixed, so you can send all of them
>>
>> To have lower number of process (which will probably result in faster
>> consuming of memory), you can set children=2.
>>
>> Cheers,
>> Daniel
>>
>> On 28/09/15 17:31, ycaner wrote:
>>> {
>>> entry: 1
>>> pid: 12039
>>> rank: 1
>>> used: 13425600
>>> free: 148336
>>> real_used: 33406096
>>> total_size: 33554432
>>> total_frags: 20
>>> }
>>
>> --
>> Daniel-Constantin Mierla
>> http://twitter.com/#!/miconda - http://www.linkedin.com/in/miconda
>> Book: SIP Routing With Kamailio - http://www.asipto.com
>>
>> ___
>> SIP Express Router (SER) and Kamailio (OpenSER) - sr-users mailing list
>> [hidden email]
>> http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users
>>
>>
>>
>> If you reply to this email, your message will be added to the
>> discussion below:
>> http://sip-router.1086192.n5.nabble.com/out-of-memory-Error-tp141866p141889.html
>>
>> To unsubscribe from out of memory Error, click here.
>> NAML
>>
>>
>
> --
>
>
> *kamailio_mem_dump_1.txt* (1M) Download Attachment
>
>
>
> View this message in context: Re: out of memory Error
>
> Sent from the Users mailing list archive
> at Nabble.com.
>
>
> ___
> SIP Express Router (SER) and Kamailio (OpenSER) - sr-users mailing list
> sr-users@lists.sip-router.org
> http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users
--
Daniel-Constantin Mierla
http://twitter.com/#!/miconda - http://www.linkedin.com/in/miconda
Book: SIP Routing With Kamailio - http://www.asipto.com
Kamailio Advanced Training, Sep 28-30, 2015, in Berlin - http://asipto.com/u/kat
___
SIP Express Router (SER) and Kamailio (OpenSER) - sr-users mailing list
sr-users@lists.sip-router.org
http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users
Re: [SR-Users] out of memory Error
Hello Daniel;
First of all , Thanks for reply.This project deserve a big award
because of you. you try to give response any question as you can.
i hope with my test results help you to make it bigger this
project.
Before you reply i set memlog=0 , debug=0 and mem_summary=15 ,
children 64 ,"SHM_MEMORY=256" , "PKG_MEMORY=32" .i added to
results.
i dont know how to analyse results but i think the problem is
"acc: acc_extra.c: extra2strar(265)". it increases bytes.
Thanks.
29.09.2015 00:31 tarihinde
Daniel-Constantin Mierla-6 [via SIP Router] yazdı:
The free size for private memory/pkg is getting low.
Set in kamailio.cfg:
memlog=1
mem_summary=8
Be sure that debug parameter is at least 1.
Restart kamailio and run the test again. When you get out of
memory, stop kamailio (e.g., using: killall kamailio).
Look inside syslog file for the messages printed at the end. For
each kamailio process, there should be a pkg summary -- messages
can be mixed, so you can send all of them
To have lower number of process (which will probably result in
faster consuming of memory), you can set children=2.
Cheers,
Daniel
On 28/09/15 17:31, ycaner wrote:
{
entry: 1
pid: 12039
rank: 1
used: 13425600
free: 148336
real_used: 33406096
total_size: 33554432
total_frags: 20
}
--
Daniel-Constantin Mierla
http://twitter.com/#!/miconda - http://www.linkedin.com/in/miconda
Book: SIP Routing With Kamailio - http://www.asipto.com
___
SIP Express Router (SER) and Kamailio (OpenSER) - sr-users mailing
list
[hidden email]
http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users
If you reply to this email, your
message will be added to the discussion below:
http://sip-router.1086192.n5.nabble.com/out-of-memory-Error-tp141866p141889.html
To unsubscribe from out of memory Error, click
here .
NAML
--
yasin-imza-2014.jpg (51K)
kamailio_mem_dump_1.txt (1M)
--
View this message in context:
http://sip-router.1086192.n5.nabble.com/out-of-memory-Error-tp141866p141893.html
Sent from the Users mailing list archive at Nabble.com.___
SIP Express Router (SER) and Kamailio (OpenSER) - sr-users mailing list
sr-users@lists.sip-router.org
http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users
Re: [SR-Users] out of memory Error
The free size for private memory/pkg is getting low.
Set in kamailio.cfg:
memlog=1
mem_summary=8
Be sure that debug parameter is at least 1.
Restart kamailio and run the test again. When you get out of memory,
stop kamailio (e.g., using: killall kamailio).
Look inside syslog file for the messages printed at the end. For each
kamailio process, there should be a pkg summary -- messages can be
mixed, so you can send all of them
To have lower number of process (which will probably result in faster
consuming of memory), you can set children=2.
Cheers,
Daniel
On 28/09/15 17:31, ycaner wrote:
> {
> entry: 1
> pid: 12039
> rank: 1
> used: 13425600
> free: 148336
> real_used: 33406096
> total_size: 33554432
> total_frags: 20
> }
--
Daniel-Constantin Mierla
http://twitter.com/#!/miconda - http://www.linkedin.com/in/miconda
Book: SIP Routing With Kamailio - http://www.asipto.com
___
SIP Express Router (SER) and Kamailio (OpenSER) - sr-users mailing list
sr-users@lists.sip-router.org
http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users
Re: [SR-Users] out of memory Error
Hello;
after 392 000 calls , it gives out of memory error again. i got memlog at
below. Could you help me find out. Thanks
--
core:bad_URIs_rcvd = 0
core:bad_msg_hdr = 0
core:drop_replies = 0
core:drop_requests = 35
core:err_replies = 0
core:err_requests = 0
core:fwd_replies = 23
core:fwd_requests = 458763
core:rcv_replies = 1249516
core:rcv_requests = 1269758
core:unsupported_methods = 0
dialog:active_dialogs = 1
dialog:early_dialogs = 0
dialog:expired_dialogs = 1
dialog:failed_dialogs = 4
dialog:processed_dialogs = 394542
dns:failed_dns_request = 0
mysql:driver_errors = 0
registrar:accepted_regs = 0
registrar:default_expire = 3600
registrar:default_expires_range = 0
registrar:expires_range = 0
registrar:max_contacts = 0
registrar:max_expires = 3600
registrar:rejected_regs = 0
shmem:fragments = 33244
shmem:free_size = 261538896
shmem:max_used_size = 13272808
shmem:real_used_size = 6896560
shmem:total_size = 268435456
shmem:used_size = 4965032
sl:1xx_replies = 0
sl:200_replies = 493
sl:202_replies = 0
sl:2xx_replies = 0
sl:300_replies = 0
sl:301_replies = 0
sl:302_replies = 0
sl:3xx_replies = 0
sl:400_replies = 0
sl:401_replies = 0
sl:403_replies = 0
sl:404_replies = 0
sl:407_replies = 0
sl:408_replies = 0
sl:483_replies = 0
sl:4xx_replies = 0
sl:500_replies = 0
sl:5xx_replies = 35
sl:6xx_replies = 0
sl:failures = 0
sl:received_ACKs = 35
sl:sent_err_replies = 0
sl:sent_replies = 395117
sl:xxx_replies = 394589
tcp:con_reset = 0
tcp:con_timeout = 0
tcp:connect_failed = 0
tcp:connect_success = 0
tcp:current_opened_connections = 0
tcp:current_write_queue_size = 0
tcp:established = 0
tcp:local_reject = 0
tcp:passive_open = 0
tcp:send_timeout = 0
tcp:sendq_full = 0
tmx:2xx_transactions = 852998
tmx:3xx_transactions = 0
tmx:4xx_transactions = 984
tmx:5xx_transactions = 3
tmx:6xx_transactions = 0
tmx:UAC_transactions = 2
tmx:UAS_transactions = 789109
tmx:active_transactions = 5
tmx:inuse_transactions = 6
tmx:local_replies = 394546
tmx:received_replies = 853985
tmx:relayed_replies = 459439
usrloc:location-contacts = 0
usrloc:location-expires = 0
usrloc:location-users = 0
usrloc:registered_users = 0
---
{
entry: 0
pid: 12029
rank: 0
used: 1162024
free: 32149056
real_used: 1405376
total_size: 33554432
total_frags: 46
}
{
entry: 1
pid: 12039
rank: 1
used: 13425600
free: 148336
real_used: 33406096
total_size: 33554432
total_frags: 20
}
{
entry: 2
pid: 12040
rank: 2
used: 13447016
free: 290776
real_used: 33263656
total_size: 33554432
total_frags: 20
}
{
entry: 3
pid: 12041
rank: 3
used: 13395480
free: 336992
real_used: 33217440
total_size: 33554432
total_frags: 20
}
{
entry: 4
pid: 12043
rank: 4
used: 13406432
free: 338808
real_used: 33215624
total_size: 33554432
total_frags: 20
}
{
entry: 5
pid: 12045
rank: 5
used: 13407640
free: 348240
real_used: 33206192
total_size: 33554432
total_frags: 20
}
{
entry: 6
pid: 12047
rank: 6
used: 13467776
free: 70320
real_used: 33484112
total_size: 33554432
total_frags: 33
}
{
entry: 7
pid: 12049
rank: 7
used: 13499392
free: 456
real_used: 33553976
total_size: 33554432
total_frags: 13
}
{
entry: 8
pid: 12051
rank: 8
used: 13500280
free: 52656
real_used: 33501776
total_size: 33554432
total_frags: 34
}
{
entry: 9
pid: 12053
rank: 9
used: 13517776
free: 57560
real_used: 33496872
total_size: 33554432
total_frags: 33
}
{
entry: 10
pid: 12055
rank: 10
used: 13408680
free: 298256
real_used: 33256176
total_size: 33554432
total_frags: 20
}
{
entry: 11
pid: 12057
rank: 11
used: 13375864
free: 517608
real_used: 33036824
total_size: 33554432
total_frags: 33
}
{
entry: 12
pid: 12059
rank: 12
used: 13426496
free: 181544
real_used: 33372888
total_size: 33554432
total_frags: 19
}
{
entry: 13
pid: 12061
rank: 13
used: 13437960
free: 153112
real_used: 33401320
total_size: 33554432
total_frags: 38
}
{
entry: 14
pid: 12063
rank: 14
used: 13428744
free: 335984
real_used: 33218448
total_size: 33554432
total_frags: 33
}
{
entry: 15
pid: 12066
rank: 15
used: 13508216
free: 312
real_us
Re: [SR-Users] out of memory Error
Hello;
at second test , after 34 calls , there is no problem about out of
memory. it is still continue with 1100 active calls. i am gonna test it
until 1 000 000 calls. Here is results at 340 000 calls
-- pkg --
{
entry: 0
pid: 12029
rank: 0
used: 1162024
free: 32149056
real_used: 1405376
total_size: 33554432
total_frags: 46
}
{
entry: 1
pid: 12039
rank: 1
used: 11740024
free: 4488648
real_used: 29065784
total_size: 33554432
total_frags: 57
}
{
entry: 2
pid: 12040
rank: 2
used: 11752360
free: 4675784
real_used: 28878648
total_size: 33554432
total_frags: 29
}
{
entry: 3
pid: 12041
rank: 3
used: 11740752
free: 4667680
real_used: 28886752
total_size: 33554432
total_frags: 39
}
{
entry: 4
pid: 12043
rank: 4
used: 11715240
free: 4737320
real_used: 28817112
total_size: 33554432
total_frags: 30
}
{
entry: 5
pid: 12045
rank: 5
used: 11701784
free: 4754696
real_used: 28799736
total_size: 33554432
total_frags: 55
}
{
entry: 6
pid: 12047
rank: 6
used: 11777872
free: 4505176
real_used: 29049256
total_size: 33554432
total_frags: 55
}
{
entry: 7
pid: 12049
rank: 7
used: 11796656
free: 4418128
real_used: 29136304
total_size: 33554432
total_frags: 39
}
{
entry: 8
pid: 12051
rank: 8
used: 11791968
free: 4491696
real_used: 29062736
total_size: 33554432
total_frags: 25
}
{
entry: 9
pid: 12053
rank: 9
used: 11789488
free: 4577672
real_used: 28976760
total_size: 33554432
total_frags: 54
}
{
entry: 10
pid: 12055
rank: 10
used: 11723864
free: 4687256
real_used: 28867176
total_size: 33554432
total_frags: 29
}
{
entry: 11
pid: 12057
rank: 11
used: 11722488
free: 4819504
real_used: 28734928
total_size: 33554432
total_frags: 29
}
{
entry: 12
pid: 12059
rank: 12
used: 11718304
free: 4652776
real_used: 28901656
total_size: 33554432
total_frags: 41
}
{
entry: 13
pid: 12061
rank: 13
used: 11737904
free: 4574264
real_used: 28980168
total_size: 33554432
total_frags: 29
}
{
entry: 14
pid: 12063
rank: 14
used: 11737096
free: 4709864
real_used: 28844568
total_size: 33554432
total_frags: 73
}
{
entry: 15
pid: 12066
rank: 15
used: 11860720
free: 4321360
real_used: 29233072
total_size: 33554432
total_frags: 72
}
{
entry: 16
pid: 12068
rank: 16
used: 11762576
free: 4509944
real_used: 29044488
total_size: 33554432
total_frags: 35
}
{
entry: 17
pid: 12070
rank: 17
used: 11779400
free: 4494744
real_used: 29059688
total_size: 33554432
total_frags: 43
}
{
entry: 18
pid: 12072
rank: 18
used: 11759048
free: 4522208
real_used: 29032224
total_size: 33554432
total_frags: 30
}
{
entry: 19
pid: 12074
rank: 19
used: 11761112
free: 4629176
real_used: 28925256
total_size: 33554432
total_frags: 59
}
{
entry: 20
pid: 12076
rank: 20
used: 11748240
free: 4576248
real_used: 28978184
total_size: 33554432
total_frags: 56
}
{
entry: 21
pid: 12078
rank: 21
used: 11741656
free: 4666944
real_used: 28887488
total_size: 33554432
total_frags: 36
}
{
entry: 22
pid: 12080
rank: 22
used: 11748864
free: 4591472
real_used: 28962960
total_size: 33554432
total_frags: 20
}
{
entry: 23
pid: 12082
rank: 23
used: 11734256
free: 4643824
real_used: 28910608
total_size: 33554432
total_frags: 30
}
{
entry: 24
pid: 12084
rank: 24
used: 11722608
free: 4638448
real_used: 28915984
total_size: 33554432
total_frags: 30
}
{
entry: 25
pid: 12086
rank: 25
used: 11682424
free: 4793096
real_used: 28761336
total_size: 33554432
total_frags: 38
}
{
[SR-Users] out of memory Error
Hello All; Kamailio V4.3.2 gives errors "out of memory" after 339000 calls.my server has centos 6.6 and 2.6.32-573.3.1.el6.x86_64 kernel version. How can we solve this problem. do i set memdb=1 and then try again? Thanks Starting with this error; Sep 24 12:38:50 localhost /usr/local/sbin/kamailio[3518]: ERROR: [msg_translator.c:2127]: build_req_buf_from_sip_req(): out of memory Sep 24 12:38:50 localhost /usr/local/sbin/kamailio[3518]: ERROR: [forward.c:548]: forward_request(): building failed Sep 24 12:38:50 localhost /usr/local/sbin/kamailio[3518]: ERROR: sl [sl_funcs.c:363]: sl_reply_error(): ERROR: sl_reply_error used: No error (2/SL) Sep 24 12:39:06 localhost /usr/local/sbin/kamailio[3514]: ERROR: [parser/parse_rr.c:63]: do_parse_rr_body(): parse_rr(): No memory left .. .. .. Sep 24 12:39:02 localhost /usr/local/sbin/kamailio[3484]: ERROR: [parser/msg_parser.c:329]: parse_headers(): ERROR:parse_headers: memory allocation error Sep 24 12:39:02 localhost /usr/local/sbin/kamailio[3484]: ERROR: dialog [dlg_handlers.c:208]: populate_leg_info(): bad sip message or missing Contact hdr Sep 24 12:39:02 localhost /usr/local/sbin/kamailio[3484]: ERROR: dialog [dlg_handlers.c:488]: dlg_onreply(): could not add further info to the dialog Sep 24 12:39:02 localhost /usr/local/sbin/kamailio[3484]: ERROR: acc [acc_extra.c:267]: extra2strar(): extra2strar: out of memory. Sep 24 12:39:02 localhost /usr/local/sbin/kamailio[3484]: ERROR: acc [acc_extra.c:267]: extra2strar(): extra2strar: out of memory. .. .. .. Sep 24 12:39:06 localhost /usr/local/sbin/kamailio[3514]: ERROR: [parser/parse_rr.c:360]: print_rr_body(): failed to parse RR Sep 24 12:39:06 localhost /usr/local/sbin/kamailio[3514]: ERROR: dialog [dlg_handlers.c:239]: populate_leg_info(): failed to print route records Sep 24 12:39:06 localhost /usr/local/sbin/kamailio[3514]: ERROR: dialog [dlg_handlers.c:488]: dlg_onreply(): could not add further info to the dialog Sep 24 12:39:06 localhost /usr/local/sbin/kamailio[3514]: ERROR: acc [acc_extra.c:267]: extra2strar(): extra2strar: out of memory. Sep 24 12:39:06 localhost /usr/local/sbin/kamailio[3514]: ERROR: acc [acc_extra.c:267]: extra2strar(): extra2strar: out of memory. ... ... Going like that. -- kamailio.cfg #!KAMAILIO #!define WITH_MYSQL #!define WITH_AUTH #!define WITH_CARR #!define WITH_ACC ##!define WITH_ACCDB #!define WITH_DIALOG #!define WITH_ACCDB_COMMENT #!define WITH_IPAUTH #!define WITH_MULTIDOMAIN #!define WITH_SAYAC ##!define WITH_BLCKLST #!define WITH_NAT #!define WITH_UTILS #!define WITH_RECORDR ##!define WITH_JSN ##!define WITH_XMLRPC ##!define WITH_PIKE #!define WITH_RAD ### LOG Levels: 3=DBG, 2=INFO, 1=NOTICE, 0=WARN, -1=ERR #!ifdef WITH_DEBUG debug=4 log_stderror=yes #!else debug=0 log_stderror=no #!endif memdbg=5 memlog=5 log_facility=LOG_LOCAL0 fork=yes children=64 disable_sctp=yes udp4_raw = on port=5061 #!ifdef WITH_TLS enable_tls=yes #!endif # life time of TCP connection when there is no traffic # - a bit higher than registration expires to cope with UA behind NAT tcp_connection_lifetime=3605 ### Custom Parameters # # These parameters can be modified runtime via RPC interface # - see the documentation of 'cfg_rpc' module. # # Format: group.id = value 'desc' description # Access: $sel(cfg_get.group.id) or @cfg_get.group.id # ### Modules Section # set paths to location of modules (to sources or installation folders) #!ifdef WITH_SRCPATH mpath="modules/" #!else mpath="/usr/local/lib64/kamailio/modules/" #!endif #!ifdef WITH_MYSQL loadmodule "db_mysql.so" #!endif loadmodule "mi_fifo.so" loadmodule "kex.so" loadmodule "corex.so" loadmodule "tm.so" loadmodule "tmx.so" loadmodule "sl.so" #!ifdef WITH_RECORDR loadmodule "rr.so" #!endif loadmodule "pv.so" loadmodule "maxfwd.so" loadmodule "usrloc.so" loadmodule "registrar.so" loadmodule "textops.so" loadmodule "siputils.so" loadmodule "xlog.so" loadmodule "sanity.so" loadmodule "ctl.so" loadmodule "cfg_rpc.so" loadmodule "mi_rpc.so" loadmodule "acc.so" loadmodule "db_flatstore.so" #!ifdef WITH_RAD loadmodule "misc_radius.so" lo
Re: [SR-Users] Out of Memory Error in Kamailio
Hello, On 04/02/15 16:06, Neeraj Swarnkar wrote: > Hi Guys, > > I am using Kamailio-4.2.1. Earlier I was using shared memory of 16GB, > which started popping out of memory error, within few seconds of > generating load from sipp. > > I used sipp following command: > > sipp -s MY_KAM_IP -l 2500 -r 50 > > */Error coming is :/* > */Feb 4 14:12:23 kamailio_us_ha1 /usr/local/sbin/kamailio[27389]: > ERROR: tm [t_reply.c:1946]: relay_reply(): ERROR: relay_reply: cannot > alloc reply shmem/* > > > > After changing the shared memory to 1 GB, this error came quite late when > generate load at 200 CPS. > sipp -s MY_KAM_IP -l 2500 -r 200 > > Why this is happening? > I am using following configuration file( kamailio.cfg). Earliest > possible help will be appreciated a lot!! Can you give the command you use to start kamailio? Also, once you get the out of memory errors, grab the output of: kamctl stats and send it here. Cheers, Daniel -- Daniel-Constantin Mierla http://twitter.com/#!/miconda - http://www.linkedin.com/in/miconda Kamailio World Conference, May 27-29, 2015 Berlin, Germany - http://www.kamailioworld.com ___ SIP Express Router (SER) and Kamailio (OpenSER) - sr-users mailing list sr-users@lists.sip-router.org http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users
[SR-Users] Out of Memory Error in Kamailio
Hi Guys, I am using Kamailio-4.2.1. Earlier I was using shared memory of 16GB, which started popping out of memory error, within few seconds of generating load from sipp. I used sipp following command: sipp -s MY_KAM_IP -l 2500 -r 50 *Error coming is :* *Feb 4 14:12:23 kamailio_us_ha1 /usr/local/sbin/kamailio[27389]: ERROR: tm [t_reply.c:1946]: relay_reply(): ERROR: relay_reply: cannot alloc reply shmem* After changing the shared memory to 1 GB, this error came quite late when generate load at 200 CPS. sipp -s MY_KAM_IP -l 2500 -r 200 Why this is happening? I am using following configuration file( kamailio.cfg). Earliest possible help will be appreciated a lot!! #!KAMAILIO # # Kamailio (OpenSER) SIP Server v4.0 - default configuration script # - web: http://www.kamailio.org # - git: http://sip-router.org # # Direct your questions about this file to: # # Refer to the Core CookBook at http://www.kamailio.org/wiki/ # for an explanation of possible statements, functions and parameters. # # Several features can be enabled using '#!define WITH_FEATURE' directives: # # *** To run in debug mode: # - define WITH_DEBUG # # *** To enable mysql: # - define WITH_MYSQL # # *** To enable authentication execute: # - enable mysql # - define WITH_AUTH # - add users using 'kamctl' # # *** To enable IP authentication execute: # - enable mysql # - enable authentication # - define WITH_IPAUTH # - add IP addresses with group id '1' to 'address' table # # *** To enable persistent user location execute: # - enable mysql # - define WITH_USRLOCDB # # *** To enable nat traversal execute: # - define WITH_NAT # - install RTPProxy: http://www.rtpproxy.org # - start RTPProxy: #rtpproxy -l _your_public_ip_ -s udp:localhost:7722 # # *** To enable TLS support execute: # - adjust CFGDIR/tls.cfg as needed # - define WITH_TLS # # *** To enhance accounting execute: # - enable mysql # - define WITH_ACCDB # - add following columns to database # define WITH_LCR to enable LCR # define WITH_CR to enable carrier route #!define WITH_MYSQL #!define DBURL #!define WITH_USRLOCDB #!define WITH_FREESWITCH #!define WITH_ACCDB #!define WITH_AUTH #!define WITH_DEBUG #!define WITH_NAT ##!define WITH_ANTIFLOOD #!define WITH_CR #!ifdef WITH_FREESWITCH #freeswitch.bindip = "10.60.23.81" desc "FreeSWITCH IP Address" freeswitch.bindip = "54.254.97.209" desc "FreeSWITCH IP Address" freeswitch.bindport = "5060" desc "FreeSWITCH Port" #!endif #!ifdef ACCDB_COMMENT ALTER TABLE acc ADD COLUMN src_user VARCHAR(64) NOT NULL DEFAULT ''; ALTER TABLE acc ADD COLUMN src_domain VARCHAR(128) NOT NULL DEFAULT ''; ALTER TABLE acc ADD COLUMN src_ip varchar(64) NOT NULL default ''; ALTER TABLE acc ADD COLUMN dst_ouser VARCHAR(64) NOT NULL DEFAULT ''; ALTER TABLE acc ADD COLUMN dst_user VARCHAR(64) NOT NULL DEFAULT ''; ALTER TABLE acc ADD COLUMN dst_domain VARCHAR(128) NOT NULL DEFAULT ''; ALTER TABLE missed_calls ADD COLUMN src_user VARCHAR(64) NOT NULL DEFAULT ''; ALTER TABLE missed_calls ADD COLUMN src_domain VARCHAR(128) NOT NULL DEFAULT ''; ALTER TABLE missed_calls ADD COLUMN src_ip varchar(64) NOT NULL default ''; ALTER TABLE missed_calls ADD COLUMN dst_ouser VARCHAR(64) NOT NULL DEFAULT ''; ALTER TABLE missed_calls ADD COLUMN dst_user VARCHAR(64) NOT NULL DEFAULT ''; ALTER TABLE missed_calls ADD COLUMN dst_domain VARCHAR(128) NOT NULL DEFAULT ''; #!endif ### Include Local Config If Exists # import_file "kamailio-local.cfg" import_file "ip.cfg" ### Defined Values # # *** Value defines - IDs used later in config #!ifdef WITH_MYSQL # - database URL - used to connect to database server by modules such # as: auth_db, acc, usrloc, a.s.o. #!ifndef DBURL #!define DBURL "mysql:// kamailio:kamaili...@kamailio-us.cejtf390jur8.us-east-1.rds.amazonaws.com/kamailio " #!endif #!endif #!define MULTIDOMAIN 0 # - flags # FLT_ - per transaction (message) flags # FLB_ - per branch flags #!define FLT_ACC 1 #!define FLT_ACCMISSED 2 #!define FLT_ACCFAILED 3 #!define FLT_NATS 5 #!define FLB_NATB 6 #!define FLB_NATSIPPING 7 ### Global Parameters # ### LOG Levels: 3=DBG, 2=INFO, 1=NOTICE, 0=WARN, -1=ERR #!ifdef WITH_DEBUG debug=-1 log_stderror=no #!else debug=-1 log_stderror=no #!endif memdbg=2 memlog=2 log_facility=LOG_LOCAL0 fork=yes children=8 /* uncomment the next line to disable TCP (default on) */ #disable_tcp=yes /* uncomment the next line to disable the auto discovery of local aliases based on reverse DNS on IPs (default on) */ auto_aliases=no /* add local domain aliases */ #alias="sip.mydomain.com" /* uncomment and configure the following line if you want Kamailio to bind on a specific interface/port/proto (default bind on all available) */ #listen=udp:10.0.0.10:5060 #listen=udp:172.31.42.191:5060 advertise 54.254.97.209:5060 listen=LOCAL_BIND_PROTO_IP_UDP_PORT advertise A
