Hi Liviu.
Thank you very much for answering my question and for these hints.
I will talk to my team about to consider using OpenSIPS 2.2+. I will
also read more about "-M" flag and see how should I use it.
I have one more question:
Is there one more opened connection to the Sqlite database every time
when my script executes a qvp_db_query? If yes, these connections
remain opened or it is closed immediately after the query terminates?
What I need to know is if the OpenSIPS is creating too many
connections to the database.
Today, with valgrind I saw this log:
==501== 167,528 (848 direct, 166,680 indirect) bytes in 1 blocks are
definitely lost in loss record 425 of 428
==501== at 0x4C2AB80: malloc (in
/usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==501== by 0x738EDC6: ??? (in
/usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6)
==501== by 0x7369569: ??? (in
/usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6)
==501== by 0x7371C47: ??? (in
/usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6)
==501== by 0x7371C6C: ??? (in
/usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6)
==501== by 0x73EF012: ??? (in
/usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6)
==501== by 0x7132D9A: db_sqlite_connect (my_con.c:62)
==501== by 0x7133314: db_sqlite_new_connection (my_con.c:134)
==501== by 0x5693A3: db_do_init (db.c:309)
==501== by 0x7A5F606: register_udomain (dlist.c:655)
==501== by 0x7C9014D: domain_fixup (reg_mod.c:386)
==501== by 0x7C9014D: registrar_fixup (reg_mod.c:421)
==501== by 0x4A731B: fix_actions (route.c:459)
==501==
==501== 169,216 (848 direct, 168,368 indirect) bytes in 1 blocks are
definitely lost in loss record 426 of 428
==501== at 0x4C2AB80: malloc (in
/usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==501== by 0x738EDC6: ??? (in
/usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6)
==501== by 0x7369569: ??? (in
/usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6)
==501== by 0x7371C47: ??? (in
/usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6)
==501== by 0x7371C6C: ??? (in
/usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6)
==501== by 0x73EF012: ??? (in
/usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6)
==501== by 0x7132D9A: db_sqlite_connect (my_con.c:62)
==501== by 0x7133314: db_sqlite_new_connection (my_con.c:134)
==501== by 0x5693A3: db_do_init (db.c:309)
==501== by 0x643CFF4: domain_db_init (domain.c:65)
==501== by 0x643E8C8: mod_init (domain_mod.c:232)
==501== by 0x4C8EF8: init_mod (sr_module.c:632)
==501==
==501== 328,352 (1,696 direct, 326,656 indirect) bytes in 2 blocks are
definitely lost in loss record 427 of 428
==501== at 0x4C2AB80: malloc (in
/usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so)
==501== by 0x738EDC6: ??? (in
/usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6)
==501== by 0x7369569: ??? (in
/usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6)
==501== by 0x7371C47: ??? (in
/usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6)
==501== by 0x7371C6C: ??? (in
/usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6)
==501== by 0x73EF012: ??? (in
/usr/lib/x86_64-linux-gnu/libsqlite3.so.0.8.6)
==501== by 0x7132D9A: db_sqlite_connect (my_con.c:62)
==501== by 0x7133314: db_sqlite_new_connection (my_con.c:134)
==501== by 0x5693A3: db_do_init (db.c:309)
==501== by 0x8577C0E: auth_fixup (authdb_mod.c:257)
==501== by 0x4A731B: fix_actions (route.c:459)
==501== by 0x4AA7EF: fix_expr (route.c:214)
==501==
==501== LEAK SUMMARY:
==501== definitely lost: 4,708 bytes in 8 blocks
==501== indirectly lost: 825,032 bytes in 6,077 blocks
==501== possibly lost: 328,824 bytes in 2,431 blocks
==501== still reachable: 4,259,419 bytes in 234 blocks
==501== suppressed: 0 bytes in 0 blocks
==501== Reachable blocks (those to which a pointer was found) are not
shown.
==501== To see them, rerun with: --leak-check=full --show-leak-kinds=all
Any hint will be very helpful!
Best regards.
RODRIGO PIMENTA CARVALHO
Inatel Competence Center
Software
Ph: +55 35 3471 9200 RAMAL 979
------------------------------------------------------------------------
*De:* users-boun...@lists.opensips.org
<users-boun...@lists.opensips.org> em nome de Liviu Chircu
<li...@opensips.org>
*Enviado:* sexta-feira, 15 de abril de 2016 11:20
*Para:* users@lists.opensips.org
*Assunto:* Re: [OpenSIPS-Users] How to avoid increasingly memory
comsuption with AVPs?
Hi Rodrigo,
That's actually PKG memory, so you should fine tune the "-M" parameter
according to your data and any instructions found in the SQLite module.
As a side note, newer versions of OpenSIPS (2.2+) will properly
indicate which type of memory you ran out of, so troubleshooting
memory issues will become easier if you do the upgrade.
Liviu Chircu
OpenSIPS Developer
http://www.opensips-solutions.com
<http://www.opensips-solutions.com/>
Home — OpenSIPS Solutions <http://www.opensips-solutions.com/>
www.opensips-solutions.com
OpenSIPS is a mature Open Source implementation of a SIP server.
OpenSIPS is more than a SIP proxy/router as it includes
application-level functionalities.
On 15.04.2016 16:50, Rodrigo Pimenta Carvalho wrote:
Hi.
After a stress test with my OpenSIPS and few user agent clients
on-line, just sending SIP REGISTER messages (1 at each minute), not
making calls, I saw this log:
Apr 15 10:09:20 [20441] WARNING:core:fm_malloc: Not enough free
memory, will attempt defragmentation
Apr 15 10:09:20 [20441] ERROR:db_sqlite:db_sqlite_allocate_rows: no
memory left
Apr 15 10:09:20 [20441] ERROR:db_sqlite:db_sqlite_convert_rows: no
private memory left
Apr 15 10:09:20 [20441] ERROR:db_sqlite:db_sqlite_convert_result:
error while converting rows
Apr 15 10:09:20 [20441] ERROR:db_sqlite:db_sqlite_store_result: error
while converting result
Apr 15 10:09:20 [20441] ERROR:avpops:db_query_avp: raw_query failed:
db0(usr_preferences) select Value from GeneralConfigurations ...
So, I suspect that I have codified something wrong in my opensips.cfg
file.
More precisely, I have used some AVPs and I'm note sure if such use
is correct or if it is the cause of increasingly memory consumption.
For example, I have codified somethings like this:
1 if($avp(I_A) == NULL){
avp_db_query("select Value from
GeneralConfigurations where Attribute =
'CONFIGURATION_INTERCOM_A_NAME'", "$avp(I_A)");
}
.
.
.
2 if ($rU==$avp(M_TU)){
$rU = $avp(M_T);
}
.
.
.
3 if (nat_uac_test("34")) {
if (is_method("REGISTER")) {
fix_nated_register();
setbflag(NAT);
$avp(attr) = "in_another_network";
} else {
fix_nated_contact();
setflag(NAT);
}
}
.
.
.
4 $avp(ContatoRegister) = $(ct.fields(uri){s.select,0,;});
if($fn != NULL){
avp_db_query("UPDATE location SET
callerName='$fn' where contact like '$avp(ContatoRegister)%'");
}
$avp(ContatoRegister) = NULL;
Could some of the 4 piece of codes above causes some increasingly
memory consumption?
Any hint will be very helpful!
Best regards.
RODRIGO PIMENTA CARVALHO
Inatel Competence Center
Software
Ph: +55 35 3471 9200 RAMAL 979
_______________________________________________
Users mailing list
Users@lists.opensips.org
http://lists.opensips.org/cgi-bin/mailman/listinfo/users
_______________________________________________
Users mailing list
Users@lists.opensips.org
http://lists.opensips.org/cgi-bin/mailman/listinfo/users
