Re: [OpenSIPS-Users] Not enough free memory, will atempt defragmenation
Hi again, A new mem error, maybe you are interested Aug 24 06:59:50 test /usr/local/sbin/opensips[1324]: SUBSCRIBE : SUBSCRIBE -- b6874def55c7f5cf8e4d61b4cc4095c9-f985 -- e170995a-- Aug 24 06:59:50 test /usr/local/sbin/opensips[1324]: ERROR:presence:send_2XX_reply: No more pkg memory Aug 24 06:59:50 test /usr/local/sbin/opensips[1324]: CRITICAL:core:qm_free: bad pointer (nil) (out of memory block!) - aborting Dani On 08/19/11 17:31, Bogdan-Andrei Iancu wrote: Hi Dani, You can not have comments in multi-line assignments So, instead of DEFS+= $(extra_defs) \ . -DCHANGEABLE_DEBUG_LEVEL \ #-DF_MALLOC \ -DDBG_QM_MALLOC \ #-DDBG_F_MALLOC \ you should do : DEFS+= $(extra_defs) \ . -DCHANGEABLE_DEBUG_LEVEL \ -DDBG_QM_MALLOC \ #-DF_MALLOC \ #-DDBG_F_MALLOC \ BTW, once you compiled in the DBG support, set: memlog=6 memdump=1 in order to get only the memory dump without all runtime logs from mem debugger. Regards, Bogdan On 08/19/2011 01:13 PM, Dani Popa wrote: Hi, True, i changed wrong the Makefiles.defs. I dont know if you need this: if i change Makefile.defs as: DEFS+= $(extra_defs) \ . . . . -DCHANGEABLE_DEBUG_LEVEL \ #-DF_MALLOC \ -DDBG_QM_MALLOC \ #-DDBG_F_MALLOC \ opensips will not be compiled with -DDBG_QM_MALLOC I'll come back with goodies, Thanks, Dani On 08/19/11 12:01, Vlad Paiu wrote: Hello, Thanks for the reply. Unfortunately, It seems that you have not compiled OpenSIPS with -DDBG_QM_MALLOC, so please review my last email and see that I also suggested editing Makefiles.defs and uncommenting that particular line, while commenting -DF_MALLOC. If you succesfully do this, opensips -V should show something like : . SHM_MEM, SHM_MMAP, PKG_MALLOC, DBG_QM_MALLOC . Please do this and return with the logs at shutdown. Thank you. Regards, ___ Users mailing list Users@lists.opensips.org http://lists.opensips.org/cgi-bin/mailman/listinfo/users ___ Users mailing list Users@lists.opensips.org http://lists.opensips.org/cgi-bin/mailman/listinfo/users
Re: [OpenSIPS-Users] Not enough free memory, will atempt defragmenation
Hello Dani, About the memory log that you sent.. I see no obvious memory leak. So as far as I can see, there are two possibilities - something really needs that much PKG. To make sure that this isn't the case, please increase your PKG_MEM_POOL_SIZE to a higher value and let us know if you still experience the same problem. - at shutdown, that extra bogus memory is freed up and doesn't show up anymore in the memory dump. Please try first increasing the memory and see if OpenSIPS is still reporting out of mem problems. About the second issue with bad pointer (nil) (out of memory block!) - aborting , there was a bug in OpenSIPS which lead to the calling of free(0), in a no more pkg situation. This has been fixed in trunk, 1.7 and 1.6 branches. Regards, -- Vlad Paiu OpenSIPS Developer On 08/24/2011 02:40 PM, Dani Popa wrote: Hi again, A new mem error, maybe you are interested Aug 24 06:59:50 test /usr/local/sbin/opensips[1324]: SUBSCRIBE : SUBSCRIBE -- b6874def55c7f5cf8e4d61b4cc4095c9-f985 -- e170995a-- Aug 24 06:59:50 test /usr/local/sbin/opensips[1324]: ERROR:presence:send_2XX_reply: No more pkg memory Aug 24 06:59:50 test /usr/local/sbin/opensips[1324]: CRITICAL:core:qm_free: bad pointer (nil) (out of memory block!) - aborting Dani On 08/19/11 17:31, Bogdan-Andrei Iancu wrote: Hi Dani, You can not have comments in multi-line assignments So, instead of DEFS+= $(extra_defs) \ . -DCHANGEABLE_DEBUG_LEVEL \ #-DF_MALLOC \ -DDBG_QM_MALLOC \ #-DDBG_F_MALLOC \ you should do : DEFS+= $(extra_defs) \ . -DCHANGEABLE_DEBUG_LEVEL \ -DDBG_QM_MALLOC \ #-DF_MALLOC \ #-DDBG_F_MALLOC \ BTW, once you compiled in the DBG support, set: memlog=6 memdump=1 in order to get only the memory dump without all runtime logs from mem debugger. Regards, Bogdan On 08/19/2011 01:13 PM, Dani Popa wrote: Hi, True, i changed wrong the Makefiles.defs. I dont know if you need this: if i change Makefile.defs as: DEFS+= $(extra_defs) \ . . . . -DCHANGEABLE_DEBUG_LEVEL \ #-DF_MALLOC \ -DDBG_QM_MALLOC \ #-DDBG_F_MALLOC \ opensips will not be compiled with -DDBG_QM_MALLOC I'll come back with goodies, Thanks, Dani On 08/19/11 12:01, Vlad Paiu wrote: Hello, Thanks for the reply. Unfortunately, It seems that you have not compiled OpenSIPS with -DDBG_QM_MALLOC, so please review my last email and see that I also suggested editing Makefiles.defs and uncommenting that particular line, while commenting -DF_MALLOC. If you succesfully do this, opensips -V should show something like : . SHM_MEM, SHM_MMAP, PKG_MALLOC, DBG_QM_MALLOC . Please do this and return with the logs at shutdown. Thank you. Regards, ___ Users mailing list Users@lists.opensips.org http://lists.opensips.org/cgi-bin/mailman/listinfo/users ___ Users mailing list Users@lists.opensips.org http://lists.opensips.org/cgi-bin/mailman/listinfo/users ___ Users mailing list Users@lists.opensips.org http://lists.opensips.org/cgi-bin/mailman/listinfo/users
Re: [OpenSIPS-Users] Not enough free memory, will atempt defragmenation
Hi, Thanks for your response. Right now PKG_MEM_POOL_SIZE is 8*1024*1024 and i have 33 users online using presence(it's right that any expire timers regarding publish and notify are 60 seconds instead 3600 as it is in documentation) . What value should i use for let's say, 100k users using presence ? I will configure a separate presence server to check if the problem is related to presence. Dani On 08/24/11 16:40, Vlad Paiu wrote: Hello Dani, About the memory log that you sent.. I see no obvious memory leak. So as far as I can see, there are two possibilities - something really needs that much PKG. To make sure that this isn't the case, please increase your PKG_MEM_POOL_SIZE to a higher value and let us know if you still experience the same problem. - at shutdown, that extra bogus memory is freed up and doesn't show up anymore in the memory dump. Please try first increasing the memory and see if OpenSIPS is still reporting out of mem problems. About the second issue with bad pointer (nil) (out of memory block!) - aborting , there was a bug in OpenSIPS which lead to the calling of free(0), in a no more pkg situation. This has been fixed in trunk, 1.7 and 1.6 branches. Regards, ___ Users mailing list Users@lists.opensips.org http://lists.opensips.org/cgi-bin/mailman/listinfo/users
Re: [OpenSIPS-Users] Not enough free memory, will atempt defragmenation
Hi, I think now the logs should be fine and you can find them at: http://92.55.132.13/loca7.log_v1.tar.gz root@test:/var/log# opensips -V version: opensips 1.6.4-2-tls (i386/linux) flags: STATS: Off, USE_IPV6, USE_TCP, USE_TLS, USE_SCTP, DISABLE_NAGLE, USE_MCAST, SHM_MEM, SHM_MMAP, PKG_MALLOC, DBG_QM_MALLOC, FAST_LOCK-ADAPTIVE_WAIT ADAPTIVE_WAIT_LOOPS=1024, MAX_RECV_BUFFER_SIZE 262144, MAX_LISTEN 16, MAX_URI_SIZE 1024, BUF_SIZE 65535 poll method support: poll, epoll_lt, epoll_et, sigio_rt, select. svnrevision: 2:8256M @(#) $Id: main.c 7530 2010-12-13 19:07:53Z bogdan_iancu $ main.c compiled on 05:48:37 Aug 19 2011 with gcc 4.5.2 Thanks, Dani Popa On 08/19/11 17:31, Bogdan-Andrei Iancu wrote: Hi Dani, You can not have comments in multi-line assignments So, instead of DEFS+= $(extra_defs) \ . -DCHANGEABLE_DEBUG_LEVEL \ #-DF_MALLOC \ -DDBG_QM_MALLOC \ #-DDBG_F_MALLOC \ you should do : DEFS+= $(extra_defs) \ . -DCHANGEABLE_DEBUG_LEVEL \ -DDBG_QM_MALLOC \ #-DF_MALLOC \ #-DDBG_F_MALLOC \ BTW, once you compiled in the DBG support, set: memlog=6 memdump=1 in order to get only the memory dump without all runtime logs from mem debugger. Regards, Bogdan On 08/19/2011 01:13 PM, Dani Popa wrote: Hi, True, i changed wrong the Makefiles.defs. I dont know if you need this: if i change Makefile.defs as: DEFS+= $(extra_defs) \ . . . . -DCHANGEABLE_DEBUG_LEVEL \ #-DF_MALLOC \ -DDBG_QM_MALLOC \ #-DDBG_F_MALLOC \ opensips will not be compiled with -DDBG_QM_MALLOC I'll come back with goodies, Thanks, Dani On 08/19/11 12:01, Vlad Paiu wrote: Hello, Thanks for the reply. Unfortunately, It seems that you have not compiled OpenSIPS with -DDBG_QM_MALLOC, so please review my last email and see that I also suggested editing Makefiles.defs and uncommenting that particular line, while commenting -DF_MALLOC. If you succesfully do this, opensips -V should show something like : . SHM_MEM, SHM_MMAP, PKG_MALLOC, DBG_QM_MALLOC . Please do this and return with the logs at shutdown. Thank you. Regards, ___ Users mailing list Users@lists.opensips.org http://lists.opensips.org/cgi-bin/mailman/listinfo/users ___ Users mailing list Users@lists.opensips.org http://lists.opensips.org/cgi-bin/mailman/listinfo/users
Re: [OpenSIPS-Users] Not enough free memory, will atempt defragmenation
Hi, Where should i find memory dump ? I have something in logs about memory. I'll attach an file. Please let me know if this is what you need. I also increased PKG_MEM_POOL_SIZE = 8 *1024 * 1024, and shared mem to 256, and also updated opensips 1.6.4 to latest svn revision, i think. root@test:/home/danip/opensips_1_6# opensipsctl fifo get_statistics all | grep shmem shmem:total_size = 268435456 shmem:used_size = 2084688 shmem:real_used_size = 2221616 shmem:max_used_size = 3095312 shmem:free_size = 266213840 shmem:fragments = 796 root@test:/home/danip/opensips_1_6# opensips -V version: opensips 1.6.4-2-tls (i386/linux) flags: STATS: Off, USE_IPV6, USE_TCP, USE_TLS, USE_SCTP, DISABLE_NAGLE, USE_MCAST, SHM_MEM, SHM_MMAP, PKG_MALLOC, FAST_LOCK-ADAPTIVE_WAIT ADAPTIVE_WAIT_LOOPS=1024, MAX_RECV_BUFFER_SIZE 262144, MAX_LISTEN 16, MAX_URI_SIZE 1024, BUF_SIZE 65535 poll method support: poll, epoll_lt, epoll_et, sigio_rt, select. svnrevision: 2:8256M @(#) $Id: main.c 7530 2010-12-13 19:07:53Z bogdan_iancu $ main.c compiled on 13:13:09 Aug 17 2011 with gcc 4.5.2 Please let me know how i can help more. logs about memory you can find at http://92.55.132.13/local7.log.mem.tar.gz, i tried to send on list but the attach was too big. Thanks, Dani On 08/04/11 18:26, Vlad Paiu wrote: Hello, Is it possible that you upgrade to 1.7 ? It is possible that this issue was fixed in the latest OpenSIPS version. If not, go to Makefile.defs, uncomment the line with -DDBG_QM_MALLOC \ and comment the line with -DF_MALLOC \ and then recompile OpenSIPS. Also set memlog=1 in your OpenSIPS cfg, and when the memory get's filled up you can either shutdown the proxy or send a SIGUSR1 signal to the attendant to get a memory dump. Please return with the memory dump and we will try to help. Regards, ___ Users mailing list Users@lists.opensips.org http://lists.opensips.org/cgi-bin/mailman/listinfo/users
Re: [OpenSIPS-Users] Not enough free memory, will atempt defragmenation
Hello, Thanks for the reply. Unfortunately, It seems that you have not compiled OpenSIPS with -DDBG_QM_MALLOC, so please review my last email and see that I also suggested editing Makefiles.defs and uncommenting that particular line, while commenting -DF_MALLOC. If you succesfully do this, opensips -V should show something like : . SHM_MEM, SHM_MMAP, PKG_MALLOC, DBG_QM_MALLOC . Please do this and return with the logs at shutdown. Thank you. Regards, -- Vlad Paiu OpenSIPS Developer On 08/19/2011 11:47 AM, Dani Popa wrote: Hi, Where should i find memory dump ? I have something in logs about memory. I'll attach an file. Please let me know if this is what you need. I also increased PKG_MEM_POOL_SIZE = 8 *1024 * 1024, and shared mem to 256, and also updated opensips 1.6.4 to latest svn revision, i think. root@test:/home/danip/opensips_1_6# opensipsctl fifo get_statistics all | grep shmem shmem:total_size = 268435456 shmem:used_size = 2084688 shmem:real_used_size = 2221616 shmem:max_used_size = 3095312 shmem:free_size = 266213840 shmem:fragments = 796 root@test:/home/danip/opensips_1_6# opensips -V version: opensips 1.6.4-2-tls (i386/linux) flags: STATS: Off, USE_IPV6, USE_TCP, USE_TLS, USE_SCTP, DISABLE_NAGLE, USE_MCAST, SHM_MEM, SHM_MMAP, PKG_MALLOC, FAST_LOCK-ADAPTIVE_WAIT ADAPTIVE_WAIT_LOOPS=1024, MAX_RECV_BUFFER_SIZE 262144, MAX_LISTEN 16, MAX_URI_SIZE 1024, BUF_SIZE 65535 poll method support: poll, epoll_lt, epoll_et, sigio_rt, select. svnrevision: 2:8256M @(#) $Id: main.c 7530 2010-12-13 19:07:53Z bogdan_iancu $ main.c compiled on 13:13:09 Aug 17 2011 with gcc 4.5.2 Please let me know how i can help more. logs about memory you can find at http://92.55.132.13/local7.log.mem.tar.gz, i tried to send on list but the attach was too big. Thanks, Dani On 08/04/11 18:26, Vlad Paiu wrote: Hello, Is it possible that you upgrade to 1.7 ? It is possible that this issue was fixed in the latest OpenSIPS version. If not, go to Makefile.defs, uncomment the line with -DDBG_QM_MALLOC \ and comment the line with -DF_MALLOC \ and then recompile OpenSIPS. Also set memlog=1 in your OpenSIPS cfg, and when the memory get's filled up you can either shutdown the proxy or send a SIGUSR1 signal to the attendant to get a memory dump. Please return with the memory dump and we will try to help. Regards, ___ Users mailing list Users@lists.opensips.org http://lists.opensips.org/cgi-bin/mailman/listinfo/users ___ Users mailing list Users@lists.opensips.org http://lists.opensips.org/cgi-bin/mailman/listinfo/users
Re: [OpenSIPS-Users] Not enough free memory, will atempt defragmenation
Hi again, i also saw that i compiled opensips with libxmlrpc-c3-dev and libxmlrpc-c3 and i was warned somewhere that i'll compile it on my own risk. Now i removed libxmlrpc-c3-dev and libxmlrpc-c3 and i compiled with libxmlrpc-c++4-dev without warnings. Let's see what we will get! Thanks, Dani On 08/19/11 12:01, Vlad Paiu wrote: Hello, Thanks for the reply. Unfortunately, It seems that you have not compiled OpenSIPS with -DDBG_QM_MALLOC, so please review my last email and see that I also suggested editing Makefiles.defs and uncommenting that particular line, while commenting -DF_MALLOC. If you succesfully do this, opensips -V should show something like : . SHM_MEM, SHM_MMAP, PKG_MALLOC, DBG_QM_MALLOC . Please do this and return with the logs at shutdown. Thank you. Regards, ___ Users mailing list Users@lists.opensips.org http://lists.opensips.org/cgi-bin/mailman/listinfo/users
Re: [OpenSIPS-Users] Not enough free memory, will atempt defragmenation
Hi, True, i changed wrong the Makefiles.defs. I dont know if you need this: if i change Makefile.defs as: DEFS+= $(extra_defs) \ . . . . -DCHANGEABLE_DEBUG_LEVEL \ #-DF_MALLOC \ -DDBG_QM_MALLOC \ #-DDBG_F_MALLOC \ opensips will not be compiled with -DDBG_QM_MALLOC I'll come back with goodies, Thanks, Dani On 08/19/11 12:01, Vlad Paiu wrote: Hello, Thanks for the reply. Unfortunately, It seems that you have not compiled OpenSIPS with -DDBG_QM_MALLOC, so please review my last email and see that I also suggested editing Makefiles.defs and uncommenting that particular line, while commenting -DF_MALLOC. If you succesfully do this, opensips -V should show something like : . SHM_MEM, SHM_MMAP, PKG_MALLOC, DBG_QM_MALLOC . Please do this and return with the logs at shutdown. Thank you. Regards, ___ Users mailing list Users@lists.opensips.org http://lists.opensips.org/cgi-bin/mailman/listinfo/users
Re: [OpenSIPS-Users] Not enough free memory, will atempt defragmenation
Hi Dani, You can not have comments in multi-line assignments So, instead of DEFS+= $(extra_defs) \ . -DCHANGEABLE_DEBUG_LEVEL \ #-DF_MALLOC \ -DDBG_QM_MALLOC \ #-DDBG_F_MALLOC \ you should do : DEFS+= $(extra_defs) \ . -DCHANGEABLE_DEBUG_LEVEL \ -DDBG_QM_MALLOC \ #-DF_MALLOC \ #-DDBG_F_MALLOC \ BTW, once you compiled in the DBG support, set: memlog=6 memdump=1 in order to get only the memory dump without all runtime logs from mem debugger. Regards, Bogdan On 08/19/2011 01:13 PM, Dani Popa wrote: Hi, True, i changed wrong the Makefiles.defs. I dont know if you need this: if i change Makefile.defs as: DEFS+= $(extra_defs) \ . . . . -DCHANGEABLE_DEBUG_LEVEL \ #-DF_MALLOC \ -DDBG_QM_MALLOC \ #-DDBG_F_MALLOC \ opensips will not be compiled with -DDBG_QM_MALLOC I'll come back with goodies, Thanks, Dani On 08/19/11 12:01, Vlad Paiu wrote: Hello, Thanks for the reply. Unfortunately, It seems that you have not compiled OpenSIPS with -DDBG_QM_MALLOC, so please review my last email and see that I also suggested editing Makefiles.defs and uncommenting that particular line, while commenting -DF_MALLOC. If you succesfully do this, opensips -V should show something like : . SHM_MEM, SHM_MMAP, PKG_MALLOC, DBG_QM_MALLOC . Please do this and return with the logs at shutdown. Thank you. Regards, ___ Users mailing list Users@lists.opensips.org http://lists.opensips.org/cgi-bin/mailman/listinfo/users -- Bogdan-Andrei Iancu OpenSIPS eBootcamp - 19th of September 2011 OpenSIPS solutions and know-how ___ Users mailing list Users@lists.opensips.org http://lists.opensips.org/cgi-bin/mailman/listinfo/users
Re: [OpenSIPS-Users] Not enough free memory, will atempt defragmenation
Hi, what about this logs: http://92.55.132.13/memdump.log.tar.gz thanks, Dani On 08/19/11 17:31, Bogdan-Andrei Iancu wrote: Hi Dani, You can not have comments in multi-line assignments So, instead of DEFS+= $(extra_defs) \ . -DCHANGEABLE_DEBUG_LEVEL \ #-DF_MALLOC \ -DDBG_QM_MALLOC \ #-DDBG_F_MALLOC \ you should do : DEFS+= $(extra_defs) \ . -DCHANGEABLE_DEBUG_LEVEL \ -DDBG_QM_MALLOC \ #-DF_MALLOC \ #-DDBG_F_MALLOC \ BTW, once you compiled in the DBG support, set: memlog=6 memdump=1 in order to get only the memory dump without all runtime logs from mem debugger. Regards, Bogdan On 08/19/2011 01:13 PM, Dani Popa wrote: Hi, True, i changed wrong the Makefiles.defs. I dont know if you need this: if i change Makefile.defs as: DEFS+= $(extra_defs) \ . . . . -DCHANGEABLE_DEBUG_LEVEL \ #-DF_MALLOC \ -DDBG_QM_MALLOC \ #-DDBG_F_MALLOC \ opensips will not be compiled with -DDBG_QM_MALLOC I'll come back with goodies, Thanks, Dani On 08/19/11 12:01, Vlad Paiu wrote: Hello, Thanks for the reply. Unfortunately, It seems that you have not compiled OpenSIPS with -DDBG_QM_MALLOC, so please review my last email and see that I also suggested editing Makefiles.defs and uncommenting that particular line, while commenting -DF_MALLOC. If you succesfully do this, opensips -V should show something like : . SHM_MEM, SHM_MMAP, PKG_MALLOC, DBG_QM_MALLOC . Please do this and return with the logs at shutdown. Thank you. Regards, ___ Users mailing list Users@lists.opensips.org http://lists.opensips.org/cgi-bin/mailman/listinfo/users ___ Users mailing list Users@lists.opensips.org http://lists.opensips.org/cgi-bin/mailman/listinfo/users
Re: [OpenSIPS-Users] Not enough free memory, will atempt defragmenation
Hi Bogdan, I did and solved compliling opensips with -DDBG_QM_MALLOC. Thanks, Dani On 08/19/11 17:31, Bogdan-Andrei Iancu wrote: Hi Dani, You can not have comments in multi-line assignments So, instead of DEFS+= $(extra_defs) \ . -DCHANGEABLE_DEBUG_LEVEL \ #-DF_MALLOC \ -DDBG_QM_MALLOC \ #-DDBG_F_MALLOC \ you should do : DEFS+= $(extra_defs) \ . -DCHANGEABLE_DEBUG_LEVEL \ -DDBG_QM_MALLOC \ #-DF_MALLOC \ #-DDBG_F_MALLOC \ BTW, once you compiled in the DBG support, set: memlog=6 memdump=1 in order to get only the memory dump without all runtime logs from mem debugger. Regards, Bogdan On 08/19/2011 01:13 PM, Dani Popa wrote: Hi, True, i changed wrong the Makefiles.defs. I dont know if you need this: if i change Makefile.defs as: DEFS+= $(extra_defs) \ . . . . -DCHANGEABLE_DEBUG_LEVEL \ #-DF_MALLOC \ -DDBG_QM_MALLOC \ #-DDBG_F_MALLOC \ opensips will not be compiled with -DDBG_QM_MALLOC I'll come back with goodies, Thanks, Dani On 08/19/11 12:01, Vlad Paiu wrote: Hello, Thanks for the reply. Unfortunately, It seems that you have not compiled OpenSIPS with -DDBG_QM_MALLOC, so please review my last email and see that I also suggested editing Makefiles.defs and uncommenting that particular line, while commenting -DF_MALLOC. If you succesfully do this, opensips -V should show something like : . SHM_MEM, SHM_MMAP, PKG_MALLOC, DBG_QM_MALLOC . Please do this and return with the logs at shutdown. Thank you. Regards, ___ Users mailing list Users@lists.opensips.org http://lists.opensips.org/cgi-bin/mailman/listinfo/users ___ Users mailing list Users@lists.opensips.org http://lists.opensips.org/cgi-bin/mailman/listinfo/users
Re: [OpenSIPS-Users] Not enough free memory, will atempt defragmenation
the logs are also ok if opensips crash instead stop it ? Thanks, Dani On 08/19/11 17:31, Bogdan-Andrei Iancu wrote: Hi Dani, You can not have comments in multi-line assignments So, instead of DEFS+= $(extra_defs) \ . -DCHANGEABLE_DEBUG_LEVEL \ #-DF_MALLOC \ -DDBG_QM_MALLOC \ #-DDBG_F_MALLOC \ you should do : DEFS+= $(extra_defs) \ . -DCHANGEABLE_DEBUG_LEVEL \ -DDBG_QM_MALLOC \ #-DF_MALLOC \ #-DDBG_F_MALLOC \ BTW, once you compiled in the DBG support, set: memlog=6 memdump=1 in order to get only the memory dump without all runtime logs from mem debugger. Regards, Bogdan On 08/19/2011 01:13 PM, Dani Popa wrote: Hi, True, i changed wrong the Makefiles.defs. I dont know if you need this: if i change Makefile.defs as: DEFS+= $(extra_defs) \ . . . . -DCHANGEABLE_DEBUG_LEVEL \ #-DF_MALLOC \ -DDBG_QM_MALLOC \ #-DDBG_F_MALLOC \ opensips will not be compiled with -DDBG_QM_MALLOC I'll come back with goodies, Thanks, Dani On 08/19/11 12:01, Vlad Paiu wrote: Hello, Thanks for the reply. Unfortunately, It seems that you have not compiled OpenSIPS with -DDBG_QM_MALLOC, so please review my last email and see that I also suggested editing Makefiles.defs and uncommenting that particular line, while commenting -DF_MALLOC. If you succesfully do this, opensips -V should show something like : . SHM_MEM, SHM_MMAP, PKG_MALLOC, DBG_QM_MALLOC . Please do this and return with the logs at shutdown. Thank you. Regards, ___ Users mailing list Users@lists.opensips.org http://lists.opensips.org/cgi-bin/mailman/listinfo/users ___ Users mailing list Users@lists.opensips.org http://lists.opensips.org/cgi-bin/mailman/listinfo/users
Re: [OpenSIPS-Users] Not enough free memory, will atempt defragmenation
sorry because i waste your time. the logs i sent to you are wrong. If i'ii replicate the case i'll send you good logs. Thanks, Dani On 08/19/11 17:31, Bogdan-Andrei Iancu wrote: Hi Dani, You can not have comments in multi-line assignments So, instead of DEFS+= $(extra_defs) \ . -DCHANGEABLE_DEBUG_LEVEL \ #-DF_MALLOC \ -DDBG_QM_MALLOC \ #-DDBG_F_MALLOC \ you should do : DEFS+= $(extra_defs) \ . -DCHANGEABLE_DEBUG_LEVEL \ -DDBG_QM_MALLOC \ #-DF_MALLOC \ #-DDBG_F_MALLOC \ BTW, once you compiled in the DBG support, set: memlog=6 memdump=1 in order to get only the memory dump without all runtime logs from mem debugger. Regards, Bogdan On 08/19/2011 01:13 PM, Dani Popa wrote: Hi, True, i changed wrong the Makefiles.defs. I dont know if you need this: if i change Makefile.defs as: DEFS+= $(extra_defs) \ . . . . -DCHANGEABLE_DEBUG_LEVEL \ #-DF_MALLOC \ -DDBG_QM_MALLOC \ #-DDBG_F_MALLOC \ opensips will not be compiled with -DDBG_QM_MALLOC I'll come back with goodies, Thanks, Dani On 08/19/11 12:01, Vlad Paiu wrote: Hello, Thanks for the reply. Unfortunately, It seems that you have not compiled OpenSIPS with -DDBG_QM_MALLOC, so please review my last email and see that I also suggested editing Makefiles.defs and uncommenting that particular line, while commenting -DF_MALLOC. If you succesfully do this, opensips -V should show something like : . SHM_MEM, SHM_MMAP, PKG_MALLOC, DBG_QM_MALLOC . Please do this and return with the logs at shutdown. Thank you. Regards, ___ Users mailing list Users@lists.opensips.org http://lists.opensips.org/cgi-bin/mailman/listinfo/users ___ Users mailing list Users@lists.opensips.org http://lists.opensips.org/cgi-bin/mailman/listinfo/users
Re: [OpenSIPS-Users] Not enough free memory, will atempt defragmenation
Hi Dani, It seems you are out of memory. What version of OpenSIPS are you using? Regards, Razvan Crainea OpenSIPS Developer On 04.08.2011 16:07, Dani Popa wrote: Hi, How can i solve this kind of problems ? Opensips doesn't crash, but it not respond to any sip requests. Aug 3 07:36:48 test /usr/local/sbin/opensips[29094]: WARNING:core:fm_malloc: Not enough free memory, will atempt defragmenation Aug 3 07:36:48 test /usr/local/sbin/opensips[29094]: ERROR:core:build_res_buf_from_sip_req: out of pkg memory ; needs 496 Aug 3 07:36:48 test /usr/local/sbin/opensips[29094]: ERROR:sl:sl_send_reply_helper: response building failed Aug 3 07:36:48 test /usr/local/sbin/opensips[29094]: ERROR:signaling:sig_send_reply_mod: failed to send reply with sl module Aug 3 07:36:48 test /usr/local/sbin/opensips[29094]: ERROR:auth:challenge: failed to send the response Aug 3 07:36:48 test /usr/local/sbin/opensips[29085]: WARNING:core:fm_malloc: Not enough free memory, will atempt defragmenation Aug 3 07:36:48 test /usr/local/sbin/opensips[29085]: ERROR:core:build_res_buf_from_sip_req: out of pkg memory ; needs 529 Aug 3 07:36:48 test /usr/local/sbin/opensips[29085]: ERROR:sl:sl_send_reply_helper: response building failed Aug 3 07:36:48 test /usr/local/sbin/opensips[29085]: ERROR:signaling:sig_send_reply_mod: failed to send reply with sl module Aug 3 07:36:48 test /usr/local/sbin/opensips[29085]: ERROR:auth:challenge: failed to send the response Aug 3 07:36:50 test /usr/local/sbin/opensips[29091]: WARNING:core:fm_malloc: Not enough free memory, will atempt defragmenation Aug 3 07:36:50 test /usr/local/sbin/opensips[29091]: ERROR:core:build_res_buf_from_sip_req: out of pkg memory ; needs 480 Aug 3 07:36:50 test /usr/local/sbin/opensips[29091]: ERROR:sl:sl_send_reply_helper: response building failed Aug 3 07:36:50 test /usr/local/sbin/opensips[29091]: ERROR:signaling:sig_send_reply_mod: failed to send reply with sl module Aug 3 07:36:50 test /usr/local/sbin/opensips[29091]: ERROR:options:opt_reply: failed to send 200 via send_reply Aug 3 07:36:50 test /usr/local/sbin/opensips[29087]: WARNING:core:fm_malloc: Not enough free memory, will atempt defragmenation Aug 3 07:36:50 test /usr/local/sbin/opensips[29087]: ERROR:core:build_res_buf_from_sip_req: out of pkg memory ; needs 503 Aug 3 07:36:50 test /usr/local/sbin/opensips[29087]: ERROR:sl:sl_send_reply_helper: response building failed Aug 3 07:36:50 test /usr/local/sbin/opensips[29087]: ERROR:signaling:sig_send_reply_mod: failed to send reply with sl module Aug 3 07:36:50 test /usr/local/sbin/opensips[29087]: ERROR:auth:challenge: failed to send the response Aug 3 07:36:51 test /usr/local/sbin/opensips[29086]: WARNING:core:fm_malloc: Not enough free memory, will atempt defragmenation Aug 3 07:36:51 test /usr/local/sbin/opensips[29086]: ERROR:core:build_res_buf_from_sip_req: out of pkg memory ; needs 503 Aug 3 07:36:51 test /usr/local/sbin/opensips[29086]: ERROR:sl:sl_send_reply_helper: response building failed Thanks, Dani ___ Users mailing list Users@lists.opensips.org http://lists.opensips.org/cgi-bin/mailman/listinfo/users ___ Users mailing list Users@lists.opensips.org http://lists.opensips.org/cgi-bin/mailman/listinfo/users
Re: [OpenSIPS-Users] Not enough free memory, will atempt defragmenation
Hi, I know that, but how can i check why :) root@test:~# opensips -V version: opensips 1.6.4-2-tls (i386/linux) flags: STATS: Off, USE_IPV6, USE_TCP, USE_TLS, USE_SCTP, DISABLE_NAGLE, USE_MCAST, SHM_MEM, SHM_MMAP, PKG_MALLOC, F_MALLOC, FAST_LOCK-ADAPTIVE_WAIT ADAPTIVE_WAIT_LOOPS=1024, MAX_RECV_BUFFER_SIZE 262144, MAX_LISTEN 16, MAX_URI_SIZE 1024, BUF_SIZE 65535 poll method support: poll, epoll_lt, epoll_et, sigio_rt, select. svnrevision: 2:7861M @(#) $Id: main.c 7530 2010-12-13 19:07:53Z bogdan_iancu $ main.c compiled on 05:57:05 May 24 2011 with gcc 4.5.2 root@test:~# free total used free sharedbuffers cached Mem: 41358163924440 211376 0 1874963253496 -/+ buffers/cache: 4834483652368 Swap: 60651483006064848 I have 50 users online that use presence and IM Dani On 08/04/11 17:04, Razvan Crainea wrote: Hi Dani, It seems you are out of memory. What version of OpenSIPS are you using? Regards, Razvan Crainea OpenSIPS Developer On 04.08.2011 16:07, Dani Popa wrote: Hi, How can i solve this kind of problems ? Opensips doesn't crash, but it not respond to any sip requests. Aug 3 07:36:48 test /usr/local/sbin/opensips[29094]: WARNING:core:fm_malloc: Not enough free memory, will atempt defragmenation Aug 3 07:36:48 test /usr/local/sbin/opensips[29094]: ERROR:core:build_res_buf_from_sip_req: out of pkg memory ; needs 496 Aug 3 07:36:48 test /usr/local/sbin/opensips[29094]: ERROR:sl:sl_send_reply_helper: response building failed Aug 3 07:36:48 test /usr/local/sbin/opensips[29094]: ERROR:signaling:sig_send_reply_mod: failed to send reply with sl module Aug 3 07:36:48 test /usr/local/sbin/opensips[29094]: ERROR:auth:challenge: failed to send the response Aug 3 07:36:48 test /usr/local/sbin/opensips[29085]: WARNING:core:fm_malloc: Not enough free memory, will atempt defragmenation Aug 3 07:36:48 test /usr/local/sbin/opensips[29085]: ERROR:core:build_res_buf_from_sip_req: out of pkg memory ; needs 529 Aug 3 07:36:48 test /usr/local/sbin/opensips[29085]: ERROR:sl:sl_send_reply_helper: response building failed Aug 3 07:36:48 test /usr/local/sbin/opensips[29085]: ERROR:signaling:sig_send_reply_mod: failed to send reply with sl module Aug 3 07:36:48 test /usr/local/sbin/opensips[29085]: ERROR:auth:challenge: failed to send the response Aug 3 07:36:50 test /usr/local/sbin/opensips[29091]: WARNING:core:fm_malloc: Not enough free memory, will atempt defragmenation Aug 3 07:36:50 test /usr/local/sbin/opensips[29091]: ERROR:core:build_res_buf_from_sip_req: out of pkg memory ; needs 480 Aug 3 07:36:50 test /usr/local/sbin/opensips[29091]: ERROR:sl:sl_send_reply_helper: response building failed Aug 3 07:36:50 test /usr/local/sbin/opensips[29091]: ERROR:signaling:sig_send_reply_mod: failed to send reply with sl module Aug 3 07:36:50 test /usr/local/sbin/opensips[29091]: ERROR:options:opt_reply: failed to send 200 via send_reply Aug 3 07:36:50 test /usr/local/sbin/opensips[29087]: WARNING:core:fm_malloc: Not enough free memory, will atempt defragmenation Aug 3 07:36:50 test /usr/local/sbin/opensips[29087]: ERROR:core:build_res_buf_from_sip_req: out of pkg memory ; needs 503 Aug 3 07:36:50 test /usr/local/sbin/opensips[29087]: ERROR:sl:sl_send_reply_helper: response building failed Aug 3 07:36:50 test /usr/local/sbin/opensips[29087]: ERROR:signaling:sig_send_reply_mod: failed to send reply with sl module Aug 3 07:36:50 test /usr/local/sbin/opensips[29087]: ERROR:auth:challenge: failed to send the response Aug 3 07:36:51 test /usr/local/sbin/opensips[29086]: WARNING:core:fm_malloc: Not enough free memory, will atempt defragmenation Aug 3 07:36:51 test /usr/local/sbin/opensips[29086]: ERROR:core:build_res_buf_from_sip_req: out of pkg memory ; needs 503 Aug 3 07:36:51 test /usr/local/sbin/opensips[29086]: ERROR:sl:sl_send_reply_helper: response building failed Thanks, Dani ___ Users mailing list Users@lists.opensips.org http://lists.opensips.org/cgi-bin/mailman/listinfo/users ___ Users mailing list Users@lists.opensips.org http://lists.opensips.org/cgi-bin/mailman/listinfo/users ___ Users mailing list Users@lists.opensips.org http://lists.opensips.org/cgi-bin/mailman/listinfo/users
Re: [OpenSIPS-Users] Not enough free memory, will atempt defragmenation
Hello, Is it possible that you upgrade to 1.7 ? It is possible that this issue was fixed in the latest OpenSIPS version. If not, go to Makefile.defs, uncomment the line with -DDBG_QM_MALLOC \ and comment the line with -DF_MALLOC \ and then recompile OpenSIPS. Also set memlog=1 in your OpenSIPS cfg, and when the memory get's filled up you can either shutdown the proxy or send a SIGUSR1 signal to the attendant to get a memory dump. Please return with the memory dump and we will try to help. Regards, -- Vlad Paiu OpenSIPS Developer On 08/04/2011 06:19 PM, Dani Popa wrote: Hi, I know that, but how can i check why :) root@test:~# opensips -V version: opensips 1.6.4-2-tls (i386/linux) flags: STATS: Off, USE_IPV6, USE_TCP, USE_TLS, USE_SCTP, DISABLE_NAGLE, USE_MCAST, SHM_MEM, SHM_MMAP, PKG_MALLOC, F_MALLOC, FAST_LOCK-ADAPTIVE_WAIT ADAPTIVE_WAIT_LOOPS=1024, MAX_RECV_BUFFER_SIZE 262144, MAX_LISTEN 16, MAX_URI_SIZE 1024, BUF_SIZE 65535 poll method support: poll, epoll_lt, epoll_et, sigio_rt, select. svnrevision: 2:7861M @(#) $Id: main.c 7530 2010-12-13 19:07:53Z bogdan_iancu $ main.c compiled on 05:57:05 May 24 2011 with gcc 4.5.2 root@test:~# free total used free sharedbuffers cached Mem: 41358163924440 211376 0 1874963253496 -/+ buffers/cache: 4834483652368 Swap: 60651483006064848 I have 50 users online that use presence and IM Dani On 08/04/11 17:04, Razvan Crainea wrote: Hi Dani, It seems you are out of memory. What version of OpenSIPS are you using? Regards, Razvan Crainea OpenSIPS Developer On 04.08.2011 16:07, Dani Popa wrote: Hi, How can i solve this kind of problems ? Opensips doesn't crash, but it not respond to any sip requests. Aug 3 07:36:48 test /usr/local/sbin/opensips[29094]: WARNING:core:fm_malloc: Not enough free memory, will atempt defragmenation Aug 3 07:36:48 test /usr/local/sbin/opensips[29094]: ERROR:core:build_res_buf_from_sip_req: out of pkg memory ; needs 496 Aug 3 07:36:48 test /usr/local/sbin/opensips[29094]: ERROR:sl:sl_send_reply_helper: response building failed Aug 3 07:36:48 test /usr/local/sbin/opensips[29094]: ERROR:signaling:sig_send_reply_mod: failed to send reply with sl module Aug 3 07:36:48 test /usr/local/sbin/opensips[29094]: ERROR:auth:challenge: failed to send the response Aug 3 07:36:48 test /usr/local/sbin/opensips[29085]: WARNING:core:fm_malloc: Not enough free memory, will atempt defragmenation Aug 3 07:36:48 test /usr/local/sbin/opensips[29085]: ERROR:core:build_res_buf_from_sip_req: out of pkg memory ; needs 529 Aug 3 07:36:48 test /usr/local/sbin/opensips[29085]: ERROR:sl:sl_send_reply_helper: response building failed Aug 3 07:36:48 test /usr/local/sbin/opensips[29085]: ERROR:signaling:sig_send_reply_mod: failed to send reply with sl module Aug 3 07:36:48 test /usr/local/sbin/opensips[29085]: ERROR:auth:challenge: failed to send the response Aug 3 07:36:50 test /usr/local/sbin/opensips[29091]: WARNING:core:fm_malloc: Not enough free memory, will atempt defragmenation Aug 3 07:36:50 test /usr/local/sbin/opensips[29091]: ERROR:core:build_res_buf_from_sip_req: out of pkg memory ; needs 480 Aug 3 07:36:50 test /usr/local/sbin/opensips[29091]: ERROR:sl:sl_send_reply_helper: response building failed Aug 3 07:36:50 test /usr/local/sbin/opensips[29091]: ERROR:signaling:sig_send_reply_mod: failed to send reply with sl module Aug 3 07:36:50 test /usr/local/sbin/opensips[29091]: ERROR:options:opt_reply: failed to send 200 via send_reply Aug 3 07:36:50 test /usr/local/sbin/opensips[29087]: WARNING:core:fm_malloc: Not enough free memory, will atempt defragmenation Aug 3 07:36:50 test /usr/local/sbin/opensips[29087]: ERROR:core:build_res_buf_from_sip_req: out of pkg memory ; needs 503 Aug 3 07:36:50 test /usr/local/sbin/opensips[29087]: ERROR:sl:sl_send_reply_helper: response building failed Aug 3 07:36:50 test /usr/local/sbin/opensips[29087]: ERROR:signaling:sig_send_reply_mod: failed to send reply with sl module Aug 3 07:36:50 test /usr/local/sbin/opensips[29087]: ERROR:auth:challenge: failed to send the response Aug 3 07:36:51 test /usr/local/sbin/opensips[29086]: WARNING:core:fm_malloc: Not enough free memory, will atempt defragmenation Aug 3 07:36:51 test /usr/local/sbin/opensips[29086]: ERROR:core:build_res_buf_from_sip_req: out of pkg memory ; needs 503 Aug 3 07:36:51 test /usr/local/sbin/opensips[29086]: ERROR:sl:sl_send_reply_helper: response building failed Thanks, Dani ___ Users mailing list Users@lists.opensips.org http://lists.opensips.org/cgi-bin/mailman/listinfo/users ___ Users mailing list Users@lists.opensips.org http://lists.opensips.org/cgi-bin/mailman/listinfo/users ___ Users mailing list Users@lists.opensips.org
Re: [OpenSIPS-Users] Not enough free memory, will atempt defragmenation
Ok, thanks for quick response. Dani On 08/04/11 18:26, Vlad Paiu wrote: Hello, Is it possible that you upgrade to 1.7 ? It is possible that this issue was fixed in the latest OpenSIPS version. If not, go to Makefile.defs, uncomment the line with -DDBG_QM_MALLOC \ and comment the line with -DF_MALLOC \ and then recompile OpenSIPS. Also set memlog=1 in your OpenSIPS cfg, and when the memory get's filled up you can either shutdown the proxy or send a SIGUSR1 signal to the attendant to get a memory dump. Please return with the memory dump and we will try to help. Regards, ___ Users mailing list Users@lists.opensips.org http://lists.opensips.org/cgi-bin/mailman/listinfo/users
