[Freeswitch-users] Possible memory / cpu leak
Hi, Ive been seeing an issue where FreeSWITCHs CPU and memory utilization climb over time; a restart of FS clears up the problem. See graphs for the past week. http://cfowl.postinbox.com/fs.jpg Observed on the Release Candidate, and then upgraded to the current trunk a couple of times. Currently running version FreeSWITCH Version 1.0.trunk (12604). This is seen both when FS is being used (~200 calls/day, and over the weekend when ~5 calls/day). How can I best debug this? Thanks, Chris. ___ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Re: [Freeswitch-users] Possible memory / cpu leak
Can you update to SVN trunk as of now? /b On Mar 16, 2009, at 3:19 PM, Chris Fowler wrote: Hi, I’ve been seeing an issue where FreeSWITCH’s CPU and memory utilization climb over time; a restart of FS clears up the problem. See graphs for the past week. http://cfowl.postinbox.com/fs.jpg Observed on the Release Candidate, and then upgraded to the current trunk a couple of times. Currently running version “FreeSWITCH Version 1.0.trunk (12604)”. This is seen both when FS is being used (~200 calls/day, and over the weekend when ~5 calls/day). How can I best debug this? Thanks, Chris. ___ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Re: [Freeswitch-users] Possible memory / cpu leak
what happens in your dialplan ? is is possible that you execute a script on each call, thats not being exited ? Jay On Tue, Mar 17, 2009 at 6:19 AM, Chris Fowler wrote: > Hi, > > I’ve been seeing an issue where FreeSWITCH’s CPU and memory utilization > climb over time; a restart of FS clears up the problem. > > See graphs for the past week. http://cfowl.postinbox.com/fs.jpg > > Observed on the Release Candidate, and then upgraded to the current > trunk a couple of times. Currently running version “FreeSWITCH Version > 1.0.trunk (12604)”. > > This is seen both when FS is being used (~200 calls/day, and over the > weekend when ~5 calls/day). > > How can I best debug this? > > Thanks, Chris. > > > ___ > Freeswitch-users mailing list > Freeswitch-users@lists.freeswitch.org > http://lists.freeswitch.org/mailman/listinfo/freeswitch-users > UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users > http://www.freeswitch.org > -- Sincerely Jay ___ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Re: [Freeswitch-users] Possible memory / cpu leak
>> Jay : what happens in your dialplan ? Nothing special; no external script execution just default pattern matching to route to extensions (per the stock config). >> Brian: Can you update to SVN trunk as of now? Yup, I will pull the trunk and report back in 24 hours. Chris. ___ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Re: [Freeswitch-users] Possible memory / cpu leak
Happen to use voicemail a lot? ivr.conf.xml? /b On Mar 16, 2009, at 5:42 PM, Chris Fowler wrote: >>> Jay : what happens in your dialplan ? > Nothing special; no external script execution just default pattern > matching to route to extensions (per the stock config). > >>> Brian: Can you update to SVN trunk as of now? > Yup, I will pull the trunk and report back in 24 hours. > > Chris. ___ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Re: [Freeswitch-users] Possible memory / cpu leak
nothing special is a bit vague. clearly something you are doing makes a difference. Perhaps you can explain any custom extensions you have or what you are doing a little better? install valgrind and run it for a while valgrind --tool=memcheck --log-file=vg.log --leak-check=full --leak-resolution=high --show-reachable=yes /path/to/freeswitch -vg then send us vg.log On Mon, Mar 16, 2009 at 5:42 PM, Chris Fowler wrote: > >> Jay : what happens in your dialplan ? > Nothing special; no external script execution just default pattern > matching to route to extensions (per the stock config). > > >> Brian: Can you update to SVN trunk as of now? > Yup, I will pull the trunk and report back in 24 hours. > > Chris. > > ___ > Freeswitch-users mailing list > Freeswitch-users@lists.freeswitch.org > http://lists.freeswitch.org/mailman/listinfo/freeswitch-users > UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users > http://www.freeswitch.org > -- Anthony Minessale II FreeSWITCH http://www.freeswitch.org/ ClueCon http://www.cluecon.com/ AIM: anthm MSN:anthony_miness...@hotmail.com GTALK/JABBER/PAYPAL:anthony.miness...@gmail.com IRC: irc.freenode.net #freeswitch FreeSWITCH Developer Conference sip:8...@conference.freeswitch.org iax:gu...@conference.freeswitch.org/888 googletalk:conf+...@conference.freeswitch.org pstn:213-799-1400 ___ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Re: [Freeswitch-users] Possible memory / cpu leak
>> Brian: Can you update to SVN trunk as of now? I updated - version reports: FreeSWITCH Version 1.0.trunk (12631) Only difference I note with this build is that upon "shutdown" FS now SegFaults. The mem/cpu usage continues to slowly climb. 2009-03-16 20:59:32 [CONSOLE] switch_loadable_module.c:1237 do_shutdown() Stopping: mod_spidermonkey Segmentation fault (core dumped) >> Anthony - nothing special is a bit vague. I modified the dial plan to accept extension in the 1000-1029 range Added DialByLast name using directory.lua (from the wiki) Modified the ivr config to play company specific greetings Voicemail is used a few times per day freeswi...@ip-10-250-155-18> sofia status API CALL [sofia(status)] output: Name Type Data State = internal profile sip:mod_so...@xxx.xxx.xxx.xx:5060 RUNNING (0) external profile sip:mod_so...@xxx.xxx.xxx.xx:5080 RUNNING (0) sip.flowroute.com gateway sip:xxx...@sip.flowroute.com REGED inphonex gateway sip:xx...@sip.inphonex.com REGED callwithus-did-xx gateway sip:...@east.callwithus.com REGED callwithus-did-xx gateway sip:...@east.callwithus.com REGED callwithus-did-xx gateway sip:...@east.callwithus.com REGED default alias internal ALIASED nat alias external ALIASED x..aaa alias internal ALIASED outbound alias external ALIASED = >> Anthony - valgrind --tool=memcheck --log-file=vg.log --leak-check=full >> --leak-resolution=high --show-reachable=yes /path/to/freeswitch -vg Nothing got logged, here's the output. Did I invoke valgrind incorrectly? ==32545== Memcheck, a memory error detector. ==32545== Copyright (C) 2002-2006, and GNU GPL'd, by Julian Seward et al. ==32545== Using LibVEX rev 1658, a library for dynamic binary translation. ==32545== Copyright (C) 2004-2006, and GNU GPL'd, by OpenWorks LLP. ==32545== Using valgrind-3.2.1, a dynamic binary instrumentation framework. ==32545== Copyright (C) 2000-2006, and GNU GPL'd, by Julian Seward et al. ==32545== For more details, rerun with: -v ==32545== ==32545== My PID = 32545, parent PID = 32511. Prog and args are: ==32545==/usr/local/freeswitch/bin/freeswitch ==32545==-vg ==32545== ___ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Re: [Freeswitch-users] Possible memory / cpu leak
Tip: ulimit -s 240, or freeswitch fork and execv out from under valgrind. /b On Mar 16, 2009, at 11:01 PM, Chris Fowler wrote: > > >>> Anthony - valgrind --tool=memcheck --log-file=vg.log --leak- >>> check=full --leak-resolution=high --show-reachable=yes /path/to/ >>> freeswitch -vg > > > Nothing got logged, here's the output. Did I invoke valgrind > incorrectly? > > ==32545== Memcheck, a memory error detector. > ==32545== Copyright (C) 2002-2006, and GNU GPL'd, by Julian Seward et > al. > ==32545== Using LibVEX rev 1658, a library for dynamic binary > translation. > ==32545== Copyright (C) 2004-2006, and GNU GPL'd, by OpenWorks LLP. > ==32545== Using valgrind-3.2.1, a dynamic binary instrumentation > framework. > ==32545== Copyright (C) 2000-2006, and GNU GPL'd, by Julian Seward et > al. > ==32545== For more details, rerun with: -v > ==32545== > ==32545== My PID = 32545, parent PID = 32511. Prog and args are: > ==32545==/usr/local/freeswitch/bin/freeswitch > ==32545==-vg > ==32545== ___ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Re: [Freeswitch-users] Possible memory / cpu leak
Thanks for the tip Brian. Here's a link to the valgrind output : http://cfowl.postinbox.com/vg.log Chris. ___ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Re: [Freeswitch-users] Possible memory / cpu leak
You're not leaking... I wouldn't call 737 bytes a leak. /b On Mar 17, 2009, at 10:49 AM, Chris Fowler wrote: Thanks for the tip Brian. Here's a link to the valgrind output : http://cfowl.postinbox.com/vg.log Chris. ___ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Re: [Freeswitch-users] Possible memory / cpu leak
The crash on shutdown was an issue in mod_spidermonkey that was accidentally added if you update again it's gone. please run the valgrind command again then make several calls that fall in line with your normal usage pattern so the program can get an accurate trace of the memory usage. On Tue, Mar 17, 2009 at 10:49 AM, Chris Fowler wrote: > Thanks for the tip Brian. > > Here's a link to the valgrind output : http://cfowl.postinbox.com/vg.log > > Chris. > > ___ > Freeswitch-users mailing list > Freeswitch-users@lists.freeswitch.org > http://lists.freeswitch.org/mailman/listinfo/freeswitch-users > UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users > http://www.freeswitch.org > -- Anthony Minessale II FreeSWITCH http://www.freeswitch.org/ ClueCon http://www.cluecon.com/ AIM: anthm MSN:anthony_miness...@hotmail.com GTALK/JABBER/PAYPAL:anthony.miness...@gmail.com IRC: irc.freenode.net #freeswitch FreeSWITCH Developer Conference sip:8...@conference.freeswitch.org iax:gu...@conference.freeswitch.org/888 googletalk:conf+...@conference.freeswitch.org pstn:213-799-1400 ___ Freeswitch-users mailing list Freeswitch-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
