Re: [asterisk-users] Asterisk on Debian / Sparc taking up 95%+ CPU with No calls on the system
On Tue, Jul 05, 2011 at 08:30:52PM -0400, A E [Gmail] wrote: hello people, I am running v1.8.4.2 on debian squeeze on a sparc platform...and for some reason I have noticed that only after a few test calls, the asterisk process is running between 95% - 99.9% CPU when there's absolutely nothing on the system. This is a clean Asterisk system in an internal network with nothing else on it with no calls on it but it's still sitting with 96% CPU. I'm not a developer so not that ept with using debug tools etc to figure out why it's doing that. Could anyone please tell me how I can figure out why it's doing this and/or help debug this. Makes no sense for it to be using CPU with nothing happening on the system The first thing I'd do is run 'top', press shift H, and see what is/are the offending thread(s). Is it a single thread? Two? More? Is it all user time? Much of it is system time? If you strace the PID of the top thread (strace -p PID), what do you see? -- Tzafrir Cohen icq#16849755 jabber:tzafrir.co...@xorcom.com +972-50-7952406 mailto:tzafrir.co...@xorcom.com http://www.xorcom.com iax:gu...@local.xorcom.com/tzafrir -- _ -- Bandwidth and Colocation Provided by http://www.api-digital.com -- New to Asterisk? Join us for a live introductory webinar every Thurs: http://www.asterisk.org/hello asterisk-users mailing list To UNSUBSCRIBE or update options visit: http://lists.digium.com/mailman/listinfo/asterisk-users
Re: [asterisk-users] Asterisk on Debian / Sparc taking up 95%+ CPU with No calls on the system
On Wed, Jul 6, 2011 at 3:21 AM, Tzafrir Cohen tzafrir.co...@xorcom.comwrote: On Tue, Jul 05, 2011 at 08:30:52PM -0400, A E [Gmail] wrote: hello people, I am running v1.8.4.2 on debian squeeze on a sparc platform...and for some reason I have noticed that only after a few test calls, the asterisk process is running between 95% - 99.9% CPU when there's absolutely nothing on the system. This is a clean Asterisk system in an internal network with nothing else on it with no calls on it but it's still sitting with 96% CPU. I'm not a developer so not that ept with using debug tools etc to figure out why it's doing that. Could anyone please tell me how I can figure out why it's doing this and/or help debug this. Makes no sense for it to be using CPU with nothing happening on the system The first thing I'd do is run 'top', press shift H, and see what is/are the offending thread(s). Is it a single thread? Two? More? Is it all user time? Much of it is system time? If you strace the PID of the top thread (strace -p PID), what do you see? Hi Tzafrir, thanks for the comments and suggestions. So I'd done all of that and what I'd found was - After I'd done Shift-h, There was only one / single thread that was taking all of the CPU - 33% was Sser and 66% was System times - when I'd run an strace on the PID of the offending thread it just rolled some message past my screen which I couldn't capture and can't remember what it said :( Anyway I've killed that process, updated the packages the system, upgraded to 1.8.4.4 and will give it another shot and see what happens. Would've helped if I'd kept the system as it was so people could help me figure out what was going on, but the fact that it stopped responding to commands which were trying to kill the hung channels, reloading configs, or even trying to stop the system wouldn't work is bizarre. I hope the developers pay attention to that. -- _ -- Bandwidth and Colocation Provided by http://www.api-digital.com -- New to Asterisk? Join us for a live introductory webinar every Thurs: http://www.asterisk.org/hello asterisk-users mailing list To UNSUBSCRIBE or update options visit: http://lists.digium.com/mailman/listinfo/asterisk-users
Re: [asterisk-users] Asterisk on Debian / Sparc taking up 95%+ CPU with No calls on the system
On Wed, Jul 06, 2011 at 06:15:26AM -0400, A E [Gmail] wrote: On Wed, Jul 6, 2011 at 3:21 AM, Tzafrir Cohen tzafrir.co...@xorcom.comwrote: On Tue, Jul 05, 2011 at 08:30:52PM -0400, A E [Gmail] wrote: hello people, I am running v1.8.4.2 on debian squeeze on a sparc platform...and for some reason I have noticed that only after a few test calls, the asterisk process is running between 95% - 99.9% CPU when there's absolutely nothing on the system. This is a clean Asterisk system in an internal network with nothing else on it with no calls on it but it's still sitting with 96% CPU. I'm not a developer so not that ept with using debug tools etc to figure out why it's doing that. Could anyone please tell me how I can figure out why it's doing this and/or help debug this. Makes no sense for it to be using CPU with nothing happening on the system The first thing I'd do is run 'top', press shift H, and see what is/are the offending thread(s). Is it a single thread? Two? More? Is it all user time? Much of it is system time? If you strace the PID of the top thread (strace -p PID), what do you see? Hi Tzafrir, thanks for the comments and suggestions. So I'd done all of that and what I'd found was - After I'd done Shift-h, There was only one / single thread that was taking all of the CPU - 33% was Sser and 66% was System times - when I'd run an strace on the PID of the offending thread it just rolled some message past my screen which I couldn't capture and can't remember what it said :( Just press ctrl-c . Anyway I've killed that process, updated the packages the system, upgraded to 1.8.4.4 and will give it another shot and see what happens. Would've helped if I'd kept the system as it was so people could help me figure out what was going on, but the fact that it stopped responding to commands which were trying to kill the hung channels, reloading configs, or even trying to stop the system wouldn't work is bizarre. I hope the developers pay attention to that. Developers need some data to work with :-( -- Tzafrir Cohen icq#16849755 jabber:tzafrir.co...@xorcom.com +972-50-7952406 mailto:tzafrir.co...@xorcom.com http://www.xorcom.com iax:gu...@local.xorcom.com/tzafrir -- _ -- Bandwidth and Colocation Provided by http://www.api-digital.com -- New to Asterisk? Join us for a live introductory webinar every Thurs: http://www.asterisk.org/hello asterisk-users mailing list To UNSUBSCRIBE or update options visit: http://lists.digium.com/mailman/listinfo/asterisk-users
Re: [asterisk-users] Asterisk on Debian / Sparc taking up 95%+ CPU with No calls on the system
On Wed, Jul 6, 2011 at 7:02 AM, Tzafrir Cohen tzafrir.co...@xorcom.comwrote: On Wed, Jul 06, 2011 at 06:15:26AM -0400, A E [Gmail] wrote: On Wed, Jul 6, 2011 at 3:21 AM, Tzafrir Cohen tzafrir.co...@xorcom.com wrote: On Tue, Jul 05, 2011 at 08:30:52PM -0400, A E [Gmail] wrote: hello people, I am running v1.8.4.2 on debian squeeze on a sparc platform...and for some reason I have noticed that only after a few test calls, the asterisk process is running between 95% - 99.9% CPU when there's absolutely nothing on the system. This is a clean Asterisk system in an internal network with nothing else on it with no calls on it but it's still sitting with 96% CPU. I'm not a developer so not that ept with using debug tools etc to figure out why it's doing that. Could anyone please tell me how I can figure out why it's doing this and/or help debug this. Makes no sense for it to be using CPU with nothing happening on the system The first thing I'd do is run 'top', press shift H, and see what is/are the offending thread(s). Is it a single thread? Two? More? Is it all user time? Much of it is system time? If you strace the PID of the top thread (strace -p PID), what do you see? Hi Tzafrir, thanks for the comments and suggestions. So I'd done all of that and what I'd found was - After I'd done Shift-h, There was only one / single thread that was taking all of the CPU - 33% was Sser and 66% was System times - when I'd run an strace on the PID of the offending thread it just rolled some message past my screen which I couldn't capture and can't remember what it said :( Just press ctrl-c . haha I did that but since that I did a 100 other things in my ssh window which is only buffered for 5000 lines and those messages have gone past. Anyway I've killed that process, updated the packages the system, upgraded to 1.8.4.4 and will give it another shot and see what happens. Would've helped if I'd kept the system as it was so people could help me figure out what was going on, but the fact that it stopped responding to commands which were trying to kill the hung channels, reloading configs, or even trying to stop the system wouldn't work is bizarre. I hope the developers pay attention to that. Developers need some data to work with :-( Haha of course. Although I have a feeling it'll happen again as this is the 2nd time this has happened. Will keep the system in that state till we can try and resolve this and capture enough info. if I had better memory, I'd have actually remembered what the message was, but anyway, what I was trying to say was that it's much more than just taking up all the CPU tells me that some thread has just gone loco. But the fact the CLI and AMI commands become unresponsive when trying to kill these zombie channels or trying to do a core reload or core stop now etc. tells me that this is a bigger issue than just some thread gone nuts and the channels being hung -- _ -- Bandwidth and Colocation Provided by http://www.api-digital.com -- New to Asterisk? Join us for a live introductory webinar every Thurs: http://www.asterisk.org/hello asterisk-users mailing list To UNSUBSCRIBE or update options visit: http://lists.digium.com/mailman/listinfo/asterisk-users
Re: [asterisk-users] Asterisk on Debian / Sparc taking up 95%+ CPU with No calls on the system
On Wed, Jul 06, 2011 at 07:11:26AM -0400, A E [Gmail] wrote: On Wed, Jul 6, 2011 at 7:02 AM, Tzafrir Cohen tzafrir.co...@xorcom.comwrote: On Wed, Jul 06, 2011 at 06:15:26AM -0400, A E [Gmail] wrote: - when I'd run an strace on the PID of the offending thread it just rolled some message past my screen which I couldn't capture and can't remember what it said :( Just press ctrl-c . haha I did that but since that I did a 100 other things in my ssh window which is only buffered for 5000 lines and those messages have gone past. If the process / thread is in a loop, the messages tend to repeat themselves. Also: anything interesting in /var/log/asterisk/messages ? -- Tzafrir Cohen icq#16849755 jabber:tzafrir.co...@xorcom.com +972-50-7952406 mailto:tzafrir.co...@xorcom.com http://www.xorcom.com iax:gu...@local.xorcom.com/tzafrir -- _ -- Bandwidth and Colocation Provided by http://www.api-digital.com -- New to Asterisk? Join us for a live introductory webinar every Thurs: http://www.asterisk.org/hello asterisk-users mailing list To UNSUBSCRIBE or update options visit: http://lists.digium.com/mailman/listinfo/asterisk-users
Re: [asterisk-users] Asterisk on Debian / Sparc taking up 95%+ CPU with No calls on the system
On Wed, Jul 6, 2011 at 7:50 AM, Tzafrir Cohen tzafrir.co...@xorcom.comwrote: On Wed, Jul 06, 2011 at 07:11:26AM -0400, A E [Gmail] wrote: On Wed, Jul 6, 2011 at 7:02 AM, Tzafrir Cohen tzafrir.co...@xorcom.com wrote: On Wed, Jul 06, 2011 at 06:15:26AM -0400, A E [Gmail] wrote: - when I'd run an strace on the PID of the offending thread it just rolled some message past my screen which I couldn't capture and can't remember what it said :( Just press ctrl-c . haha I did that but since that I did a 100 other things in my ssh window which is only buffered for 5000 lines and those messages have gone past. If the process / thread is in a loop, the messages tend to repeat themselves. Also: anything interesting in /var/log/asterisk/messages ? Yup, it surely was in some funky loop...and I wouldn't be surprised if it was looping to check if the channels were hungup or not and ended up taking up the entire CPUI should've tried to just kill that thread with its PID and seen if the operation returns to normal. No, unfortunately nothing interesting found in the logs, other than the indication that when I tried to reload using core reload it was actually loading the configs even though it didn't show anything on the CLI. -- _ -- Bandwidth and Colocation Provided by http://www.api-digital.com -- New to Asterisk? Join us for a live introductory webinar every Thurs: http://www.asterisk.org/hello asterisk-users mailing list To UNSUBSCRIBE or update options visit: http://lists.digium.com/mailman/listinfo/asterisk-users
[asterisk-users] Asterisk on Debian / Sparc taking up 95%+ CPU with No calls on the system
hello people, I am running v1.8.4.2 on debian squeeze on a sparc platform...and for some reason I have noticed that only after a few test calls, the asterisk process is running between 95% - 99.9% CPU when there's absolutely nothing on the system. This is a clean Asterisk system in an internal network with nothing else on it with no calls on it but it's still sitting with 96% CPU. I'm not a developer so not that ept with using debug tools etc to figure out why it's doing that. Could anyone please tell me how I can figure out why it's doing this and/or help debug this. Makes no sense for it to be using CPU with nothing happening on the system Thanks -- _ -- Bandwidth and Colocation Provided by http://www.api-digital.com -- New to Asterisk? Join us for a live introductory webinar every Thurs: http://www.asterisk.org/hello asterisk-users mailing list To UNSUBSCRIBE or update options visit: http://lists.digium.com/mailman/listinfo/asterisk-users
Re: [asterisk-users] Asterisk on Debian / Sparc taking up 95%+ CPU with No calls on the system
On the CLI write: sip show channels If there are lots of bye channels you have the same problem than me. I've tried waiting with the call generator -sipp- and channels finished when there are a few. But they're not ending faster enough when I send lots of concurrent calls. Elder 2011/7/5, A E [Gmail] all.efor...@gmail.com: hello people, I am running v1.8.4.2 on debian squeeze on a sparc platform...and for some reason I have noticed that only after a few test calls, the asterisk process is running between 95% - 99.9% CPU when there's absolutely nothing on the system. This is a clean Asterisk system in an internal network with nothing else on it with no calls on it but it's still sitting with 96% CPU. I'm not a developer so not that ept with using debug tools etc to figure out why it's doing that. Could anyone please tell me how I can figure out why it's doing this and/or help debug this. Makes no sense for it to be using CPU with nothing happening on the system Thanks -- Enviado desde mi dispositivo móvil -- _ -- Bandwidth and Colocation Provided by http://www.api-digital.com -- New to Asterisk? Join us for a live introductory webinar every Thurs: http://www.asterisk.org/hello asterisk-users mailing list To UNSUBSCRIBE or update options visit: http://lists.digium.com/mailman/listinfo/asterisk-users
Re: [asterisk-users] Asterisk on Debian / Sparc taking up 95%+ CPU with No calls on the system
On Wed, Jul 6, 2011 at 12:00 AM, Daniel - Asterisk earohua...@gmail.comwrote: On the CLI write: sip show channels If there are lots of bye channels you have the same problem than me. I've tried waiting with the call generator -sipp- and channels finished when there are a few. But they're not ending faster enough when I send lots of concurrent calls. Elder Hi, thanks for the response. yeah I'd checked that before and I only have 2 dialogs which seem to be part of the same call that are just sitting there and I can't seem to get them to hang up by typing channel request hangup all . I even tried sending a Hangup by connecting on the AMI but that doesn't seem to be doing anything either. So this channel is sitting there in the 'BYE' state. Is there anyway of clearing them without having to reload/restart Asterisk? I want to see if that's the cause of the CPU usage and I'll lose that if I restart Asterisk. Thanks 2011/7/5, A E [Gmail] all.efor...@gmail.com: hello people, I am running v1.8.4.2 on debian squeeze on a sparc platform...and for some reason I have noticed that only after a few test calls, the asterisk process is running between 95% - 99.9% CPU when there's absolutely nothing on the system. This is a clean Asterisk system in an internal network with nothing else on it with no calls on it but it's still sitting with 96% CPU. I'm not a developer so not that ept with using debug tools etc to figure out why it's doing that. Could anyone please tell me how I can figure out why it's doing this and/or help debug this. Makes no sense for it to be using CPU with nothing happening on the system Thanks -- Enviado desde mi dispositivo móvil -- _ -- Bandwidth and Colocation Provided by http://www.api-digital.com -- New to Asterisk? Join us for a live introductory webinar every Thurs: http://www.asterisk.org/hello asterisk-users mailing list To UNSUBSCRIBE or update options visit: http://lists.digium.com/mailman/listinfo/asterisk-users -- _ -- Bandwidth and Colocation Provided by http://www.api-digital.com -- New to Asterisk? Join us for a live introductory webinar every Thurs: http://www.asterisk.org/hello asterisk-users mailing list To UNSUBSCRIBE or update options visit: http://lists.digium.com/mailman/listinfo/asterisk-users
Re: [asterisk-users] Asterisk on Debian / Sparc taking up 95%+ CPU with No calls on the system
You have to provide channel ID to command like channel request hangup SIP/12316156-sad4d46a5. From: asterisk-users-boun...@lists.digium.com [mailto:asterisk-users-boun...@lists.digium.com] On Behalf Of A E [Gmail] Sent: Wednesday, July 06, 2011 9:50 AM To: Asterisk Users Mailing List - Non-Commercial Discussion Subject: Re: [asterisk-users] Asterisk on Debian / Sparc taking up 95%+ CPU with No calls on the system On Wed, Jul 6, 2011 at 12:00 AM, Daniel - Asterisk earohua...@gmail.com wrote: On the CLI write: sip show channels If there are lots of bye channels you have the same problem than me. I've tried waiting with the call generator -sipp- and channels finished when there are a few. But they're not ending faster enough when I send lots of concurrent calls. Elder Hi, thanks for the response. yeah I'd checked that before and I only have 2 dialogs which seem to be part of the same call that are just sitting there and I can't seem to get them to hang up by typing channel request hangup all . I even tried sending a Hangup by connecting on the AMI but that doesn't seem to be doing anything either. So this channel is sitting there in the 'BYE' state. Is there anyway of clearing them without having to reload/restart Asterisk? I want to see if that's the cause of the CPU usage and I'll lose that if I restart Asterisk. Thanks 2011/7/5, A E [Gmail] all.efor...@gmail.com: hello people, I am running v1.8.4.2 on debian squeeze on a sparc platform...and for some reason I have noticed that only after a few test calls, the asterisk process is running between 95% - 99.9% CPU when there's absolutely nothing on the system. This is a clean Asterisk system in an internal network with nothing else on it with no calls on it but it's still sitting with 96% CPU. I'm not a developer so not that ept with using debug tools etc to figure out why it's doing that. Could anyone please tell me how I can figure out why it's doing this and/or help debug this. Makes no sense for it to be using CPU with nothing happening on the system Thanks -- Enviado desde mi dispositivo móvil -- _ -- Bandwidth and Colocation Provided by http://www.api-digital.com -- New to Asterisk? Join us for a live introductory webinar every Thurs: http://www.asterisk.org/hello asterisk-users mailing list To UNSUBSCRIBE or update options visit: http://lists.digium.com/mailman/listinfo/asterisk-users -- _ -- Bandwidth and Colocation Provided by http://www.api-digital.com -- New to Asterisk? Join us for a live introductory webinar every Thurs: http://www.asterisk.org/hello asterisk-users mailing list To UNSUBSCRIBE or update options visit: http://lists.digium.com/mailman/listinfo/asterisk-users
Re: [asterisk-users] Asterisk on Debian / Sparc taking up 95%+ CPU with No calls on the system
On Wed, Jul 6, 2011 at 1:49 AM, Faisal Hanif fai...@vopium.com wrote: You have to provide channel ID to command like “channel request hangup SIP/12316156-sad4d46a5”. ** Thanks, but all is also a valid keyword according to the documentation. I think there are some bugs associated with hung channels. Nothing seems to work when a channel is hung in that state. hanging up is not working, nor the AMI is working in providing status etc. and when I'm on the CLI, even core stop now doesn't work and it hands the CLI. Something is majorly wrong. I'm going to upgrade the version to 1.8.4.4 and see what happens ** *From:* asterisk-users-boun...@lists.digium.com [mailto: asterisk-users-boun...@lists.digium.com] *On Behalf Of *A E [Gmail] *Sent:* Wednesday, July 06, 2011 9:50 AM *To:* Asterisk Users Mailing List - Non-Commercial Discussion *Subject:* Re: [asterisk-users] Asterisk on Debian / Sparc taking up 95%+ CPU with No calls on the system ** ** ** ** On Wed, Jul 6, 2011 at 12:00 AM, Daniel - Asterisk earohua...@gmail.com wrote: On the CLI write: sip show channels If there are lots of bye channels you have the same problem than me. I've tried waiting with the call generator -sipp- and channels finished when there are a few. But they're not ending faster enough when I send lots of concurrent calls. Elder Hi, thanks for the response. yeah I'd checked that before and I only have 2 dialogs which seem to be part of the same call that are just sitting there and I can't seem to get them to hang up by typing channel request hangup all . I even tried sending a Hangup by connecting on the AMI but that doesn't seem to be doing anything either. So this channel is sitting there in the 'BYE' state. Is there anyway of clearing them without having to reload/restart Asterisk? I want to see if that's the cause of the CPU usage and I'll lose that if I restart Asterisk. Thanks ** ** 2011/7/5, A E [Gmail] all.efor...@gmail.com: hello people, I am running v1.8.4.2 on debian squeeze on a sparc platform...and for some reason I have noticed that only after a few test calls, the asterisk process is running between 95% - 99.9% CPU when there's absolutely nothing on the system. This is a clean Asterisk system in an internal network with nothing else on it with no calls on it but it's still sitting with 96% CPU. I'm not a developer so not that ept with using debug tools etc to figure out why it's doing that. Could anyone please tell me how I can figure out why it's doing this and/or help debug this. Makes no sense for it to be using CPU with nothing happening on the system Thanks -- Enviado desde mi dispositivo móvil -- _ -- Bandwidth and Colocation Provided by http://www.api-digital.com -- New to Asterisk? Join us for a live introductory webinar every Thurs: http://www.asterisk.org/hello asterisk-users mailing list To UNSUBSCRIBE or update options visit: http://lists.digium.com/mailman/listinfo/asterisk-users ** ** -- _ -- Bandwidth and Colocation Provided by http://www.api-digital.com -- New to Asterisk? Join us for a live introductory webinar every Thurs: http://www.asterisk.org/hello asterisk-users mailing list To UNSUBSCRIBE or update options visit: http://lists.digium.com/mailman/listinfo/asterisk-users -- _ -- Bandwidth and Colocation Provided by http://www.api-digital.com -- New to Asterisk? Join us for a live introductory webinar every Thurs: http://www.asterisk.org/hello asterisk-users mailing list To UNSUBSCRIBE or update options visit: http://lists.digium.com/mailman/listinfo/asterisk-users
