[Pgpool-general] seemingly hung pgpool process consuming 100% CPU

2011-09-07 Thread Lonni J Friedman
Greetings, I'm running pgpool-3.0.4 on a Linux-x86_64 server serving as a load balancer for a three server postgresql-9.0.4 cluster (1 master, 2 standby). I'm seeing strange behavior where a single pgpool process seems to hang after some period of time, and then consume 100% of the CPU. I've seen

Re: [Pgpool-general] seemingly hung pgpool process consuming 100% CPU

2011-09-09 Thread Lonni J Friedman
No one else has experienced this or has suggestions how to debug it? On Wed, Sep 7, 2011 at 12:49 PM, Lonni J Friedman wrote: > Greetings, > I'm running pgpool-3.0.4 on a Linux-x86_64 server serving as a load > balancer for a three server postgresql-9.0.4 cluster (1 master, 2 > standby).  I'm see

Re: [Pgpool-general] seemingly hung pgpool process consuming 100% CPU

2011-09-14 Thread Lonni J Friedman
This problem has returned yet again: PID USER PR NI VIRT RES SHR S %CPU %MEMTIME+ COMMAND 29191 postgres 20 0 80192 14m 1544 R 89.8 0.2 51:15.91 pgpool postgres 29191 3.4 0.1 80192 14728 ?RSep13 51:40 pgpool: lfriedman nightly 10.31.96.84(61698) idle I'd rea

Re: [Pgpool-general] seemingly hung pgpool process consuming 100% CPU

2011-09-14 Thread Tatsuo Ishii
Please use gdb. For example, become postgres user (or root user) gdb pgpool 29191 bt cont bt cont : : : This will give us an idea where it's looping. -- Tatsuo Ishii SRA OSS, Inc. Japan English: http://www.sraoss.co.jp/index_en.php Japanese: http://www.sraoss.co.jp > This problem has returned ye

Re: [Pgpool-general] seemingly hung pgpool process consuming 100% CPU

2011-09-14 Thread Lonni J Friedman
Thanks for your reply. I'll do this the next time this happens (which will likely be within a few days based on history). On Wed, Sep 14, 2011 at 3:57 PM, Tatsuo Ishii wrote: > Please use gdb. For example, > > become postgres user (or root user) > gdb pgpool 29191 > bt > cont > bt > cont > : > :

Re: [Pgpool-general] seemingly hung pgpool process consuming 100% CPU

2011-09-18 Thread Lonni J Friedman
This happened again. I ran the gdb command that you requested, however it occurred to me that the output may not be all that useful since I'm not running a debug build of pgpool: ### # gdb pgpool 2343 GNU gdb (GDB) Red Hat Enterprise Linux (7.1-29.el6) Copyright (C) 2010 Free Software

Re: [Pgpool-general] seemingly hung pgpool process consuming 100% CPU

2011-09-19 Thread Tatsuo Ishii
It's really hard to find the cause of the problem from a stack trace without symbol tables... Is it possible to reinstalll pgpool binary with debug symbols? -- Tatsuo Ishii SRA OSS, Inc. Japan English: http://www.sraoss.co.jp/index_en.php Japanese: http://www.sraoss.co.jp > This happened again. I

Re: [Pgpool-general] seemingly hung pgpool process consuming 100% CPU

2011-09-20 Thread Lonni J Friedman
I tried to do that, but pgpool refuses to start reporting: -bash: /usr/lib/debug/usr/sbin/pgpool.debug: bad ELF interpreter: No such file or directory I'm puzzled why it fails, as it was built on the same server where I built the (working) release build of pgpool. $ file /usr/lib/debug/usr/sbin/p

Re: [Pgpool-general] seemingly hung pgpool process consuming 100% CPU

2011-09-20 Thread Lonni J Friedman
Nevermind, I figured out what I was doing wrong. Now I just need for this to hang again. On Tue, Sep 20, 2011 at 9:08 AM, Lonni J Friedman wrote: > I tried to do that, but pgpool refuses to start reporting: > -bash: /usr/lib/debug/usr/sbin/pgpool.debug: bad ELF interpreter: No > such file or dir

Re: [Pgpool-general] seemingly hung pgpool process consuming 100% CPU

2011-11-22 Thread Lonni J Friedman
This hadn't reproduced in a long time, but we ugpraded to pgpool-3.1 a week ago, and this morning I found a pgpool process that was consuming 100% CPU, and had been running for a week (although wasn't consuming 100% CPU the entire time). Something else weird is that it showed an active, idle conne

Re: [Pgpool-general] seemingly hung pgpool process consuming 100% CPU

2011-11-23 Thread Lonni J Friedman
Not wanting to be impatient, but I'm very concerned about this problem, since its impossible to predict when it will occur. Is there additional information that I can provide to investigate this further? thanks On Tue, Nov 22, 2011 at 10:11 AM, Lonni J Friedman wrote: > This hadn't reproduced i

Re: [Pgpool-general] seemingly hung pgpool process consuming 100% CPU

2011-11-23 Thread Tatsuo Ishii
> Not wanting to be impatient, but I'm very concerned about this > problem, since its impossible to predict when it will occur. Is there > additional information that I can provide to investigate this further? I really need to know where pgpool is looping. -- Tatsuo Ishii SRA OSS, Inc. Japan Engl

Re: [Pgpool-general] seemingly hung pgpool process consuming 100% CPU

2011-11-23 Thread Lonni J Friedman
On Wed, Nov 23, 2011 at 10:42 PM, Tatsuo Ishii wrote: >> Not wanting to be impatient, but I'm very concerned about this >> problem, since its impossible to predict when it will occur.  Is there >> additional information that I can provide to investigate this further? > > I really need to know wher

Re: [Pgpool-general] seemingly hung pgpool process consuming 100% CPU

2011-11-23 Thread Tatsuo Ishii
> On Wed, Nov 23, 2011 at 10:42 PM, Tatsuo Ishii wrote: >>> Not wanting to be impatient, but I'm very concerned about this >>> problem, since its impossible to predict when it will occur.  Is there >>> additional information that I can provide to investigate this further? >> >> I really need to kn