Re: [firebird-support] server 2.5.8 deadlocked

2018-02-12 Thread Hamish Moffatt ham...@risingsoftware.com [firebird-support] 
On 13/02/18 13:07, Hamish Moffatt ham...@risingsoftware.com 
[firebird-support] wrote:


I'm getting the Firebird 2.5 superclassic server on Linux deadlocking
regularly at the moment. Twice in one day last week, and again today
after uptime of less than 6 hours.

I just upgraded to 2.5.8 today, from 2.5.6. Our workload isn't huge, but
we do have a lot of small databases and maybe up to 100 client
connections at once.



For what it's worth, I have occasional remote connections over the 
Internet with latency of about 160ms (US east coast to Australia).


This is very slow with Firebird 2.5 but we only need to fetch one row 
from a db so it's acceptable to us.


Twice I think the deadlock condition has coincided such with a remote 
request.


Could this be a factor?

Hamish

Re: [firebird-support] server 2.5.8 deadlocked

2018-02-12 Thread HuI HaO huihaoc...@hotmail.com [firebird-support] 
any solution find？i have same problem also

From Hugo Chia

On 13 Feb 2018, at 10:07 AM, Hamish Moffatt 
ham...@risingsoftware.com [firebird-support] 
> 
wrote:



I'm getting the Firebird 2.5 superclassic server on Linux deadlocking
regularly at the moment. Twice in one day last week, and again today
after uptime of less than 6 hours.

I just upgraded to 2.5.8 today, from 2.5.6. Our workload isn't huge, but
we do have a lot of small databases and maybe up to 100 client
connections at once.

I attached gdb and dumped the state of all threads, which shows every
one of them is waiting on a mutex or futex, ie it's dead locked. I've
attached the trace.

How can I debug this?

Would I be better off with superserver?

I can't connect with isql when it's in this state (it hangs).

Hamish

--

Thread 54 (Thread 0x9342bb40 (LWP 31639)):
#0 0xb7fccd81 in __kernel_vsyscall ()
#1 0xb782fb9b in pthread_cond_wait@@GLIBC_2.3.2 () at 
../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
#2 0xb7beab97 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#3 0xb7d98653 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#4 0xb7d9dc9d in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#5 0xb7a64835 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#6 0xb782a27a in start_thread (arg=0x9342bb40) at pthread_create.c:333
#7 0xb7753b56 in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:110

Thread 53 (Thread 0x8f7adb40 (LWP 31616)):
#0 0xb7fccd81 in __kernel_vsyscall ()
#1 0xb782fb9b in pthread_cond_wait@@GLIBC_2.3.2 () at 
../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
#2 0xb7beab97 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#3 0xb7d98653 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#4 0xb7d9dc9d in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#5 0xb7a64835 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#6 0xb782a27a in start_thread (arg=0x8f7adb40) at pthread_create.c:333
#7 0xb7753b56 in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:110

Thread 52 (Thread 0x8ffaeb40 (LWP 31603)):
#0 0xb7fccd81 in __kernel_vsyscall ()
#1 0xb782fb9b in pthread_cond_wait@@GLIBC_2.3.2 () at 
../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
#2 0xb7beab97 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#3 0xb7d98653 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#4 0xb7d9dc9d in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#5 0xb7a64835 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#6 0xb782a27a in start_thread (arg=0x8ffaeb40) at pthread_create.c:333
#7 0xb7753b56 in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:110

Thread 51 (Thread 0x94c2eb40 (LWP 30369)):
#0 0xb7fccd81 in __kernel_vsyscall ()
#1 0xb782fb9b in pthread_cond_wait@@GLIBC_2.3.2 () at 
../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
#2 0xb7beab97 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#3 0xb7b94bc8 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#4 0xb7b95e3d in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#5 0xb7a64835 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#6 0xb782a27a in start_thread (arg=0x94c2eb40) at pthread_create.c:333
#7 0xb7753b56 in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:110

Thread 50 (Thread 0x9a439b40 (LWP 30333)):
#0 0xb7fccd81 in __kernel_vsyscall ()
#1 0xb782fb9b in pthread_cond_wait@@GLIBC_2.3.2 () at 
../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
#2 0xb7beab97 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#3 0xb7d98653 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#4 0xb7d9dc9d in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#5 0xb7a64835 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#6 0xb782a27a in start_thread (arg=0x9a439b40) at pthread_create.c:333
#7 0xb7753b56 in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:110

Thread 49 (Thread 0x9542fb40 (LWP 28376)):
#0 0xb7fccd81 in __kernel_vsyscall ()
#1 0xb782fb9b in pthread_cond_wait@@GLIBC_2.3.2 () at 
../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
#2 0xb7beab97 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#3 0xb7b94bc8 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#4 0xb7b95e3d in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#5 0xb7a64835 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#6 0xb782a27a in start_thread (arg=0x9542fb40) at pthread_create.c:333
#7 0xb7753b56 in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:110

Thread 48 (Thread 0x917b1b40 (LWP 28374)):
#0 0xb7fccd81 in __kernel_vsyscall ()
#1 0xb782fb9b in pthread_cond_wait@@GLIBC_2.3.2 () at 
../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
#2 0xb7beab97 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#3 0xb7d98653 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#4 0xb7d9dc9d in ?? () from

[firebird-support] server 2.5.8 deadlocked

2018-02-12 Thread Hamish Moffatt ham...@risingsoftware.com [firebird-support] 
I'm getting the Firebird 2.5 superclassic server on Linux deadlocking 
regularly at the moment. Twice in one day last week, and again today 
after uptime of less than 6 hours.

I just upgraded to 2.5.8 today, from 2.5.6. Our workload isn't huge, but 
we do have a lot of small databases and maybe up to 100 client 
connections at once.


I attached gdb and dumped the state of all threads, which shows every 
one of them is waiting on a mutex or futex, ie it's dead locked. I've 
attached the trace.

How can I debug this?

Would I be better off with superserver?


I can't connect with isql when it's in this state (it hangs).


Hamish


  --

Thread 54 (Thread 0x9342bb40 (LWP 31639)):
#0  0xb7fccd81 in __kernel_vsyscall ()
#1  0xb782fb9b in pthread_cond_wait@@GLIBC_2.3.2 () at 
../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
#2  0xb7beab97 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#3  0xb7d98653 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#4  0xb7d9dc9d in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#5  0xb7a64835 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#6  0xb782a27a in start_thread (arg=0x9342bb40) at pthread_create.c:333
#7  0xb7753b56 in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:110

Thread 53 (Thread 0x8f7adb40 (LWP 31616)):
#0  0xb7fccd81 in __kernel_vsyscall ()
#1  0xb782fb9b in pthread_cond_wait@@GLIBC_2.3.2 () at 
../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
#2  0xb7beab97 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#3  0xb7d98653 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#4  0xb7d9dc9d in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#5  0xb7a64835 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#6  0xb782a27a in start_thread (arg=0x8f7adb40) at pthread_create.c:333
#7  0xb7753b56 in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:110

Thread 52 (Thread 0x8ffaeb40 (LWP 31603)):
#0  0xb7fccd81 in __kernel_vsyscall ()
#1  0xb782fb9b in pthread_cond_wait@@GLIBC_2.3.2 () at 
../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
#2  0xb7beab97 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#3  0xb7d98653 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#4  0xb7d9dc9d in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#5  0xb7a64835 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#6  0xb782a27a in start_thread (arg=0x8ffaeb40) at pthread_create.c:333
#7  0xb7753b56 in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:110

Thread 51 (Thread 0x94c2eb40 (LWP 30369)):
#0  0xb7fccd81 in __kernel_vsyscall ()
#1  0xb782fb9b in pthread_cond_wait@@GLIBC_2.3.2 () at 
../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
#2  0xb7beab97 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#3  0xb7b94bc8 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#4  0xb7b95e3d in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#5  0xb7a64835 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#6  0xb782a27a in start_thread (arg=0x94c2eb40) at pthread_create.c:333
#7  0xb7753b56 in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:110

Thread 50 (Thread 0x9a439b40 (LWP 30333)):
#0  0xb7fccd81 in __kernel_vsyscall ()
#1  0xb782fb9b in pthread_cond_wait@@GLIBC_2.3.2 () at 
../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
#2  0xb7beab97 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#3  0xb7d98653 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#4  0xb7d9dc9d in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#5  0xb7a64835 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#6  0xb782a27a in start_thread (arg=0x9a439b40) at pthread_create.c:333
#7  0xb7753b56 in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:110

Thread 49 (Thread 0x9542fb40 (LWP 28376)):
#0  0xb7fccd81 in __kernel_vsyscall ()
#1  0xb782fb9b in pthread_cond_wait@@GLIBC_2.3.2 () at 
../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
#2  0xb7beab97 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#3  0xb7b94bc8 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#4  0xb7b95e3d in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#5  0xb7a64835 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#6  0xb782a27a in start_thread (arg=0x9542fb40) at pthread_create.c:333
#7  0xb7753b56 in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:110

Thread 48 (Thread 0x917b1b40 (LWP 28374)):
#0  0xb7fccd81 in __kernel_vsyscall ()
#1  0xb782fb9b in pthread_cond_wait@@GLIBC_2.3.2 () at 
../sysdeps/unix/sysv/linux/i386/pthread_cond_wait.S:187
#2  0xb7beab97 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#3  0xb7d98653 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#4  0xb7d9dc9d in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#5  0xb7a64835 in ?? () from /usr/lib/i386-linux-gnu/libfbembed.so.2.5
#6  0xb782a27a in start_thread (arg=0x917b1b40) at pthread_create.c:333
#7  0xb7753b56 in clone () at