On Tue, Jul 15, 2014 at 7:57 PM, Paolo Bonzini <pbonz...@redhat.com> wrote: > Il 13/07/2014 17:29, Andrey Korolyov ha scritto: > >> Small follow-up: issue have probabilistic nature, as it looks - by >> limited number of runs, it is reproducible within three cases: >> 1) live migration went well, I/O locked up, >> 2) live migration failed by timeout, I/O locked up, >> 3) live migration went well and disk was not locked, but on backward >> migration we are always hitting 2). > > > Can you provide a gdb backtrace of case (2)? > > Paolo >
Sorry, I`ve mixed reset into. The timeout on migration happens if there was already hang before reset. Bt-reset and bt-noreset corresponds to two backtraces first of which had hang+reset previously. As it looks by bisection, the problem introduced by fix targeted to patch exactly the same behavior. Moreover, rolling problematic commit back (9a833121eb253589143ff8fe30be8a311a2c16b3) fixes situation for me.
Thread 33 (Thread 0x7fb632fcc700 (LWP 3023)): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162 #1 0x00007fb63ed7e51b in ceph::log::Log::entry (this=0x7fb642f13860) at log/Log.cc:323 #2 0x00007fb63b321e9a in start_thread (arg=0x7fb632fcc700) at pthread_create.c:308 #3 0x00007fb63b04f3dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #4 0x0000000000000000 in ?? () Thread 32 (Thread 0x7fb6327cb700 (LWP 3024)): #0 sem_timedwait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/sem_timedwait.S:102 #1 0x00007fb63ee57b18 in CephContextServiceThread::entry (this=0x7fb642f15630) at common/ceph_context.cc:57 #2 0x00007fb63b321e9a in start_thread (arg=0x7fb6327cb700) at pthread_create.c:308 #3 0x00007fb63b04f3dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #4 0x0000000000000000 in ?? () Thread 31 (Thread 0x7fb631fca700 (LWP 3025)): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162 #1 0x00007fb63ed9ae6b in Wait (mutex=..., this=0x7fb642f1afa0) at ./common/Cond.h:55 #2 DispatchQueue::entry (this=0x7fb642f1af38) at msg/DispatchQueue.cc:129 #3 0x00007fb63ee035ad in DispatchQueue::DispatchThread::entry (this=<optimized out>) at msg/DispatchQueue.h:104 #4 0x00007fb63b321e9a in start_thread (arg=0x7fb631fca700) at pthread_create.c:308 #5 0x00007fb63b04f3dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 30 (Thread 0x7fb6317c9700 (LWP 3026)): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162 #1 0x00007fb63edff5f0 in Wait (mutex=..., this=0x7fb642f1b360) at ./common/Cond.h:55 #2 SimpleMessenger::reaper_entry (this=0x7fb642f1ae50) at msg/SimpleMessenger.cc:206 #3 0x00007fb63ee03e7d in SimpleMessenger::ReaperThread::entry (this=<optimized out>) at msg/SimpleMessenger.h:422 #4 0x00007fb63b321e9a in start_thread (arg=0x7fb6317c9700) at pthread_create.c:308 #5 0x00007fb63b04f3dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 29 (Thread 0x7fb630fc8700 (LWP 3027)): #0 pthread_cond_timedwait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:215 #1 0x00007fb63ed33238 in WaitUntil (when=..., mutex=..., this=0x7fb642f15a40) at common/Cond.h:71 #2 SafeTimer::timer_thread (this=0x7fb642f15a30) at common/Timer.cc:114 #3 0x00007fb63ed3416d in SafeTimerThread::entry (this=<optimized out>) at common/Timer.cc:38 #4 0x00007fb63b321e9a in start_thread (arg=0x7fb630fc8700) at pthread_create.c:308 #5 0x00007fb63b04f3dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 28 (Thread 0x7fb6307c7700 (LWP 3028)): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162 #1 0x00007fb63ed34bdf in Wait (mutex=..., this=0x7fb642f15b58) at ./common/Cond.h:55 #2 Finisher::finisher_thread_entry (this=0x7fb642f15af8) at common/Finisher.cc:80 #3 0x00007fb63b321e9a in start_thread (arg=0x7fb6307c7700) at pthread_create.c:308 #4 0x00007fb63b04f3dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #5 0x0000000000000000 in ?? () Thread 27 (Thread 0x7fb62ffc6700 (LWP 3029)): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162 #1 0x00007fb63edeee1e in Wait (mutex=..., this=0x7fb642f1d1e8) at ./common/Cond.h:55 #2 Pipe::writer (this=0x7fb642f1d000) at msg/Pipe.cc:1610 #3 0x00007fb63edfa1dd in Pipe::Writer::entry (this=<optimized out>) at msg/Pipe.h:59 #4 0x00007fb63b321e9a in start_thread (arg=0x7fb62ffc6700) at pthread_create.c:308 #5 0x00007fb63b04f3dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 26 (Thread 0x7fb62fec5700 (LWP 3030)): #0 0x00007fb63b043a13 in __GI___poll (fds=<optimized out>, nfds=<optimized out>, timeout=<optimized out>) at ../sysdeps/unix/sysv/linux/poll.c:87 #1 0x00007fb63ede3f0c in Pipe::tcp_read_wait (this=this@entry=0x7fb642f1d000) at msg/Pipe.cc:2144 #2 0x00007fb63ede41d0 in Pipe::tcp_read (this=this@entry=0x7fb642f1d000, buf=<optimized out>, buf@entry=0x7fb62fec4aef "\377\a", len=len@entry=1) at msg/Pipe.cc:2117 #3 0x00007fb63edf610e in Pipe::reader (this=0x7fb642f1d000) at msg/Pipe.cc:1353 #4 0x00007fb63edfa2fd in Pipe::Reader::entry (this=<optimized out>) at msg/Pipe.h:47 #5 0x00007fb63b321e9a in start_thread (arg=0x7fb62fec5700) at pthread_create.c:308 #6 0x00007fb63b04f3dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #7 0x0000000000000000 in ?? () Thread 25 (Thread 0x7fb62fdc4700 (LWP 3031)): #0 pthread_cond_timedwait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:215 #1 0x00007fb63ed33238 in WaitUntil (when=..., mutex=..., this=0x7fb642f15e48) at common/Cond.h:71 #2 SafeTimer::timer_thread (this=0x7fb642f15e38) at common/Timer.cc:114 #3 0x00007fb63ed3416d in SafeTimerThread::entry (this=<optimized out>) at common/Timer.cc:38 #4 0x00007fb63b321e9a in start_thread (arg=0x7fb62fdc4700) at pthread_create.c:308 #5 0x00007fb63b04f3dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 24 (Thread 0x7fb62f5c3700 (LWP 3032)): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162 #1 0x00007fb63ed34bdf in Wait (mutex=..., this=0x7fb642f15f68) at ./common/Cond.h:55 #2 Finisher::finisher_thread_entry (this=0x7fb642f15f08) at common/Finisher.cc:80 #3 0x00007fb63b321e9a in start_thread (arg=0x7fb62f5c3700) at pthread_create.c:308 #4 0x00007fb63b04f3dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #5 0x0000000000000000 in ?? () Thread 23 (Thread 0x7fb62edc2700 (LWP 3033)): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162 #1 0x00007fb63ed34bdf in Wait (mutex=..., this=0x7fb642f20858) at ./common/Cond.h:55 #2 Finisher::finisher_thread_entry (this=0x7fb642f207f8) at common/Finisher.cc:80 #3 0x00007fb63b321e9a in start_thread (arg=0x7fb62edc2700) at pthread_create.c:308 #4 0x00007fb63b04f3dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #5 0x0000000000000000 in ?? () Thread 22 (Thread 0x7fb62e5c1700 (LWP 3034)): #0 pthread_cond_timedwait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:215 #1 0x00007fb63f9890bc in WaitUntil (when=..., mutex=..., this=0x7fb642f20798) at ./common/Cond.h:71 #2 WaitInterval (interval=..., mutex=..., cct=<optimized out>, this=0x7fb642f20798) at ./common/Cond.h:79 #3 ObjectCacher::flusher_entry (this=0x7fb642f205c0) at osdc/ObjectCacher.cc:1458 #4 0x00007fb63f99c20d in ObjectCacher::FlusherThread::entry (this=<optimized out>) at osdc/ObjectCacher.h:354 #5 0x00007fb63b321e9a in start_thread (arg=0x7fb62e5c1700) at pthread_create.c:308 #6 0x00007fb63b04f3dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #7 0x0000000000000000 in ?? () Thread 21 (Thread 0x7fb62ddc0700 (LWP 3035)): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162 #1 0x00007fb63edeee1e in Wait (mutex=..., this=0x7fb642f21548) at ./common/Cond.h:55 #2 Pipe::writer (this=0x7fb642f21360) at msg/Pipe.cc:1610 #3 0x00007fb63edfa1dd in Pipe::Writer::entry (this=<optimized out>) at msg/Pipe.h:59 #4 0x00007fb63b321e9a in start_thread (arg=0x7fb62ddc0700) at pthread_create.c:308 #5 0x00007fb63b04f3dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 20 (Thread 0x7fb62dcbf700 (LWP 3036)): #0 0x00007fb63b043a13 in __GI___poll (fds=<optimized out>, nfds=<optimized out>, timeout=<optimized out>) at ../sysdeps/unix/sysv/linux/poll.c:87 #1 0x00007fb63ede3f0c in Pipe::tcp_read_wait (this=this@entry=0x7fb642f21360) at msg/Pipe.cc:2144 #2 0x00007fb63ede41d0 in Pipe::tcp_read (this=this@entry=0x7fb642f21360, buf=<optimized out>, buf@entry=0x7fb62dcbeaef "\377\001", len=len@entry=1) at msg/Pipe.cc:2117 #3 0x00007fb63edf610e in Pipe::reader (this=0x7fb642f21360) at msg/Pipe.cc:1353 #4 0x00007fb63edfa2fd in Pipe::Reader::entry (this=<optimized out>) at msg/Pipe.h:47 #5 0x00007fb63b321e9a in start_thread (arg=0x7fb62dcbf700) at pthread_create.c:308 #6 0x00007fb63b04f3dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #7 0x0000000000000000 in ?? () Thread 19 (Thread 0x7fb62dbbe700 (LWP 3037)): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162 #1 0x00007fb63edeee1e in Wait (mutex=..., this=0x7fb642f21be8) at ./common/Cond.h:55 #2 Pipe::writer (this=0x7fb642f21a00) at msg/Pipe.cc:1610 #3 0x00007fb63edfa1dd in Pipe::Writer::entry (this=<optimized out>) at msg/Pipe.h:59 #4 0x00007fb63b321e9a in start_thread (arg=0x7fb62dbbe700) at pthread_create.c:308 #5 0x00007fb63b04f3dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 18 (Thread 0x7fb62dabd700 (LWP 3038)): #0 0x00007fb63b043a13 in __GI___poll (fds=<optimized out>, nfds=<optimized out>, timeout=<optimized out>) at ../sysdeps/unix/sysv/linux/poll.c:87 #1 0x00007fb63ede3f0c in Pipe::tcp_read_wait (this=this@entry=0x7fb642f21a00) at msg/Pipe.cc:2144 #2 0x00007fb63ede41d0 in Pipe::tcp_read (this=this@entry=0x7fb642f21a00, buf=<optimized out>, buf@entry=0x7fb62dabcaef "\377\002", len=len@entry=1) at msg/Pipe.cc:2117 #3 0x00007fb63edf610e in Pipe::reader (this=0x7fb642f21a00) at msg/Pipe.cc:1353 #4 0x00007fb63edfa2fd in Pipe::Reader::entry (this=<optimized out>) at msg/Pipe.h:47 #5 0x00007fb63b321e9a in start_thread (arg=0x7fb62dabd700) at pthread_create.c:308 #6 0x00007fb63b04f3dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #7 0x0000000000000000 in ?? () Thread 17 (Thread 0x7fb62d9bc700 (LWP 3039)): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162 #1 0x00007fb63edeee1e in Wait (mutex=..., this=0x7fb642f224f8) at ./common/Cond.h:55 #2 Pipe::writer (this=0x7fb642f22310) at msg/Pipe.cc:1610 #3 0x00007fb63edfa1dd in Pipe::Writer::entry (this=<optimized out>) at msg/Pipe.h:59 #4 0x00007fb63b321e9a in start_thread (arg=0x7fb62d9bc700) at pthread_create.c:308 #5 0x00007fb63b04f3dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 16 (Thread 0x7fb62d8bb700 (LWP 3040)): #0 0x00007fb63b043a13 in __GI___poll (fds=<optimized out>, nfds=<optimized out>, timeout=<optimized out>) at ../sysdeps/unix/sysv/linux/poll.c:87 #1 0x00007fb63ede3f0c in Pipe::tcp_read_wait (this=this@entry=0x7fb642f22310) at msg/Pipe.cc:2144 #2 0x00007fb63ede41d0 in Pipe::tcp_read (this=this@entry=0x7fb642f22310, buf=<optimized out>, buf@entry=0x7fb62d8baaef "\377\033", len=len@entry=1) at msg/Pipe.cc:2117 #3 0x00007fb63edf610e in Pipe::reader (this=0x7fb642f22310) at msg/Pipe.cc:1353 #4 0x00007fb63edfa2fd in Pipe::Reader::entry (this=<optimized out>) at msg/Pipe.h:47 #5 0x00007fb63b321e9a in start_thread (arg=0x7fb62d8bb700) at pthread_create.c:308 #6 0x00007fb63b04f3dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #7 0x0000000000000000 in ?? () Thread 15 (Thread 0x7fb62d7ba700 (LWP 3041)): #0 0x00007fb63b047c37 in ioctl () at ../sysdeps/unix/syscall-template.S:82 #1 0x00007fb6405560a9 in ?? () #2 0x00007fb6405561e5 in ?? () #3 0x00007fb6405419bc in ?? () #4 0x00007fb63b321e9a in start_thread (arg=0x7fb62d7ba700) at pthread_create.c:308 #5 0x00007fb63b04f3dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 14 (Thread 0x7fb62cfb9700 (LWP 3042)): #0 0x00007fb63b047c37 in ioctl () at ../sysdeps/unix/syscall-template.S:82 #1 0x00007fb6405560a9 in ?? () #2 0x00007fb6405561e5 in ?? () #3 0x00007fb6405419bc in ?? () #4 0x00007fb63b321e9a in start_thread (arg=0x7fb62cfb9700) at pthread_create.c:308 #5 0x00007fb63b04f3dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 13 (Thread 0x7fb5fffff700 (LWP 3043)): #0 0x00007fb63b047c37 in ioctl () at ../sysdeps/unix/syscall-template.S:82 #1 0x00007fb6405560a9 in ?? () #2 0x00007fb6405561e5 in ?? () #3 0x00007fb6405419bc in ?? () #4 0x00007fb63b321e9a in start_thread (arg=0x7fb5fffff700) at pthread_create.c:308 #5 0x00007fb63b04f3dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 12 (Thread 0x7fb5ff7fe700 (LWP 3044)): #0 0x00007fb63b047c37 in ioctl () at ../sysdeps/unix/syscall-template.S:82 #1 0x00007fb6405560a9 in ?? () #2 0x00007fb6405561e5 in ?? () #3 0x00007fb6405419bc in ?? () #4 0x00007fb63b321e9a in start_thread (arg=0x7fb5ff7fe700) at pthread_create.c:308 #5 0x00007fb63b04f3dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 11 (Thread 0x7fb5feffd700 (LWP 3045)): #0 0x00007fb63b047c37 in ioctl () at ../sysdeps/unix/syscall-template.S:82 #1 0x00007fb6405560a9 in ?? () #2 0x00007fb6405561e5 in ?? () #3 0x00007fb6405419bc in ?? () #4 0x00007fb63b321e9a in start_thread (arg=0x7fb5feffd700) at pthread_create.c:308 #5 0x00007fb63b04f3dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 10 (Thread 0x7fb5fe7fc700 (LWP 3046)): #0 0x00007fb63b047c37 in ioctl () at ../sysdeps/unix/syscall-template.S:82 #1 0x00007fb6405560a9 in ?? () #2 0x00007fb6405561e5 in ?? () #3 0x00007fb6405419bc in ?? () #4 0x00007fb63b321e9a in start_thread (arg=0x7fb5fe7fc700) at pthread_create.c:308 #5 0x00007fb63b04f3dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 9 (Thread 0x7fb5fdffb700 (LWP 3047)): #0 0x00007fb63b047c37 in ioctl () at ../sysdeps/unix/syscall-template.S:82 #1 0x00007fb6405560a9 in ?? () #2 0x00007fb6405561e5 in ?? () #3 0x00007fb6405419bc in ?? () #4 0x00007fb63b321e9a in start_thread (arg=0x7fb5fdffb700) at pthread_create.c:308 #5 0x00007fb63b04f3dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 8 (Thread 0x7fb5fd7fa700 (LWP 3048)): #0 0x00007fb63b047c37 in ioctl () at ../sysdeps/unix/syscall-template.S:82 #1 0x00007fb6405560a9 in ?? () #2 0x00007fb6405561e5 in ?? () #3 0x00007fb6405419bc in ?? () #4 0x00007fb63b321e9a in start_thread (arg=0x7fb5fd7fa700) at pthread_create.c:308 #5 0x00007fb63b04f3dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 7 (Thread 0x7fb5fcff9700 (LWP 3049)): #0 0x00007fb63b047c37 in ioctl () at ../sysdeps/unix/syscall-template.S:82 #1 0x00007fb6405560a9 in ?? () #2 0x00007fb6405561e5 in ?? () #3 0x00007fb6405419bc in ?? () #4 0x00007fb63b321e9a in start_thread (arg=0x7fb5fcff9700) at pthread_create.c:308 #5 0x00007fb63b04f3dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 6 (Thread 0x7fb5dffff700 (LWP 3050)): #0 0x00007fb63b047c37 in ioctl () at ../sysdeps/unix/syscall-template.S:82 #1 0x00007fb6405560a9 in ?? () #2 0x00007fb6405561e5 in ?? () #3 0x00007fb6405419bc in ?? () #4 0x00007fb63b321e9a in start_thread (arg=0x7fb5dffff700) at pthread_create.c:308 #5 0x00007fb63b04f3dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 5 (Thread 0x7fb5df7fe700 (LWP 3051)): #0 0x00007fb63b047c37 in ioctl () at ../sysdeps/unix/syscall-template.S:82 #1 0x00007fb6405560a9 in ?? () #2 0x00007fb6405561e5 in ?? () #3 0x00007fb6405419bc in ?? () #4 0x00007fb63b321e9a in start_thread (arg=0x7fb5df7fe700) at pthread_create.c:308 #5 0x00007fb63b04f3dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 4 (Thread 0x7fb5deffd700 (LWP 3052)): #0 0x00007fb63b047c37 in ioctl () at ../sysdeps/unix/syscall-template.S:82 #1 0x00007fb6405560a9 in ?? () #2 0x00007fb6405561e5 in ?? () #3 0x00007fb6405419bc in ?? () #4 0x00007fb63b321e9a in start_thread (arg=0x7fb5deffd700) at pthread_create.c:308 #5 0x00007fb63b04f3dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 3 (Thread 0x7fb62c5ff700 (LWP 3054)): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162 #1 0x00007fb63edeee1e in Wait (mutex=..., this=0x7fb643060548) at ./common/Cond.h:55 #2 Pipe::writer (this=0x7fb643060360) at msg/Pipe.cc:1610 #3 0x00007fb63edfa1dd in Pipe::Writer::entry (this=<optimized out>) at msg/Pipe.h:59 #4 0x00007fb63b321e9a in start_thread (arg=0x7fb62c5ff700) at pthread_create.c:308 #5 0x00007fb63b04f3dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 2 (Thread 0x7fb62c3ff700 (LWP 3055)): #0 0x00007fb63b043a13 in __GI___poll (fds=<optimized out>, nfds=<optimized out>, timeout=<optimized out>) at ../sysdeps/unix/sysv/linux/poll.c:87 #1 0x00007fb63ede3f0c in Pipe::tcp_read_wait (this=this@entry=0x7fb643060360) at msg/Pipe.cc:2144 #2 0x00007fb63ede41d0 in Pipe::tcp_read (this=this@entry=0x7fb643060360, buf=<optimized out>, buf@entry=0x7fb62c3feaef "\377\001", len=len@entry=1) at msg/Pipe.cc:2117 #3 0x00007fb63edf610e in Pipe::reader (this=0x7fb643060360) at msg/Pipe.cc:1353 #4 0x00007fb63edfa2fd in Pipe::Reader::entry (this=<optimized out>) at msg/Pipe.h:47 #5 0x00007fb63b321e9a in start_thread (arg=0x7fb62c3ff700) at pthread_create.c:308 #6 0x00007fb63b04f3dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #7 0x0000000000000000 in ?? () Thread 1 (Thread 0x7fb640349940 (LWP 3020)): #0 0x00007fb63b043ae3 in ppoll (fds=<optimized out>, nfds=<optimized out>, timeout=<optimized out>, sigmask=<optimized out>) at ../sysdeps/unix/sysv/linux/ppoll.c:58 #1 0x00007fb6407b6679 in ?? () #2 0x00007fb6407b5a64 in ?? () #3 0x00007fb640513665 in main ()
Thread 33 (Thread 0x7f0098460700 (LWP 2886)): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162 #1 0x00007f00a421251b in ceph::log::Log::entry (this=0x7f00a7de5860) at log/Log.cc:323 #2 0x00007f00a07b5e9a in start_thread (arg=0x7f0098460700) at pthread_create.c:308 #3 0x00007f00a04e33dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #4 0x0000000000000000 in ?? () Thread 32 (Thread 0x7f0097c5f700 (LWP 2887)): #0 sem_timedwait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/sem_timedwait.S:102 #1 0x00007f00a42ebb18 in CephContextServiceThread::entry (this=0x7f00a7de7630) at common/ceph_context.cc:57 #2 0x00007f00a07b5e9a in start_thread (arg=0x7f0097c5f700) at pthread_create.c:308 #3 0x00007f00a04e33dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #4 0x0000000000000000 in ?? () Thread 31 (Thread 0x7f009745e700 (LWP 2888)): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162 #1 0x00007f00a422ee6b in Wait (mutex=..., this=0x7f00a7decfa0) at ./common/Cond.h:55 #2 DispatchQueue::entry (this=0x7f00a7decf38) at msg/DispatchQueue.cc:129 #3 0x00007f00a42975ad in DispatchQueue::DispatchThread::entry (this=<optimized out>) at msg/DispatchQueue.h:104 #4 0x00007f00a07b5e9a in start_thread (arg=0x7f009745e700) at pthread_create.c:308 #5 0x00007f00a04e33dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 30 (Thread 0x7f0096c5d700 (LWP 2889)): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162 #1 0x00007f00a42935f0 in Wait (mutex=..., this=0x7f00a7ded360) at ./common/Cond.h:55 #2 SimpleMessenger::reaper_entry (this=0x7f00a7dece50) at msg/SimpleMessenger.cc:206 #3 0x00007f00a4297e7d in SimpleMessenger::ReaperThread::entry (this=<optimized out>) at msg/SimpleMessenger.h:422 #4 0x00007f00a07b5e9a in start_thread (arg=0x7f0096c5d700) at pthread_create.c:308 #5 0x00007f00a04e33dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 29 (Thread 0x7f009645c700 (LWP 2890)): #0 pthread_cond_timedwait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:215 #1 0x00007f00a41c7238 in WaitUntil (when=..., mutex=..., this=0x7f00a7de7a40) at common/Cond.h:71 #2 SafeTimer::timer_thread (this=0x7f00a7de7a30) at common/Timer.cc:114 #3 0x00007f00a41c816d in SafeTimerThread::entry (this=<optimized out>) at common/Timer.cc:38 #4 0x00007f00a07b5e9a in start_thread (arg=0x7f009645c700) at pthread_create.c:308 #5 0x00007f00a04e33dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 28 (Thread 0x7f0095c5b700 (LWP 2891)): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162 #1 0x00007f00a41c8bdf in Wait (mutex=..., this=0x7f00a7de7b58) at ./common/Cond.h:55 #2 Finisher::finisher_thread_entry (this=0x7f00a7de7af8) at common/Finisher.cc:80 #3 0x00007f00a07b5e9a in start_thread (arg=0x7f0095c5b700) at pthread_create.c:308 #4 0x00007f00a04e33dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #5 0x0000000000000000 in ?? () Thread 27 (Thread 0x7f009545a700 (LWP 2892)): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162 #1 0x00007f00a4282e1e in Wait (mutex=..., this=0x7f00a7def1e8) at ./common/Cond.h:55 #2 Pipe::writer (this=0x7f00a7def000) at msg/Pipe.cc:1610 #3 0x00007f00a428e1dd in Pipe::Writer::entry (this=<optimized out>) at msg/Pipe.h:59 #4 0x00007f00a07b5e9a in start_thread (arg=0x7f009545a700) at pthread_create.c:308 #5 0x00007f00a04e33dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 26 (Thread 0x7f0095359700 (LWP 2893)): #0 0x00007f00a04d7a13 in __GI___poll (fds=<optimized out>, nfds=<optimized out>, timeout=<optimized out>) at ../sysdeps/unix/sysv/linux/poll.c:87 #1 0x00007f00a4277f0c in Pipe::tcp_read_wait (this=this@entry=0x7f00a7def000) at msg/Pipe.cc:2144 #2 0x00007f00a42781d0 in Pipe::tcp_read (this=this@entry=0x7f00a7def000, buf=<optimized out>, buf@entry=0x7f0095358aef "\377\b", len=len@entry=1) at msg/Pipe.cc:2117 #3 0x00007f00a428a10e in Pipe::reader (this=0x7f00a7def000) at msg/Pipe.cc:1353 #4 0x00007f00a428e2fd in Pipe::Reader::entry (this=<optimized out>) at msg/Pipe.h:47 #5 0x00007f00a07b5e9a in start_thread (arg=0x7f0095359700) at pthread_create.c:308 #6 0x00007f00a04e33dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #7 0x0000000000000000 in ?? () Thread 25 (Thread 0x7f0095258700 (LWP 2894)): #0 pthread_cond_timedwait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:215 #1 0x00007f00a41c7238 in WaitUntil (when=..., mutex=..., this=0x7f00a7de7e48) at common/Cond.h:71 #2 SafeTimer::timer_thread (this=0x7f00a7de7e38) at common/Timer.cc:114 #3 0x00007f00a41c816d in SafeTimerThread::entry (this=<optimized out>) at common/Timer.cc:38 #4 0x00007f00a07b5e9a in start_thread (arg=0x7f0095258700) at pthread_create.c:308 #5 0x00007f00a04e33dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 24 (Thread 0x7f0094a57700 (LWP 2895)): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162 #1 0x00007f00a41c8bdf in Wait (mutex=..., this=0x7f00a7de7f68) at ./common/Cond.h:55 #2 Finisher::finisher_thread_entry (this=0x7f00a7de7f08) at common/Finisher.cc:80 #3 0x00007f00a07b5e9a in start_thread (arg=0x7f0094a57700) at pthread_create.c:308 #4 0x00007f00a04e33dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #5 0x0000000000000000 in ?? () Thread 23 (Thread 0x7f0087fff700 (LWP 2896)): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162 #1 0x00007f00a41c8bdf in Wait (mutex=..., this=0x7f00a7df2858) at ./common/Cond.h:55 #2 Finisher::finisher_thread_entry (this=0x7f00a7df27f8) at common/Finisher.cc:80 #3 0x00007f00a07b5e9a in start_thread (arg=0x7f0087fff700) at pthread_create.c:308 #4 0x00007f00a04e33dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #5 0x0000000000000000 in ?? () Thread 22 (Thread 0x7f00877fe700 (LWP 2897)): #0 pthread_cond_timedwait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_timedwait.S:215 #1 0x00007f00a4e1d0bc in WaitUntil (when=..., mutex=..., this=0x7f00a7df2798) at ./common/Cond.h:71 #2 WaitInterval (interval=..., mutex=..., cct=<optimized out>, this=0x7f00a7df2798) at ./common/Cond.h:79 #3 ObjectCacher::flusher_entry (this=0x7f00a7df25c0) at osdc/ObjectCacher.cc:1458 #4 0x00007f00a4e3020d in ObjectCacher::FlusherThread::entry (this=<optimized out>) at osdc/ObjectCacher.h:354 #5 0x00007f00a07b5e9a in start_thread (arg=0x7f00877fe700) at pthread_create.c:308 #6 0x00007f00a04e33dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #7 0x0000000000000000 in ?? () Thread 21 (Thread 0x7f0094256700 (LWP 2898)): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162 #1 0x00007f00a4282e1e in Wait (mutex=..., this=0x7f00a7df3548) at ./common/Cond.h:55 #2 Pipe::writer (this=0x7f00a7df3360) at msg/Pipe.cc:1610 #3 0x00007f00a428e1dd in Pipe::Writer::entry (this=<optimized out>) at msg/Pipe.h:59 #4 0x00007f00a07b5e9a in start_thread (arg=0x7f0094256700) at pthread_create.c:308 #5 0x00007f00a04e33dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 20 (Thread 0x7f0094155700 (LWP 2899)): #0 0x00007f00a04d7a13 in __GI___poll (fds=<optimized out>, nfds=<optimized out>, timeout=<optimized out>) at ../sysdeps/unix/sysv/linux/poll.c:87 #1 0x00007f00a4277f0c in Pipe::tcp_read_wait (this=this@entry=0x7f00a7df3360) at msg/Pipe.cc:2144 #2 0x00007f00a42781d0 in Pipe::tcp_read (this=this@entry=0x7f00a7df3360, buf=<optimized out>, buf@entry=0x7f0094154aef "\377\001", len=len@entry=1) at msg/Pipe.cc:2117 #3 0x00007f00a428a10e in Pipe::reader (this=0x7f00a7df3360) at msg/Pipe.cc:1353 #4 0x00007f00a428e2fd in Pipe::Reader::entry (this=<optimized out>) at msg/Pipe.h:47 #5 0x00007f00a07b5e9a in start_thread (arg=0x7f0094155700) at pthread_create.c:308 #6 0x00007f00a04e33dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #7 0x0000000000000000 in ?? () Thread 19 (Thread 0x7f0086ffd700 (LWP 2900)): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162 #1 0x00007f00a4282e1e in Wait (mutex=..., this=0x7f00a7df3be8) at ./common/Cond.h:55 #2 Pipe::writer (this=0x7f00a7df3a00) at msg/Pipe.cc:1610 #3 0x00007f00a428e1dd in Pipe::Writer::entry (this=<optimized out>) at msg/Pipe.h:59 #4 0x00007f00a07b5e9a in start_thread (arg=0x7f0086ffd700) at pthread_create.c:308 #5 0x00007f00a04e33dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 18 (Thread 0x7f0086efc700 (LWP 2901)): #0 0x00007f00a04d7a13 in __GI___poll (fds=<optimized out>, nfds=<optimized out>, timeout=<optimized out>) at ../sysdeps/unix/sysv/linux/poll.c:87 #1 0x00007f00a4277f0c in Pipe::tcp_read_wait (this=this@entry=0x7f00a7df3a00) at msg/Pipe.cc:2144 #2 0x00007f00a42781d0 in Pipe::tcp_read (this=this@entry=0x7f00a7df3a00, buf=<optimized out>, buf@entry=0x7f0086efbaef "\377\002", len=len@entry=1) at msg/Pipe.cc:2117 #3 0x00007f00a428a10e in Pipe::reader (this=0x7f00a7df3a00) at msg/Pipe.cc:1353 #4 0x00007f00a428e2fd in Pipe::Reader::entry (this=<optimized out>) at msg/Pipe.h:47 #5 0x00007f00a07b5e9a in start_thread (arg=0x7f0086efc700) at pthread_create.c:308 #6 0x00007f00a04e33dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #7 0x0000000000000000 in ?? () Thread 17 (Thread 0x7f0086dfb700 (LWP 2902)): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162 #1 0x00007f00a4282e1e in Wait (mutex=..., this=0x7f00a7df44f8) at ./common/Cond.h:55 #2 Pipe::writer (this=0x7f00a7df4310) at msg/Pipe.cc:1610 #3 0x00007f00a428e1dd in Pipe::Writer::entry (this=<optimized out>) at msg/Pipe.h:59 #4 0x00007f00a07b5e9a in start_thread (arg=0x7f0086dfb700) at pthread_create.c:308 #5 0x00007f00a04e33dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 16 (Thread 0x7f0086cfa700 (LWP 2903)): #0 0x00007f00a04d7a13 in __GI___poll (fds=<optimized out>, nfds=<optimized out>, timeout=<optimized out>) at ../sysdeps/unix/sysv/linux/poll.c:87 #1 0x00007f00a4277f0c in Pipe::tcp_read_wait (this=this@entry=0x7f00a7df4310) at msg/Pipe.cc:2144 #2 0x00007f00a42781d0 in Pipe::tcp_read (this=this@entry=0x7f00a7df4310, buf=<optimized out>, buf@entry=0x7f0086cf9aef "\377.", len=len@entry=1) at msg/Pipe.cc:2117 #3 0x00007f00a428a10e in Pipe::reader (this=0x7f00a7df4310) at msg/Pipe.cc:1353 #4 0x00007f00a428e2fd in Pipe::Reader::entry (this=<optimized out>) at msg/Pipe.h:47 #5 0x00007f00a07b5e9a in start_thread (arg=0x7f0086cfa700) at pthread_create.c:308 #6 0x00007f00a04e33dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #7 0x0000000000000000 in ?? () Thread 15 (Thread 0x7f0086bf9700 (LWP 2904)): #0 0x00007f00a04dbc37 in ioctl () at ../sysdeps/unix/syscall-template.S:82 #1 0x00007f00a59ea0a9 in ?? () #2 0x00007f00a59ea1e5 in ?? () #3 0x00007f00a59d59bc in ?? () #4 0x00007f00a07b5e9a in start_thread (arg=0x7f0086bf9700) at pthread_create.c:308 #5 0x00007f00a04e33dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 14 (Thread 0x7f00863f8700 (LWP 2905)): #0 0x00007f00a04dbc37 in ioctl () at ../sysdeps/unix/syscall-template.S:82 #1 0x00007f00a59ea0a9 in ?? () #2 0x00007f00a59ea1e5 in ?? () #3 0x00007f00a59d59bc in ?? () #4 0x00007f00a07b5e9a in start_thread (arg=0x7f00863f8700) at pthread_create.c:308 #5 0x00007f00a04e33dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 13 (Thread 0x7f0085bf7700 (LWP 2906)): #0 0x00007f00a04dbc37 in ioctl () at ../sysdeps/unix/syscall-template.S:82 #1 0x00007f00a59ea0a9 in ?? () #2 0x00007f00a59ea1e5 in ?? () #3 0x00007f00a59d59bc in ?? () #4 0x00007f00a07b5e9a in start_thread (arg=0x7f0085bf7700) at pthread_create.c:308 #5 0x00007f00a04e33dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 12 (Thread 0x7f00853f6700 (LWP 2907)): #0 0x00007f00a04dbc37 in ioctl () at ../sysdeps/unix/syscall-template.S:82 #1 0x00007f00a59ea0a9 in ?? () #2 0x00007f00a59ea1e5 in ?? () #3 0x00007f00a59d59bc in ?? () #4 0x00007f00a07b5e9a in start_thread (arg=0x7f00853f6700) at pthread_create.c:308 #5 0x00007f00a04e33dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 11 (Thread 0x7f0084bf5700 (LWP 2908)): #0 0x00007f00a04dbc37 in ioctl () at ../sysdeps/unix/syscall-template.S:82 #1 0x00007f00a59ea0a9 in ?? () #2 0x00007f00a59ea1e5 in ?? () #3 0x00007f00a59d59bc in ?? () #4 0x00007f00a07b5e9a in start_thread (arg=0x7f0084bf5700) at pthread_create.c:308 #5 0x00007f00a04e33dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 10 (Thread 0x7f0057fff700 (LWP 2909)): #0 0x00007f00a04dbc37 in ioctl () at ../sysdeps/unix/syscall-template.S:82 #1 0x00007f00a59ea0a9 in ?? () #2 0x00007f00a59ea1e5 in ?? () #3 0x00007f00a59d59bc in ?? () #4 0x00007f00a07b5e9a in start_thread (arg=0x7f0057fff700) at pthread_create.c:308 #5 0x00007f00a04e33dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 9 (Thread 0x7f00577fe700 (LWP 2910)): #0 0x00007f00a04dbc37 in ioctl () at ../sysdeps/unix/syscall-template.S:82 #1 0x00007f00a59ea0a9 in ?? () #2 0x00007f00a59ea1e5 in ?? () #3 0x00007f00a59d59bc in ?? () #4 0x00007f00a07b5e9a in start_thread (arg=0x7f00577fe700) at pthread_create.c:308 #5 0x00007f00a04e33dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 8 (Thread 0x7f0056ffd700 (LWP 2911)): #0 0x00007f00a04dbc37 in ioctl () at ../sysdeps/unix/syscall-template.S:82 #1 0x00007f00a59ea0a9 in ?? () #2 0x00007f00a59ea1e5 in ?? () #3 0x00007f00a59d59bc in ?? () #4 0x00007f00a07b5e9a in start_thread (arg=0x7f0056ffd700) at pthread_create.c:308 #5 0x00007f00a04e33dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 7 (Thread 0x7f00567fc700 (LWP 2912)): #0 0x00007f00a04dbc37 in ioctl () at ../sysdeps/unix/syscall-template.S:82 #1 0x00007f00a59ea0a9 in ?? () #2 0x00007f00a59ea1e5 in ?? () #3 0x00007f00a59d59bc in ?? () #4 0x00007f00a07b5e9a in start_thread (arg=0x7f00567fc700) at pthread_create.c:308 #5 0x00007f00a04e33dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 6 (Thread 0x7f0055ffb700 (LWP 2913)): #0 0x00007f00a04dbc37 in ioctl () at ../sysdeps/unix/syscall-template.S:82 #1 0x00007f00a59ea0a9 in ?? () #2 0x00007f00a59ea1e5 in ?? () #3 0x00007f00a59d59bc in ?? () #4 0x00007f00a07b5e9a in start_thread (arg=0x7f0055ffb700) at pthread_create.c:308 #5 0x00007f00a04e33dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 5 (Thread 0x7f00557fa700 (LWP 2914)): #0 0x00007f00a04dbc37 in ioctl () at ../sysdeps/unix/syscall-template.S:82 #1 0x00007f00a59ea0a9 in ?? () #2 0x00007f00a59ea1e5 in ?? () #3 0x00007f00a59d59bc in ?? () #4 0x00007f00a07b5e9a in start_thread (arg=0x7f00557fa700) at pthread_create.c:308 #5 0x00007f00a04e33dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 4 (Thread 0x7f0054ff9700 (LWP 2915)): #0 0x00007f00a04dbc37 in ioctl () at ../sysdeps/unix/syscall-template.S:82 #1 0x00007f00a59ea0a9 in ?? () #2 0x00007f00a59ea1e5 in ?? () #3 0x00007f00a59d59bc in ?? () #4 0x00007f00a07b5e9a in start_thread (arg=0x7f0054ff9700) at pthread_create.c:308 #5 0x00007f00a04e33dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 3 (Thread 0x7f00841ff700 (LWP 2917)): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162 #1 0x00007f00a4282e1e in Wait (mutex=..., this=0x7f00a7f32548) at ./common/Cond.h:55 #2 Pipe::writer (this=0x7f00a7f32360) at msg/Pipe.cc:1610 #3 0x00007f00a428e1dd in Pipe::Writer::entry (this=<optimized out>) at msg/Pipe.h:59 #4 0x00007f00a07b5e9a in start_thread (arg=0x7f00841ff700) at pthread_create.c:308 #5 0x00007f00a04e33dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #6 0x0000000000000000 in ?? () Thread 2 (Thread 0x7f00547f8700 (LWP 2918)): #0 0x00007f00a04d7a13 in __GI___poll (fds=<optimized out>, nfds=<optimized out>, timeout=<optimized out>) at ../sysdeps/unix/sysv/linux/poll.c:87 #1 0x00007f00a4277f0c in Pipe::tcp_read_wait (this=this@entry=0x7f00a7f32360) at msg/Pipe.cc:2144 #2 0x00007f00a42781d0 in Pipe::tcp_read (this=this@entry=0x7f00a7f32360, buf=<optimized out>, buf@entry=0x7f00547f7aef "\377\001", len=len@entry=1) at msg/Pipe.cc:2117 #3 0x00007f00a428a10e in Pipe::reader (this=0x7f00a7f32360) at msg/Pipe.cc:1353 #4 0x00007f00a428e2fd in Pipe::Reader::entry (this=<optimized out>) at msg/Pipe.h:47 #5 0x00007f00a07b5e9a in start_thread (arg=0x7f00547f8700) at pthread_create.c:308 #6 0x00007f00a04e33dd in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112 #7 0x0000000000000000 in ?? () Thread 1 (Thread 0x7f00a57dd940 (LWP 2883)): #0 0x00007f00a04d7ae3 in ppoll (fds=<optimized out>, nfds=<optimized out>, timeout=<optimized out>, sigmask=<optimized out>) at ../sysdeps/unix/sysv/linux/ppoll.c:58 #1 0x00007f00a5c4a679 in ?? () #2 0x00007f00a5c49a64 in ?? () #3 0x00007f00a59a7665 in main ()
