On Tue, 14 Mar 2023 at 10:12, Dr. David Alan Gilbert
<dgilb...@redhat.com> wrote:
>
> Copying Peter Xu on this one since it's poscopy, especially the newer
> postcopy preempt.
>
> * Peter Maydell (peter.mayd...@linaro.org) wrote:
> > On Sun, 12 Mar 2023 at 14:06, Peter Maydell <peter.mayd...@linaro.org>
> > wrote:
> > > Here's another one, on the s390x CI runner:
> > > https://gitlab.com/qemu-project/qemu/-/jobs/3917587994
> >
> > And here's a backtrace from a hung migration-test on the s390x
> > runner (looks like a deadlock, none of these processes were
> > using CPU):
>
> Ah a backtrace!
I've attached another 2 -- migration-test seems to fairly
commonly hang on the s390 CI runner; there are several
stuck tests on it at the moment.
-- PMM
Process tree:
migration-test(1841031)-+-qemu-system-x86(1841381)
`-qemu-system-x86(1841387)
===========================================================
PROCESS: 1841031
gitlab-+ 1841031 1838397 0 Mar13 ? 00:00:02
/home/gitlab-runner/builds/FLaZkdt1/0/qemu-project/qemu/build/tests/qtest/migration-test
--tap -k
[New LWP 1841033]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/s390x-linux-gnu/libthread_db.so.1".
__libc_recv (fd=fd@entry=5, buf=buf@entry=0x3ffdac792e7, len=len@entry=1,
flags=flags@entry=0) at ../sysdeps/unix/sysv/linux/recv.c:30
Thread 2 (Thread 0x3ffb01ff900 (LWP 1841033)):
#0 syscall () at ../sysdeps/unix/sysv/linux/s390/s390-64/syscall.S:37
#1 0x000002aa133dae34 in qemu_futex_wait (val=<optimized out>, f=<optimized
out>) at
/home/gitlab-runner/builds/FLaZkdt1/0/qemu-project/qemu/include/qemu/futex.h:29
#2 qemu_event_wait (ev=ev@entry=0x2aa135596b8 <rcu_call_ready_event>) at
../util/qemu-thread-posix.c:464
#3 0x000002aa134079ea in call_rcu_thread (opaque=opaque@entry=0x0) at
../util/rcu.c:261
#4 0x000002aa133d9e9a in qemu_thread_start (args=<optimized out>) at
../util/qemu-thread-posix.c:541
#5 0x000003ffb0b87e66 in start_thread (arg=0x3ffb01ff900) at
pthread_create.c:477
#6 0x000003ffb0a7cbe6 in thread_start () at
../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65
Thread 1 (Thread 0x3ffb126d990 (LWP 1841031)):
#0 __libc_recv (fd=fd@entry=5, buf=buf@entry=0x3ffdac792e7, len=len@entry=1,
flags=flags@entry=0) at ../sysdeps/unix/sysv/linux/recv.c:30
#1 0x000002aa133aba22 in recv (__flags=0, __n=1, __buf=0x3ffdac792e7, __fd=5)
at /usr/include/s390x-linux-gnu/bits/socket2.h:44
#2 qmp_fd_receive (fd=<optimized out>) at ../tests/qtest/libqmp.c:73
#3 0x000002aa133a9b8e in qtest_qmp_receive_dict (s=0x2aa135fb800) at
../tests/qtest/libqtest.c:837
#4 qtest_qmp_eventwait_ref (event=<optimized out>, s=<optimized out>) at
../tests/qtest/libqtest.c:837
#5 qtest_qmp_eventwait_ref (s=0x2aa135fb800, event=<optimized out>) at
../tests/qtest/libqtest.c:828
#6 0x000002aa133a9c1a in qtest_qmp_eventwait (s=<optimized out>,
event=<optimized out>) at ../tests/qtest/libqtest.c:850
#7 0x000002aa1339ec56 in test_postcopy_common (args=0x3ffdac795e8) at
../tests/qtest/migration-test.c:1161
#8 0x000002aa1339edb4 in test_postcopy_preempt () at
../tests/qtest/migration-test.c:1178
#9 0x000003ffb0d7e608 in ?? () from /lib/s390x-linux-gnu/libglib-2.0.so.0
#10 0x000003ffb0d7e392 in ?? () from /lib/s390x-linux-gnu/libglib-2.0.so.0
#11 0x000003ffb0d7e392 in ?? () from /lib/s390x-linux-gnu/libglib-2.0.so.0
#12 0x000003ffb0d7e392 in ?? () from /lib/s390x-linux-gnu/libglib-2.0.so.0
#13 0x000003ffb0d7e392 in ?? () from /lib/s390x-linux-gnu/libglib-2.0.so.0
#14 0x000003ffb0d7eada in g_test_run_suite () from
/lib/s390x-linux-gnu/libglib-2.0.so.0
#15 0x000003ffb0d7eb10 in g_test_run () from
/lib/s390x-linux-gnu/libglib-2.0.so.0
#16 0x000002aa1339ab14 in main (argc=<optimized out>, argv=<optimized out>) at
../tests/qtest/migration-test.c:2615
[Inferior 1 (process 1841031) detached]
===========================================================
PROCESS: 1841381
gitlab-+ 1841381 1841031 0 Mar13 ? 00:00:06 ./qemu-system-x86_64 -qtest
unix:/tmp/qtest-1841031.sock -qtest-log /dev/null -chardev
socket,path=/tmp/qtest-1841031.qmp,id=char0 -mon chardev=char0,mode=control
-display none -accel kvm -accel tcg -name source,debug-threads=on -m 150M
-serial file:/tmp/migration-test-RM5901/src_serial -drive
file=/tmp/migration-test-RM5901/bootsect,format=raw -accel qtest
[New LWP 1841383]
[New LWP 1841384]
[New LWP 1841385]
[New LWP 1841394]
[New LWP 1841395]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/s390x-linux-gnu/libthread_db.so.1".
0x000003ffb51f1c8c in __ppoll (fds=0x2aa1c0ffbd0, nfds=5, timeout=<optimized
out>, timeout@entry=0x3fffbb79bc8, sigmask=sigmask@entry=0x0) at
../sysdeps/unix/sysv/linux/ppoll.c:44
Thread 6 (Thread 0x3ff469f7900 (LWP 1841395)):
#0 __libc_sendmsg (fd=<optimized out>, msg=msg@entry=0x3ff469f2810,
flags=flags@entry=0) at ../sysdeps/unix/sysv/linux/sendmsg.c:30
#1 0x000002aa1a34c52a in qio_channel_socket_writev (ioc=<optimized out>,
iov=<optimized out>, niov=<optimized out>, fds=<optimized out>, nfds=<optimized
out>, flags=0, errp=0x3ff469f2b80) at ../io/channel-socket.c:605
#2 0x000002aa1a351b88 in qio_channel_writev_full (ioc=ioc@entry=0x2aa1c0f8400,
iov=0x2aa1c0e88e0, niov=64, fds=fds@entry=0x0, nfds=nfds@entry=0, flags=0,
errp=0x3ff469f2b80) at ../io/channel.c:108
#3 0x000002aa1a352a00 in qio_channel_writev_full_all (ioc=0x2aa1c0f8400,
iov=iov@entry=0x2aa1b2792a0, niov=<optimized out>, fds=fds@entry=0x0,
nfds=nfds@entry=0, flags=0, errp=0x3ff469f2b80) at ../io/channel.c:263
#4 0x000002aa1a352aae in qio_channel_writev_all (ioc=<optimized out>,
iov=iov@entry=0x2aa1b2792a0, niov=<optimized out>,
errp=errp@entry=0x3ff469f2b80) at ../io/channel.c:242
#5 0x000002aa1a10de94 in qemu_fflush (f=f@entry=0x2aa1b271260) at
../migration/qemu-file.c:302
#6 0x000002aa1a10e122 in qemu_fflush (f=0x2aa1b271260) at
../migration/qemu-file.c:297
#7 add_to_iovec (f=f@entry=0x2aa1b271260, buf=<optimized out>,
size=size@entry=4096, may_free=<optimized out>) at ../migration/qemu-file.c:510
#8 0x000002aa1a10e606 in qemu_put_buffer_async (f=f@entry=0x2aa1b271260,
buf=<error reading variable: value has been optimized out>,
size=size@entry=4096, may_free=<optimized out>) at ../migration/qemu-file.c:535
#9 0x000002aa1a2bd398 in save_normal_page (async=<optimized out>,
buf=<optimized out>, offset=1175552, block=0x2aa1b19f340, pss=0x3ff40003000) at
../migration/ram.c:1400
#10 ram_save_page (pss=0x3ff40003000, rs=0x3ff40003000) at
../migration/ram.c:1449
#11 ram_save_target_page_legacy (rs=0x3ff40003000, pss=0x3ff40003000) at
../migration/ram.c:2381
#12 0x000002aa1a2ba330 in ram_save_host_page (pss=0x3ff40003000,
rs=0x3ff40003000) at ../migration/ram.c:2539
#13 ram_find_and_save_block (rs=rs@entry=0x3ff40003000) at
../migration/ram.c:2620
#14 0x000002aa1a2ba9e4 in ram_save_iterate (f=0x2aa1b271260, opaque=<optimized
out>) at ../migration/ram.c:3361
#15 0x000002aa1a12a524 in qemu_savevm_state_iterate (f=0x2aa1b271260,
postcopy=<optimized out>) at ../migration/savevm.c:1345
#16 0x000002aa1a11da14 in migration_iteration_run (s=0x2aa1af3a810) at
../migration/migration.c:3896
#17 migration_thread (opaque=opaque@entry=0x2aa1af3a810) at
../migration/migration.c:4124
#18 0x000002aa1a4c42ca in qemu_thread_start (args=<optimized out>) at
../util/qemu-thread-posix.c:541
#19 0x000003ffb5307e66 in start_thread (arg=0x3ff469f7900) at
pthread_create.c:477
#20 0x000003ffb51fcbe6 in thread_start () at
../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65
Thread 5 (Thread 0x3ff471f8900 (LWP 1841394)):
#0 __libc_recvmsg (fd=<optimized out>, msg=msg@entry=0x3ff471f39f0,
flags=flags@entry=0) at ../sysdeps/unix/sysv/linux/recvmsg.c:30
#1 0x000002aa1a34c7e4 in qio_channel_socket_readv (ioc=<optimized out>,
iov=<optimized out>, niov=<optimized out>, fds=0x0, nfds=0x0, flags=0,
errp=0x3ff471f3ca8) at ../io/channel-socket.c:532
#2 0x000002aa1a351a70 in qio_channel_readv_full (ioc=0x2aa1c0f8400,
iov=iov@entry=0x3ff471f3bf0, niov=niov@entry=1, fds=fds@entry=0x0,
nfds=nfds@entry=0x0, flags=0, errp=0x3ff471f3ca8) at ../io/channel.c:74
#3 0x000002aa1a351cf6 in qio_channel_read (ioc=<optimized out>,
buf=buf@entry=0x2aa1b17d9d8 "", buflen=buflen@entry=32768,
errp=errp@entry=0x3ff471f3ca8) at ../io/channel.c:314
#4 0x000002aa1a10dd2e in qemu_fill_buffer (f=0x2aa1b17d9a0) at
../migration/qemu-file.c:415
#5 0x000002aa1a10e908 in qemu_peek_byte (f=0x2aa1b17d9a0, offset=<optimized
out>) at ../migration/qemu-file.c:707
#6 0x000002aa1a10ebaa in qemu_get_byte (f=0x2aa1b17d9a0) at
../migration/qemu-file.c:720
#7 qemu_get_be16 (f=f@entry=0x2aa1b17d9a0) at ../migration/qemu-file.c:800
#8 0x000002aa1a11a3d8 in source_return_path_thread
(opaque=opaque@entry=0x2aa1af3a810) at ../migration/migration.c:2995
#9 0x000002aa1a4c42ca in qemu_thread_start (args=<optimized out>) at
../util/qemu-thread-posix.c:541
#10 0x000003ffb5307e66 in start_thread (arg=0x3ff471f8900) at
pthread_create.c:477
#11 0x000003ffb51fcbe6 in thread_start () at
../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65
Thread 4 (Thread 0x3ffa4eab900 (LWP 1841385)):
#0 futex_wait_cancelable (private=0, expected=0, futex_word=0x2aa1b29c30c) at
../sysdeps/nptl/futex-internal.h:183
#1 __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x2aa1ad9b798
<qemu_global_mutex>, cond=0x2aa1b29c2e0) at pthread_cond_wait.c:508
#2 __pthread_cond_wait (cond=cond@entry=0x2aa1b29c2e0,
mutex=mutex@entry=0x2aa1ad9b798 <qemu_global_mutex>) at pthread_cond_wait.c:647
#3 0x000002aa1a4c4cae in qemu_cond_wait_impl (cond=0x2aa1b29c2e0,
mutex=0x2aa1ad9b798 <qemu_global_mutex>, file=0x2aa1a60b014
"../softmmu/cpus.c", line=<optimized out>) at ../util/qemu-thread-posix.c:225
#4 0x000002aa1a0edafe in qemu_wait_io_event (cpu=cpu@entry=0x2aa1b26a160) at
../softmmu/cpus.c:424
#5 0x000002aa1a3315ca in mttcg_cpu_thread_fn (arg=arg@entry=0x2aa1b26a160) at
../accel/tcg/tcg-accel-ops-mttcg.c:123
#6 0x000002aa1a4c42ca in qemu_thread_start (args=<optimized out>) at
../util/qemu-thread-posix.c:541
#7 0x000003ffb5307e66 in start_thread (arg=0x3ffa4eab900) at
pthread_create.c:477
#8 0x000003ffb51fcbe6 in thread_start () at
../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65
Thread 3 (Thread 0x3ffa579d900 (LWP 1841384)):
#0 0x000003ffb51f1b32 in __GI___poll (fds=0x3ff58003280, nfds=3,
timeout=<optimized out>) at ../sysdeps/unix/sysv/linux/poll.c:29
#1 0x000003ffb79d4386 in () at /lib/s390x-linux-gnu/libglib-2.0.so.0
#2 0x000003ffb79d4790 in g_main_loop_run () at
/lib/s390x-linux-gnu/libglib-2.0.so.0
#3 0x000002aa1a37480e in iothread_run (opaque=opaque@entry=0x2aa1b0aec00) at
../iothread.c:70
#4 0x000002aa1a4c42ca in qemu_thread_start (args=<optimized out>) at
../util/qemu-thread-posix.c:541
#5 0x000003ffb5307e66 in start_thread (arg=0x3ffa579d900) at
pthread_create.c:477
#6 0x000003ffb51fcbe6 in thread_start () at
../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65
Thread 2 (Thread 0x3ffa6423900 (LWP 1841383)):
#0 syscall () at ../sysdeps/unix/sysv/linux/s390/s390-64/syscall.S:37
#1 0x000002aa1a4c5264 in qemu_futex_wait (val=<optimized out>, f=<optimized
out>) at
/home/gitlab-runner/builds/FLaZkdt1/0/qemu-project/qemu/include/qemu/futex.h:29
#2 qemu_event_wait (ev=ev@entry=0x2aa1adccab0 <rcu_call_ready_event>) at
../util/qemu-thread-posix.c:464
#3 0x000002aa1a4cde3a in call_rcu_thread (opaque=opaque@entry=0x0) at
../util/rcu.c:261
#4 0x000002aa1a4c42ca in qemu_thread_start (args=<optimized out>) at
../util/qemu-thread-posix.c:541
#5 0x000003ffb5307e66 in start_thread (arg=0x3ffa6423900) at
pthread_create.c:477
#6 0x000003ffb51fcbe6 in thread_start () at
../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65
Thread 1 (Thread 0x3ffb8b7e4a0 (LWP 1841381)):
#0 0x000003ffb51f1c8c in __ppoll (fds=0x2aa1c0ffbd0, nfds=5,
timeout=<optimized out>, timeout@entry=0x3fffbb79bc8,
sigmask=sigmask@entry=0x0) at ../sysdeps/unix/sysv/linux/ppoll.c:44
#1 0x000002aa1a4da07a in ppoll (__ss=0x0, __timeout=0x3fffbb79bc8,
__nfds=<optimized out>, __fds=<optimized out>) at
/usr/include/s390x-linux-gnu/bits/poll2.h:77
#2 qemu_poll_ns (fds=<optimized out>, nfds=<optimized out>,
timeout=timeout@entry=1000000000) at ../util/qemu-timer.c:351
#3 0x000002aa1a4d7090 in os_host_main_loop_wait (timeout=1000000000) at
../util/main-loop.c:312
#4 main_loop_wait (nonblocking=nonblocking@entry=0) at ../util/main-loop.c:603
#5 0x000002aa1a0f46d4 in qemu_main_loop () at ../softmmu/runstate.c:731
#6 0x000002aa19f0e312 in qemu_default_main () at ../softmmu/main.c:37
#7 0x000003ffb512440a in __libc_start_main (main=0x2aa19f0b8d8 <main>,
argc=<optimized out>, argv=0x3fffbb7a018, init=<optimized out>, fini=<optimized
out>, rtld_fini=0x3ffb8b90e50 <_dl_fini>, stack_end=0x3fffbb79f60) at
libc-start.c:308
#8 0x000002aa19f0e23c in _start () at ../softmmu/main.c:48
[Inferior 1 (process 1841381) detached]
===========================================================
PROCESS: 1841387
gitlab-+ 1841387 1841031 0 Mar13 ? 00:00:00 ./qemu-system-x86_64 -qtest
unix:/tmp/qtest-1841031.sock -qtest-log /dev/null -chardev
socket,path=/tmp/qtest-1841031.qmp,id=char0 -mon chardev=char0,mode=control
-display none -accel kvm -accel tcg -name target,debug-threads=on -m 150M
-serial file:/tmp/migration-test-RM5901/dest_serial -incoming
unix:/tmp/migration-test-RM5901/migsocket -drive
file=/tmp/migration-test-RM5901/bootsect,format=raw -accel qtest
[New LWP 1841389]
[New LWP 1841390]
[New LWP 1841391]
[New LWP 1841397]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/s390x-linux-gnu/libthread_db.so.1".
futex_wait_cancelable (private=0, expected=0, futex_word=0x2aa370039c0) at
../sysdeps/nptl/futex-internal.h:183
Thread 5 (Thread 0x3ff3a1fd900 (LWP 1841397)):
#0 0x000003ffa3571b32 in __GI___poll (fds=fds@entry=0x3ff2c000b60, nfds=2,
nfds@entry=<error reading variable: value has been optimized out>,
timeout=timeout@entry=-1) at ../sysdeps/unix/sysv/linux/poll.c:29
#1 0x000002aa348a4dfe in poll (__timeout=-1, __nfds=<optimized out>,
__fds=0x3ff2c000b60) at /usr/include/s390x-linux-gnu/bits/poll2.h:46
#2 postcopy_ram_fault_thread (opaque=opaque@entry=0x2aa37003800) at
../migration/postcopy-ram.c:952
#3 0x000002aa34c442ca in qemu_thread_start (args=<optimized out>) at
../util/qemu-thread-posix.c:541
#4 0x000003ffa3687e66 in start_thread (arg=0x3ff3a1fd900) at
pthread_create.c:477
#5 0x000003ffa357cbe6 in thread_start () at
../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65
Thread 4 (Thread 0x3ff9322b900 (LWP 1841391)):
#0 futex_wait_cancelable (private=0, expected=0, futex_word=0x2aa3711630c) at
../sysdeps/nptl/futex-internal.h:183
#1 __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x2aa3551b798
<qemu_global_mutex>, cond=0x2aa371162e0) at pthread_cond_wait.c:508
#2 __pthread_cond_wait (cond=cond@entry=0x2aa371162e0,
mutex=mutex@entry=0x2aa3551b798 <qemu_global_mutex>) at pthread_cond_wait.c:647
#3 0x000002aa34c44cae in qemu_cond_wait_impl (cond=0x2aa371162e0,
mutex=0x2aa3551b798 <qemu_global_mutex>, file=0x2aa34d8b014
"../softmmu/cpus.c", line=<optimized out>) at ../util/qemu-thread-posix.c:225
#4 0x000002aa3486dafe in qemu_wait_io_event (cpu=cpu@entry=0x2aa370e4160) at
../softmmu/cpus.c:424
#5 0x000002aa34ab15ca in mttcg_cpu_thread_fn (arg=arg@entry=0x2aa370e4160) at
../accel/tcg/tcg-accel-ops-mttcg.c:123
#6 0x000002aa34c442ca in qemu_thread_start (args=<optimized out>) at
../util/qemu-thread-posix.c:541
#7 0x000003ffa3687e66 in start_thread (arg=0x3ff9322b900) at
pthread_create.c:477
#8 0x000003ffa357cbe6 in thread_start () at
../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65
Thread 3 (Thread 0x3ff93b1d900 (LWP 1841390)):
#0 0x000003ffa3571b32 in __GI___poll (fds=0x3ff44003280, nfds=3,
timeout=<optimized out>) at ../sysdeps/unix/sysv/linux/poll.c:29
#1 0x000003ffa5d54386 in () at /lib/s390x-linux-gnu/libglib-2.0.so.0
#2 0x000003ffa5d54790 in g_main_loop_run () at
/lib/s390x-linux-gnu/libglib-2.0.so.0
#3 0x000002aa34af480e in iothread_run (opaque=opaque@entry=0x2aa36f28c00) at
../iothread.c:70
#4 0x000002aa34c442ca in qemu_thread_start (args=<optimized out>) at
../util/qemu-thread-posix.c:541
#5 0x000003ffa3687e66 in start_thread (arg=0x3ff93b1d900) at
pthread_create.c:477
#6 0x000003ffa357cbe6 in thread_start () at
../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65
Thread 2 (Thread 0x3ff947a3900 (LWP 1841389)):
#0 syscall () at ../sysdeps/unix/sysv/linux/s390/s390-64/syscall.S:37
#1 0x000002aa34c45264 in qemu_futex_wait (val=<optimized out>, f=<optimized
out>) at
/home/gitlab-runner/builds/FLaZkdt1/0/qemu-project/qemu/include/qemu/futex.h:29
#2 qemu_event_wait (ev=ev@entry=0x2aa3554cab0 <rcu_call_ready_event>) at
../util/qemu-thread-posix.c:464
#3 0x000002aa34c4de3a in call_rcu_thread (opaque=opaque@entry=0x0) at
../util/rcu.c:261
#4 0x000002aa34c442ca in qemu_thread_start (args=<optimized out>) at
../util/qemu-thread-posix.c:541
#5 0x000003ffa3687e66 in start_thread (arg=0x3ff947a3900) at
pthread_create.c:477
#6 0x000003ffa357cbe6 in thread_start () at
../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65
Thread 1 (Thread 0x3ffa6efe4a0 (LWP 1841387)):
#0 futex_wait_cancelable (private=0, expected=0, futex_word=0x2aa370039c0) at
../sysdeps/nptl/futex-internal.h:183
#1 __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x2aa37003968,
cond=0x2aa37003998) at pthread_cond_wait.c:508
#2 __pthread_cond_wait (cond=cond@entry=0x2aa37003998,
mutex=mutex@entry=0x2aa37003968) at pthread_cond_wait.c:647
#3 0x000002aa34c44cae in qemu_cond_wait_impl (cond=0x2aa37003998,
mutex=0x2aa37003968, file=0x2aa34e65f06 "../util/qemu-thread-posix.c",
line=<optimized out>) at ../util/qemu-thread-posix.c:225
#4 0x000002aa34c450ce in qemu_sem_wait (sem=0x2aa37003968) at
../util/qemu-thread-posix.c:314
#5 0x000002aa348a444a in postcopy_ram_incoming_setup (mis=0x2aa37003800,
mis@entry=<error reading variable: value has been optimized out>) at
../migration/postcopy-ram.c:1204
#6 0x000002aa348abb60 in loadvm_postcopy_handle_listen (mis=<optimized out>)
at ../migration/savevm.c:2016
#7 loadvm_process_command (f=0x2aa37201810) at ../migration/savevm.c:2379
#8 qemu_loadvm_state_main (f=f@entry=0x2aa37201810, mis=0x2aa37003800) at
../migration/savevm.c:2724
#9 0x000002aa348abeee in loadvm_handle_cmd_packaged (mis=<optimized out>) at
../migration/savevm.c:2248
#10 loadvm_process_command (f=0x2aa370eb260) at ../migration/savevm.c:2373
#11 qemu_loadvm_state_main (f=f@entry=0x2aa370eb260,
mis=mis@entry=0x2aa37003800) at ../migration/savevm.c:2724
#12 0x000002aa348acb04 in qemu_loadvm_state (f=0x2aa370eb260) at
../migration/savevm.c:2790
#13 0x000002aa34899b54 in process_incoming_migration_co (opaque=<optimized
out>) at ../migration/migration.c:606
#14 0x000002aa34c58f16 in coroutine_trampoline (i0=<optimized out>,
i1=<optimized out>) at ../util/coroutine-ucontext.c:177
#15 0x000003ffa34d69c2 in __makecontext_ret () at
../sysdeps/unix/sysv/linux/s390/s390-64/__makecontext_ret.S:23
[Inferior 1 (process 1841387) detached]
Process tree:
migration-test(1840499)-+-qemu-system-i38(1841012)
`-qemu-system-i38(1841019)
===========================================================
PROCESS: 1840499
gitlab-+ 1840499 1838397 0 Mar13 ? 00:00:02
/home/gitlab-runner/builds/FLaZkdt1/0/qemu-project/qemu/build/tests/qtest/migration-test
--tap -k
[New LWP 1840501]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/s390x-linux-gnu/libthread_db.so.1".
__libc_recv (fd=fd@entry=5, buf=buf@entry=0x3fff23798b7, len=len@entry=1,
flags=flags@entry=0) at ../sysdeps/unix/sysv/linux/recv.c:30
30 ../sysdeps/unix/sysv/linux/recv.c: No such file or directory.
Thread 2 (Thread 0x3ffbe3ff900 (LWP 1840501)):
#0 syscall () at ../sysdeps/unix/sysv/linux/s390/s390-64/syscall.S:37
#1 0x000002aa029dae34 in qemu_futex_wait (val=<optimized out>, f=<optimized
out>) at
/home/gitlab-runner/builds/FLaZkdt1/0/qemu-project/qemu/include/qemu/futex.h:29
#2 qemu_event_wait (ev=ev@entry=0x2aa02b596b8 <rcu_call_ready_event>) at
../util/qemu-thread-posix.c:464
#3 0x000002aa02a079ea in call_rcu_thread (opaque=opaque@entry=0x0) at
../util/rcu.c:261
#4 0x000002aa029d9e9a in qemu_thread_start (args=<optimized out>) at
../util/qemu-thread-posix.c:541
#5 0x000003ffbed87e66 in start_thread (arg=0x3ffbe3ff900) at
pthread_create.c:477
#6 0x000003ffbec7cbe6 in thread_start () at
../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65
Thread 1 (Thread 0x3ffbf46d990 (LWP 1840499)):
#0 __libc_recv (fd=fd@entry=5, buf=buf@entry=0x3fff23798b7, len=len@entry=1,
flags=flags@entry=0) at ../sysdeps/unix/sysv/linux/recv.c:30
#1 0x000002aa029aba22 in recv (__flags=0, __n=1, __buf=0x3fff23798b7, __fd=5)
at /usr/include/s390x-linux-gnu/bits/socket2.h:44
#2 qmp_fd_receive (fd=<optimized out>) at ../tests/qtest/libqmp.c:73
#3 0x000002aa029a9b8e in qtest_qmp_receive_dict (s=0x2aa0327d120) at
../tests/qtest/libqtest.c:837
#4 qtest_qmp_eventwait_ref (event=<optimized out>, s=<optimized out>) at
../tests/qtest/libqtest.c:837
#5 qtest_qmp_eventwait_ref (s=0x2aa0327d120, event=<optimized out>) at
../tests/qtest/libqtest.c:828
#6 0x000002aa029a9c1a in qtest_qmp_eventwait (s=<optimized out>,
event=<optimized out>) at ../tests/qtest/libqtest.c:850
#7 0x000002aa0299ec56 in test_postcopy_common (args=0x3fff2379bb8) at
../tests/qtest/migration-test.c:1161
#8 0x000002aa0299edb4 in test_postcopy_preempt () at
../tests/qtest/migration-test.c:1178
#9 0x000003ffbef7e608 in ?? () from /lib/s390x-linux-gnu/libglib-2.0.so.0
#10 0x000003ffbef7e392 in ?? () from /lib/s390x-linux-gnu/libglib-2.0.so.0
#11 0x000003ffbef7e392 in ?? () from /lib/s390x-linux-gnu/libglib-2.0.so.0
#12 0x000003ffbef7e392 in ?? () from /lib/s390x-linux-gnu/libglib-2.0.so.0
#13 0x000003ffbef7e392 in ?? () from /lib/s390x-linux-gnu/libglib-2.0.so.0
#14 0x000003ffbef7eada in g_test_run_suite () from
/lib/s390x-linux-gnu/libglib-2.0.so.0
#15 0x000003ffbef7eb10 in g_test_run () from
/lib/s390x-linux-gnu/libglib-2.0.so.0
#16 0x000002aa0299ab14 in main (argc=<optimized out>, argv=<optimized out>) at
../tests/qtest/migration-test.c:2615
[Inferior 1 (process 1840499) detached]
===========================================================
PROCESS: 1841012
gitlab-+ 1841012 1840499 0 Mar13 ? 00:00:06 ./qemu-system-i386 -qtest
unix:/tmp/qtest-1840499.sock -qtest-log /dev/null -chardev
socket,path=/tmp/qtest-1840499.qmp,id=char0 -mon chardev=char0,mode=control
-display none -accel kvm -accel tcg -name source,debug-threads=on -m 150M
-serial file:/tmp/migration-test-8IQB11/src_serial -drive
file=/tmp/migration-test-8IQB11/bootsect,format=raw -accel qtest
[New LWP 1841014]
[New LWP 1841015]
[New LWP 1841016]
[New LWP 1841062]
[New LWP 1841063]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/s390x-linux-gnu/libthread_db.so.1".
0x000003ff9a771c8c in __ppoll (fds=0x2aa396d66e0, nfds=5, timeout=<optimized
out>, timeout@entry=0x3ffd40fa048, sigmask=sigmask@entry=0x0) at
../sysdeps/unix/sysv/linux/ppoll.c:44
44 ../sysdeps/unix/sysv/linux/ppoll.c: No such file or directory.
Thread 6 (Thread 0x3ff2bfff900 (LWP 1841063)):
#0 __libc_sendmsg (fd=<optimized out>, msg=msg@entry=0x3ff2bffa810,
flags=flags@entry=0) at ../sysdeps/unix/sysv/linux/sendmsg.c:30
#1 0x000002aa38343b7a in qio_channel_socket_writev (ioc=<optimized out>,
iov=<optimized out>, niov=<optimized out>, fds=<optimized out>, nfds=<optimized
out>, flags=0, errp=0x3ff2bffab80) at ../io/channel-socket.c:605
#2 0x000002aa383491d8 in qio_channel_writev_full (ioc=ioc@entry=0x2aa3a52fa80,
iov=0x2aa3a53b300, niov=64, fds=fds@entry=0x0, nfds=nfds@entry=0, flags=0,
errp=0x3ff2bffab80) at ../io/channel.c:108
#3 0x000002aa3834a050 in qio_channel_writev_full_all (ioc=0x2aa3a52fa80,
iov=iov@entry=0x2aa396b26b0, niov=<optimized out>, fds=fds@entry=0x0,
nfds=nfds@entry=0, flags=0, errp=0x3ff2bffab80) at ../io/channel.c:263
#4 0x000002aa3834a0fe in qio_channel_writev_all (ioc=<optimized out>,
iov=iov@entry=0x2aa396b26b0, niov=<optimized out>,
errp=errp@entry=0x3ff2bffab80) at ../io/channel.c:242
#5 0x000002aa3810d404 in qemu_fflush (f=f@entry=0x2aa396aa670) at
../migration/qemu-file.c:302
#6 0x000002aa3810d692 in qemu_fflush (f=0x2aa396aa670) at
../migration/qemu-file.c:297
#7 add_to_iovec (f=f@entry=0x2aa396aa670, buf=<optimized out>,
size=size@entry=4096, may_free=<optimized out>) at ../migration/qemu-file.c:510
#8 0x000002aa3810db76 in qemu_put_buffer_async (f=f@entry=0x2aa396aa670,
buf=<error reading variable: value has been optimized out>,
size=size@entry=4096, may_free=<optimized out>) at ../migration/qemu-file.c:535
#9 0x000002aa382b4d00 in save_normal_page (async=<optimized out>,
buf=<optimized out>, offset=1175552, block=0x2aa395dabb0, pss=0x3ff24002800) at
../migration/ram.c:1400
#10 ram_save_page (pss=0x3ff24002800, rs=0x3ff24002800) at
../migration/ram.c:1449
#11 ram_save_target_page_legacy (rs=0x3ff24002800, pss=0x3ff24002800) at
../migration/ram.c:2381
#12 0x000002aa382b1c98 in ram_save_host_page (pss=0x3ff24002800,
rs=0x3ff24002800) at ../migration/ram.c:2539
#13 ram_find_and_save_block (rs=rs@entry=0x3ff24002800) at
../migration/ram.c:2620
#14 0x000002aa382b234c in ram_save_iterate (f=0x2aa396aa670, opaque=<optimized
out>) at ../migration/ram.c:3361
#15 0x000002aa38129a94 in qemu_savevm_state_iterate (f=0x2aa396aa670,
postcopy=<optimized out>) at ../migration/savevm.c:1345
#16 0x000002aa3811cf84 in migration_iteration_run (s=0x2aa39375710) at
../migration/migration.c:3896
#17 migration_thread (opaque=opaque@entry=0x2aa39375710) at
../migration/migration.c:4124
#18 0x000002aa384bb91a in qemu_thread_start (args=<optimized out>) at
../util/qemu-thread-posix.c:541
#19 0x000003ff9a887e66 in start_thread (arg=0x3ff2bfff900) at
pthread_create.c:477
#20 0x000003ff9a77cbe6 in thread_start () at
../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65
Thread 5 (Thread 0x3ff30ff9900 (LWP 1841062)):
#0 __libc_recvmsg (fd=<optimized out>, msg=msg@entry=0x3ff30ff49f0,
flags=flags@entry=0) at ../sysdeps/unix/sysv/linux/recvmsg.c:30
#1 0x000002aa38343e34 in qio_channel_socket_readv (ioc=<optimized out>,
iov=<optimized out>, niov=<optimized out>, fds=0x0, nfds=0x0, flags=0,
errp=0x3ff30ff4ca8) at ../io/channel-socket.c:532
#2 0x000002aa383490c0 in qio_channel_readv_full (ioc=0x2aa3a52fa80,
iov=iov@entry=0x3ff30ff4bf0, niov=niov@entry=1, fds=fds@entry=0x0,
nfds=nfds@entry=0x0, flags=0, errp=0x3ff30ff4ca8) at ../io/channel.c:74
#3 0x000002aa38349346 in qio_channel_read (ioc=<optimized out>,
buf=buf@entry=0x2aa395b9548 "", buflen=buflen@entry=32768,
errp=errp@entry=0x3ff30ff4ca8) at ../io/channel.c:314
#4 0x000002aa3810d29e in qemu_fill_buffer (f=0x2aa395b9510) at
../migration/qemu-file.c:415
#5 0x000002aa3810de78 in qemu_peek_byte (f=0x2aa395b9510, offset=<optimized
out>) at ../migration/qemu-file.c:707
#6 0x000002aa3810e11a in qemu_get_byte (f=0x2aa395b9510) at
../migration/qemu-file.c:720
#7 qemu_get_be16 (f=f@entry=0x2aa395b9510) at ../migration/qemu-file.c:800
#8 0x000002aa38119948 in source_return_path_thread
(opaque=opaque@entry=0x2aa39375710) at ../migration/migration.c:2995
#9 0x000002aa384bb91a in qemu_thread_start (args=<optimized out>) at
../util/qemu-thread-posix.c:541
#10 0x000003ff9a887e66 in start_thread (arg=0x3ff30ff9900) at
pthread_create.c:477
#11 0x000003ff9a77cbe6 in thread_start () at
../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65
Thread 4 (Thread 0x3ff8a42b900 (LWP 1841016)):
#0 futex_wait_cancelable (private=0, expected=0, futex_word=0x2aa396d5718) at
../sysdeps/nptl/futex-internal.h:183
#1 __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x2aa38d8fcf0
<qemu_global_mutex>, cond=0x2aa396d56f0) at pthread_cond_wait.c:508
#2 __pthread_cond_wait (cond=cond@entry=0x2aa396d56f0,
mutex=mutex@entry=0x2aa38d8fcf0 <qemu_global_mutex>) at pthread_cond_wait.c:647
#3 0x000002aa384bc2fe in qemu_cond_wait_impl (cond=0x2aa396d56f0,
mutex=0x2aa38d8fcf0 <qemu_global_mutex>, file=0x2aa38602664
"../softmmu/cpus.c", line=<optimized out>) at ../util/qemu-thread-posix.c:225
#4 0x000002aa380ed06e in qemu_wait_io_event (cpu=cpu@entry=0x2aa396a5980) at
../softmmu/cpus.c:424
#5 0x000002aa38328c1a in mttcg_cpu_thread_fn (arg=arg@entry=0x2aa396a5980) at
../accel/tcg/tcg-accel-ops-mttcg.c:123
#6 0x000002aa384bb91a in qemu_thread_start (args=<optimized out>) at
../util/qemu-thread-posix.c:541
#7 0x000003ff9a887e66 in start_thread (arg=0x3ff8a42b900) at
pthread_create.c:477
#8 0x000003ff9a77cbe6 in thread_start () at
../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65
Thread 3 (Thread 0x3ff8ad1d900 (LWP 1841015)):
#0 0x000003ff9a771b32 in __GI___poll (fds=0x3ff3c003280, nfds=3,
timeout=<optimized out>) at ../sysdeps/unix/sysv/linux/poll.c:29
#1 0x000003ff9cf54386 in () at /lib/s390x-linux-gnu/libglib-2.0.so.0
#2 0x000003ff9cf54790 in g_main_loop_run () at
/lib/s390x-linux-gnu/libglib-2.0.so.0
#3 0x000002aa3836be5e in iothread_run (opaque=opaque@entry=0x2aa39477800) at
../iothread.c:70
#4 0x000002aa384bb91a in qemu_thread_start (args=<optimized out>) at
../util/qemu-thread-posix.c:541
#5 0x000003ff9a887e66 in start_thread (arg=0x3ff8ad1d900) at
pthread_create.c:477
#6 0x000003ff9a77cbe6 in thread_start () at
../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65
Thread 2 (Thread 0x3ff8b9a3900 (LWP 1841014)):
#0 syscall () at ../sysdeps/unix/sysv/linux/s390/s390-64/syscall.S:37
#1 0x000002aa384bc8b4 in qemu_futex_wait (val=<optimized out>, f=<optimized
out>) at
/home/gitlab-runner/builds/FLaZkdt1/0/qemu-project/qemu/include/qemu/futex.h:29
#2 qemu_event_wait (ev=ev@entry=0x2aa38dbffc8 <rcu_call_ready_event>) at
../util/qemu-thread-posix.c:464
#3 0x000002aa384c548a in call_rcu_thread (opaque=opaque@entry=0x0) at
../util/rcu.c:261
#4 0x000002aa384bb91a in qemu_thread_start (args=<optimized out>) at
../util/qemu-thread-posix.c:541
#5 0x000003ff9a887e66 in start_thread (arg=0x3ff8b9a3900) at
pthread_create.c:477
#6 0x000003ff9a77cbe6 in thread_start () at
../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65
Thread 1 (Thread 0x3ff9e0fe4a0 (LWP 1841012)):
#0 0x000003ff9a771c8c in __ppoll (fds=0x2aa396d66e0, nfds=5,
timeout=<optimized out>, timeout@entry=0x3ffd40fa048,
sigmask=sigmask@entry=0x0) at ../sysdeps/unix/sysv/linux/ppoll.c:44
#1 0x000002aa384d16ca in ppoll (__ss=0x0, __timeout=0x3ffd40fa048,
__nfds=<optimized out>, __fds=<optimized out>) at
/usr/include/s390x-linux-gnu/bits/poll2.h:77
#2 qemu_poll_ns (fds=<optimized out>, nfds=<optimized out>,
timeout=timeout@entry=1000000000) at ../util/qemu-timer.c:351
#3 0x000002aa384ce6e0 in os_host_main_loop_wait (timeout=1000000000) at
../util/main-loop.c:312
#4 main_loop_wait (nonblocking=nonblocking@entry=0) at ../util/main-loop.c:603
#5 0x000002aa380f3c44 in qemu_main_loop () at ../softmmu/runstate.c:731
#6 0x000002aa37f0d882 in qemu_default_main () at ../softmmu/main.c:37
#7 0x000003ff9a6a440a in __libc_start_main (main=0x2aa37f0ae48 <main>,
argc=<optimized out>, argv=0x3ffd40fa498, init=<optimized out>, fini=<optimized
out>, rtld_fini=0x3ff9e110e50 <_dl_fini>, stack_end=0x3ffd40fa3e0) at
libc-start.c:308
#8 0x000002aa37f0d7ac in _start () at ../softmmu/main.c:48
[Inferior 1 (process 1841012) detached]
===========================================================
PROCESS: 1841019
gitlab-+ 1841019 1840499 0 Mar13 ? 00:00:00 ./qemu-system-i386 -qtest
unix:/tmp/qtest-1840499.sock -qtest-log /dev/null -chardev
socket,path=/tmp/qtest-1840499.qmp,id=char0 -mon chardev=char0,mode=control
-display none -accel kvm -accel tcg -name target,debug-threads=on -m 150M
-serial file:/tmp/migration-test-8IQB11/dest_serial -incoming
unix:/tmp/migration-test-8IQB11/migsocket -drive
file=/tmp/migration-test-8IQB11/bootsect,format=raw -accel qtest
[New LWP 1841021]
[New LWP 1841022]
[New LWP 1841023]
[New LWP 1841067]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/s390x-linux-gnu/libthread_db.so.1".
futex_wait_cancelable (private=0, expected=0, futex_word=0x2aa3a92e1c0) at
../sysdeps/nptl/futex-internal.h:183
183 ../sysdeps/nptl/futex-internal.h: No such file or directory.
Thread 5 (Thread 0x3ff4a8ff900 (LWP 1841067)):
#0 0x000003ffb0071b32 in __GI___poll (fds=fds@entry=0x3ff40000b60, nfds=2,
nfds@entry=<error reading variable: value has been optimized out>,
timeout=timeout@entry=-1) at ../sysdeps/unix/sysv/linux/poll.c:29
#1 0x000002aa382a436e in poll (__timeout=-1, __nfds=<optimized out>,
__fds=0x3ff40000b60) at /usr/include/s390x-linux-gnu/bits/poll2.h:46
#2 postcopy_ram_fault_thread (opaque=opaque@entry=0x2aa3a92e000) at
../migration/postcopy-ram.c:952
#3 0x000002aa3863b91a in qemu_thread_start (args=<optimized out>) at
../util/qemu-thread-posix.c:541
#4 0x000003ffb0187e66 in start_thread (arg=0x3ff4a8ff900) at
pthread_create.c:477
#5 0x000003ffb007cbe6 in thread_start () at
../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65
Thread 4 (Thread 0x3ff5b7fe900 (LWP 1841023)):
#0 futex_wait_cancelable (private=0, expected=0, futex_word=0x2aa3aa3e69c) at
../sysdeps/nptl/futex-internal.h:183
#1 __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x2aa38f0fcf0
<qemu_global_mutex>, cond=0x2aa3aa3e670) at pthread_cond_wait.c:508
#2 __pthread_cond_wait (cond=cond@entry=0x2aa3aa3e670,
mutex=mutex@entry=0x2aa38f0fcf0 <qemu_global_mutex>) at pthread_cond_wait.c:647
#3 0x000002aa3863c2fe in qemu_cond_wait_impl (cond=0x2aa3aa3e670,
mutex=0x2aa38f0fcf0 <qemu_global_mutex>, file=0x2aa38782664
"../softmmu/cpus.c", line=<optimized out>) at ../util/qemu-thread-posix.c:225
#4 0x000002aa3826d06e in qemu_wait_io_event (cpu=cpu@entry=0x2aa3aa0e980) at
../softmmu/cpus.c:424
#5 0x000002aa384a8c1a in mttcg_cpu_thread_fn (arg=arg@entry=0x2aa3aa0e980) at
../accel/tcg/tcg-accel-ops-mttcg.c:123
#6 0x000002aa3863b91a in qemu_thread_start (args=<optimized out>) at
../util/qemu-thread-posix.c:541
#7 0x000003ffb0187e66 in start_thread (arg=0x3ff5b7fe900) at
pthread_create.c:477
#8 0x000003ffb007cbe6 in thread_start () at
../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65
Thread 3 (Thread 0x3ff5bfff900 (LWP 1841022)):
#0 0x000003ffb0071b32 in __GI___poll (fds=0x3ff54003280, nfds=3,
timeout=<optimized out>) at ../sysdeps/unix/sysv/linux/poll.c:29
#1 0x000003ffb2854386 in () at /lib/s390x-linux-gnu/libglib-2.0.so.0
#2 0x000003ffb2854790 in g_main_loop_run () at
/lib/s390x-linux-gnu/libglib-2.0.so.0
#3 0x000002aa384ebe5e in iothread_run (opaque=opaque@entry=0x2aa3a7e0800) at
../iothread.c:70
#4 0x000002aa3863b91a in qemu_thread_start (args=<optimized out>) at
../util/qemu-thread-posix.c:541
#5 0x000003ffb0187e66 in start_thread (arg=0x3ff5bfff900) at
pthread_create.c:477
#6 0x000003ffb007cbe6 in thread_start () at
../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65
Thread 2 (Thread 0x3ffa12a3900 (LWP 1841021)):
#0 syscall () at ../sysdeps/unix/sysv/linux/s390/s390-64/syscall.S:37
#1 0x000002aa3863c8b4 in qemu_futex_wait (val=<optimized out>, f=<optimized
out>) at
/home/gitlab-runner/builds/FLaZkdt1/0/qemu-project/qemu/include/qemu/futex.h:29
#2 qemu_event_wait (ev=ev@entry=0x2aa38f3ffc8 <rcu_call_ready_event>) at
../util/qemu-thread-posix.c:464
#3 0x000002aa3864548a in call_rcu_thread (opaque=opaque@entry=0x0) at
../util/rcu.c:261
#4 0x000002aa3863b91a in qemu_thread_start (args=<optimized out>) at
../util/qemu-thread-posix.c:541
#5 0x000003ffb0187e66 in start_thread (arg=0x3ffa12a3900) at
pthread_create.c:477
#6 0x000003ffb007cbe6 in thread_start () at
../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65
Thread 1 (Thread 0x3ffb39fe4a0 (LWP 1841019)):
#0 futex_wait_cancelable (private=0, expected=0, futex_word=0x2aa3a92e1c0) at
../sysdeps/nptl/futex-internal.h:183
#1 __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x2aa3a92e168,
cond=0x2aa3a92e198) at pthread_cond_wait.c:508
#2 __pthread_cond_wait (cond=cond@entry=0x2aa3a92e198,
mutex=mutex@entry=0x2aa3a92e168) at pthread_cond_wait.c:647
#3 0x000002aa3863c2fe in qemu_cond_wait_impl (cond=0x2aa3a92e198,
mutex=0x2aa3a92e168, file=0x2aa3885b73e "../util/qemu-thread-posix.c",
line=<optimized out>) at ../util/qemu-thread-posix.c:225
#4 0x000002aa3863c71e in qemu_sem_wait (sem=0x2aa3a92e168) at
../util/qemu-thread-posix.c:314
#5 0x000002aa382a39ba in postcopy_ram_incoming_setup (mis=0x2aa3a92e000,
mis@entry=<error reading variable: value has been optimized out>) at
../migration/postcopy-ram.c:1204
#6 0x000002aa382ab0d0 in loadvm_postcopy_handle_listen (mis=<optimized out>)
at ../migration/savevm.c:2016
#7 loadvm_process_command (f=0x2aa3aa5c7d0) at ../migration/savevm.c:2379
#8 qemu_loadvm_state_main (f=f@entry=0x2aa3aa5c7d0, mis=0x2aa3a92e000) at
../migration/savevm.c:2724
#9 0x000002aa382ab45e in loadvm_handle_cmd_packaged (mis=<optimized out>) at
../migration/savevm.c:2248
#10 loadvm_process_command (f=0x2aa3aa135f0) at ../migration/savevm.c:2373
#11 qemu_loadvm_state_main (f=f@entry=0x2aa3aa135f0,
mis=mis@entry=0x2aa3a92e000) at ../migration/savevm.c:2724
#12 0x000002aa382ac074 in qemu_loadvm_state (f=0x2aa3aa135f0) at
../migration/savevm.c:2790
#13 0x000002aa382990c4 in process_incoming_migration_co (opaque=<optimized
out>) at ../migration/migration.c:606
#14 0x000002aa38650566 in coroutine_trampoline (i0=<optimized out>,
i1=<optimized out>) at ../util/coroutine-ucontext.c:177
#15 0x000003ffaffd69c2 in __makecontext_ret () at
../sysdeps/unix/sysv/linux/s390/s390-64/__makecontext_ret.S:23
[Inferior 1 (process 1841019) detached]
