* Peter Maydell (peter.mayd...@linaro.org) wrote: > On Tue, 14 Mar 2023 at 10:12, Dr. David Alan Gilbert > <dgilb...@redhat.com> wrote: > > > > Copying Peter Xu on this one since it's poscopy, especially the newer > > postcopy preempt. > > > > * Peter Maydell (peter.mayd...@linaro.org) wrote: > > > On Sun, 12 Mar 2023 at 14:06, Peter Maydell <peter.mayd...@linaro.org> > > > wrote: > > > > Here's another one, on the s390x CI runner: > > > > https://gitlab.com/qemu-project/qemu/-/jobs/3917587994 > > > > > > And here's a backtrace from a hung migration-test on the s390x > > > runner (looks like a deadlock, none of these processes were > > > using CPU): > > > > Ah a backtrace! > > I've attached another 2 -- migration-test seems to fairly > commonly hang on the s390 CI runner; there are several > stuck tests on it at the moment.
These are the same as the last one I replied to; it's probably best if we disable /migration/postcopy/preempt/* until peterx has attacked it. Dave > -- PMM > Process tree: > migration-test(1841031)-+-qemu-system-x86(1841381) > `-qemu-system-x86(1841387) > =========================================================== > PROCESS: 1841031 > gitlab-+ 1841031 1838397 0 Mar13 ? 00:00:02 > /home/gitlab-runner/builds/FLaZkdt1/0/qemu-project/qemu/build/tests/qtest/migration-test > --tap -k > [New LWP 1841033] > [Thread debugging using libthread_db enabled] > Using host libthread_db library "/lib/s390x-linux-gnu/libthread_db.so.1". > __libc_recv (fd=fd@entry=5, buf=buf@entry=0x3ffdac792e7, len=len@entry=1, > flags=flags@entry=0) at ../sysdeps/unix/sysv/linux/recv.c:30 > > Thread 2 (Thread 0x3ffb01ff900 (LWP 1841033)): > #0 syscall () at ../sysdeps/unix/sysv/linux/s390/s390-64/syscall.S:37 > #1 0x000002aa133dae34 in qemu_futex_wait (val=<optimized out>, f=<optimized > out>) at > /home/gitlab-runner/builds/FLaZkdt1/0/qemu-project/qemu/include/qemu/futex.h:29 > #2 qemu_event_wait (ev=ev@entry=0x2aa135596b8 <rcu_call_ready_event>) at > ../util/qemu-thread-posix.c:464 > #3 0x000002aa134079ea in call_rcu_thread (opaque=opaque@entry=0x0) at > ../util/rcu.c:261 > #4 0x000002aa133d9e9a in qemu_thread_start (args=<optimized out>) at > ../util/qemu-thread-posix.c:541 > #5 0x000003ffb0b87e66 in start_thread (arg=0x3ffb01ff900) at > pthread_create.c:477 > #6 0x000003ffb0a7cbe6 in thread_start () at > ../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65 > > Thread 1 (Thread 0x3ffb126d990 (LWP 1841031)): > #0 __libc_recv (fd=fd@entry=5, buf=buf@entry=0x3ffdac792e7, len=len@entry=1, > flags=flags@entry=0) at ../sysdeps/unix/sysv/linux/recv.c:30 > #1 0x000002aa133aba22 in recv (__flags=0, __n=1, __buf=0x3ffdac792e7, > __fd=5) at /usr/include/s390x-linux-gnu/bits/socket2.h:44 > #2 qmp_fd_receive (fd=<optimized out>) at ../tests/qtest/libqmp.c:73 > #3 0x000002aa133a9b8e in qtest_qmp_receive_dict (s=0x2aa135fb800) at > ../tests/qtest/libqtest.c:837 > #4 qtest_qmp_eventwait_ref (event=<optimized out>, s=<optimized out>) at > ../tests/qtest/libqtest.c:837 > #5 qtest_qmp_eventwait_ref (s=0x2aa135fb800, event=<optimized out>) at > ../tests/qtest/libqtest.c:828 > #6 0x000002aa133a9c1a in qtest_qmp_eventwait (s=<optimized out>, > event=<optimized out>) at ../tests/qtest/libqtest.c:850 > #7 0x000002aa1339ec56 in test_postcopy_common (args=0x3ffdac795e8) at > ../tests/qtest/migration-test.c:1161 > #8 0x000002aa1339edb4 in test_postcopy_preempt () at > ../tests/qtest/migration-test.c:1178 > #9 0x000003ffb0d7e608 in ?? () from /lib/s390x-linux-gnu/libglib-2.0.so.0 > #10 0x000003ffb0d7e392 in ?? () from /lib/s390x-linux-gnu/libglib-2.0.so.0 > #11 0x000003ffb0d7e392 in ?? () from /lib/s390x-linux-gnu/libglib-2.0.so.0 > #12 0x000003ffb0d7e392 in ?? () from /lib/s390x-linux-gnu/libglib-2.0.so.0 > #13 0x000003ffb0d7e392 in ?? () from /lib/s390x-linux-gnu/libglib-2.0.so.0 > #14 0x000003ffb0d7eada in g_test_run_suite () from > /lib/s390x-linux-gnu/libglib-2.0.so.0 > #15 0x000003ffb0d7eb10 in g_test_run () from > /lib/s390x-linux-gnu/libglib-2.0.so.0 > #16 0x000002aa1339ab14 in main (argc=<optimized out>, argv=<optimized out>) > at ../tests/qtest/migration-test.c:2615 > [Inferior 1 (process 1841031) detached] > > =========================================================== > PROCESS: 1841381 > gitlab-+ 1841381 1841031 0 Mar13 ? 00:00:06 ./qemu-system-x86_64 > -qtest unix:/tmp/qtest-1841031.sock -qtest-log /dev/null -chardev > socket,path=/tmp/qtest-1841031.qmp,id=char0 -mon chardev=char0,mode=control > -display none -accel kvm -accel tcg -name source,debug-threads=on -m 150M > -serial file:/tmp/migration-test-RM5901/src_serial -drive > file=/tmp/migration-test-RM5901/bootsect,format=raw -accel qtest > [New LWP 1841383] > [New LWP 1841384] > [New LWP 1841385] > [New LWP 1841394] > [New LWP 1841395] > [Thread debugging using libthread_db enabled] > Using host libthread_db library "/lib/s390x-linux-gnu/libthread_db.so.1". > 0x000003ffb51f1c8c in __ppoll (fds=0x2aa1c0ffbd0, nfds=5, timeout=<optimized > out>, timeout@entry=0x3fffbb79bc8, sigmask=sigmask@entry=0x0) at > ../sysdeps/unix/sysv/linux/ppoll.c:44 > > Thread 6 (Thread 0x3ff469f7900 (LWP 1841395)): > #0 __libc_sendmsg (fd=<optimized out>, msg=msg@entry=0x3ff469f2810, > flags=flags@entry=0) at ../sysdeps/unix/sysv/linux/sendmsg.c:30 > #1 0x000002aa1a34c52a in qio_channel_socket_writev (ioc=<optimized out>, > iov=<optimized out>, niov=<optimized out>, fds=<optimized out>, > nfds=<optimized out>, flags=0, errp=0x3ff469f2b80) at > ../io/channel-socket.c:605 > #2 0x000002aa1a351b88 in qio_channel_writev_full > (ioc=ioc@entry=0x2aa1c0f8400, iov=0x2aa1c0e88e0, niov=64, fds=fds@entry=0x0, > nfds=nfds@entry=0, flags=0, errp=0x3ff469f2b80) at ../io/channel.c:108 > #3 0x000002aa1a352a00 in qio_channel_writev_full_all (ioc=0x2aa1c0f8400, > iov=iov@entry=0x2aa1b2792a0, niov=<optimized out>, fds=fds@entry=0x0, > nfds=nfds@entry=0, flags=0, errp=0x3ff469f2b80) at ../io/channel.c:263 > #4 0x000002aa1a352aae in qio_channel_writev_all (ioc=<optimized out>, > iov=iov@entry=0x2aa1b2792a0, niov=<optimized out>, > errp=errp@entry=0x3ff469f2b80) at ../io/channel.c:242 > #5 0x000002aa1a10de94 in qemu_fflush (f=f@entry=0x2aa1b271260) at > ../migration/qemu-file.c:302 > #6 0x000002aa1a10e122 in qemu_fflush (f=0x2aa1b271260) at > ../migration/qemu-file.c:297 > #7 add_to_iovec (f=f@entry=0x2aa1b271260, buf=<optimized out>, > size=size@entry=4096, may_free=<optimized out>) at > ../migration/qemu-file.c:510 > #8 0x000002aa1a10e606 in qemu_put_buffer_async (f=f@entry=0x2aa1b271260, > buf=<error reading variable: value has been optimized out>, > size=size@entry=4096, may_free=<optimized out>) at > ../migration/qemu-file.c:535 > #9 0x000002aa1a2bd398 in save_normal_page (async=<optimized out>, > buf=<optimized out>, offset=1175552, block=0x2aa1b19f340, pss=0x3ff40003000) > at ../migration/ram.c:1400 > #10 ram_save_page (pss=0x3ff40003000, rs=0x3ff40003000) at > ../migration/ram.c:1449 > #11 ram_save_target_page_legacy (rs=0x3ff40003000, pss=0x3ff40003000) at > ../migration/ram.c:2381 > #12 0x000002aa1a2ba330 in ram_save_host_page (pss=0x3ff40003000, > rs=0x3ff40003000) at ../migration/ram.c:2539 > #13 ram_find_and_save_block (rs=rs@entry=0x3ff40003000) at > ../migration/ram.c:2620 > #14 0x000002aa1a2ba9e4 in ram_save_iterate (f=0x2aa1b271260, > opaque=<optimized out>) at ../migration/ram.c:3361 > #15 0x000002aa1a12a524 in qemu_savevm_state_iterate (f=0x2aa1b271260, > postcopy=<optimized out>) at ../migration/savevm.c:1345 > #16 0x000002aa1a11da14 in migration_iteration_run (s=0x2aa1af3a810) at > ../migration/migration.c:3896 > #17 migration_thread (opaque=opaque@entry=0x2aa1af3a810) at > ../migration/migration.c:4124 > #18 0x000002aa1a4c42ca in qemu_thread_start (args=<optimized out>) at > ../util/qemu-thread-posix.c:541 > #19 0x000003ffb5307e66 in start_thread (arg=0x3ff469f7900) at > pthread_create.c:477 > #20 0x000003ffb51fcbe6 in thread_start () at > ../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65 > > Thread 5 (Thread 0x3ff471f8900 (LWP 1841394)): > #0 __libc_recvmsg (fd=<optimized out>, msg=msg@entry=0x3ff471f39f0, > flags=flags@entry=0) at ../sysdeps/unix/sysv/linux/recvmsg.c:30 > #1 0x000002aa1a34c7e4 in qio_channel_socket_readv (ioc=<optimized out>, > iov=<optimized out>, niov=<optimized out>, fds=0x0, nfds=0x0, flags=0, > errp=0x3ff471f3ca8) at ../io/channel-socket.c:532 > #2 0x000002aa1a351a70 in qio_channel_readv_full (ioc=0x2aa1c0f8400, > iov=iov@entry=0x3ff471f3bf0, niov=niov@entry=1, fds=fds@entry=0x0, > nfds=nfds@entry=0x0, flags=0, errp=0x3ff471f3ca8) at ../io/channel.c:74 > #3 0x000002aa1a351cf6 in qio_channel_read (ioc=<optimized out>, > buf=buf@entry=0x2aa1b17d9d8 "", buflen=buflen@entry=32768, > errp=errp@entry=0x3ff471f3ca8) at ../io/channel.c:314 > #4 0x000002aa1a10dd2e in qemu_fill_buffer (f=0x2aa1b17d9a0) at > ../migration/qemu-file.c:415 > #5 0x000002aa1a10e908 in qemu_peek_byte (f=0x2aa1b17d9a0, offset=<optimized > out>) at ../migration/qemu-file.c:707 > #6 0x000002aa1a10ebaa in qemu_get_byte (f=0x2aa1b17d9a0) at > ../migration/qemu-file.c:720 > #7 qemu_get_be16 (f=f@entry=0x2aa1b17d9a0) at ../migration/qemu-file.c:800 > #8 0x000002aa1a11a3d8 in source_return_path_thread > (opaque=opaque@entry=0x2aa1af3a810) at ../migration/migration.c:2995 > #9 0x000002aa1a4c42ca in qemu_thread_start (args=<optimized out>) at > ../util/qemu-thread-posix.c:541 > #10 0x000003ffb5307e66 in start_thread (arg=0x3ff471f8900) at > pthread_create.c:477 > #11 0x000003ffb51fcbe6 in thread_start () at > ../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65 > > Thread 4 (Thread 0x3ffa4eab900 (LWP 1841385)): > #0 futex_wait_cancelable (private=0, expected=0, futex_word=0x2aa1b29c30c) > at ../sysdeps/nptl/futex-internal.h:183 > #1 __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x2aa1ad9b798 > <qemu_global_mutex>, cond=0x2aa1b29c2e0) at pthread_cond_wait.c:508 > #2 __pthread_cond_wait (cond=cond@entry=0x2aa1b29c2e0, > mutex=mutex@entry=0x2aa1ad9b798 <qemu_global_mutex>) at > pthread_cond_wait.c:647 > #3 0x000002aa1a4c4cae in qemu_cond_wait_impl (cond=0x2aa1b29c2e0, > mutex=0x2aa1ad9b798 <qemu_global_mutex>, file=0x2aa1a60b014 > "../softmmu/cpus.c", line=<optimized out>) at ../util/qemu-thread-posix.c:225 > #4 0x000002aa1a0edafe in qemu_wait_io_event (cpu=cpu@entry=0x2aa1b26a160) at > ../softmmu/cpus.c:424 > #5 0x000002aa1a3315ca in mttcg_cpu_thread_fn (arg=arg@entry=0x2aa1b26a160) > at ../accel/tcg/tcg-accel-ops-mttcg.c:123 > #6 0x000002aa1a4c42ca in qemu_thread_start (args=<optimized out>) at > ../util/qemu-thread-posix.c:541 > #7 0x000003ffb5307e66 in start_thread (arg=0x3ffa4eab900) at > pthread_create.c:477 > #8 0x000003ffb51fcbe6 in thread_start () at > ../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65 > > Thread 3 (Thread 0x3ffa579d900 (LWP 1841384)): > #0 0x000003ffb51f1b32 in __GI___poll (fds=0x3ff58003280, nfds=3, > timeout=<optimized out>) at ../sysdeps/unix/sysv/linux/poll.c:29 > #1 0x000003ffb79d4386 in () at /lib/s390x-linux-gnu/libglib-2.0.so.0 > #2 0x000003ffb79d4790 in g_main_loop_run () at > /lib/s390x-linux-gnu/libglib-2.0.so.0 > #3 0x000002aa1a37480e in iothread_run (opaque=opaque@entry=0x2aa1b0aec00) at > ../iothread.c:70 > #4 0x000002aa1a4c42ca in qemu_thread_start (args=<optimized out>) at > ../util/qemu-thread-posix.c:541 > #5 0x000003ffb5307e66 in start_thread (arg=0x3ffa579d900) at > pthread_create.c:477 > #6 0x000003ffb51fcbe6 in thread_start () at > ../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65 > > Thread 2 (Thread 0x3ffa6423900 (LWP 1841383)): > #0 syscall () at ../sysdeps/unix/sysv/linux/s390/s390-64/syscall.S:37 > #1 0x000002aa1a4c5264 in qemu_futex_wait (val=<optimized out>, f=<optimized > out>) at > /home/gitlab-runner/builds/FLaZkdt1/0/qemu-project/qemu/include/qemu/futex.h:29 > #2 qemu_event_wait (ev=ev@entry=0x2aa1adccab0 <rcu_call_ready_event>) at > ../util/qemu-thread-posix.c:464 > #3 0x000002aa1a4cde3a in call_rcu_thread (opaque=opaque@entry=0x0) at > ../util/rcu.c:261 > #4 0x000002aa1a4c42ca in qemu_thread_start (args=<optimized out>) at > ../util/qemu-thread-posix.c:541 > #5 0x000003ffb5307e66 in start_thread (arg=0x3ffa6423900) at > pthread_create.c:477 > #6 0x000003ffb51fcbe6 in thread_start () at > ../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65 > > Thread 1 (Thread 0x3ffb8b7e4a0 (LWP 1841381)): > #0 0x000003ffb51f1c8c in __ppoll (fds=0x2aa1c0ffbd0, nfds=5, > timeout=<optimized out>, timeout@entry=0x3fffbb79bc8, > sigmask=sigmask@entry=0x0) at ../sysdeps/unix/sysv/linux/ppoll.c:44 > #1 0x000002aa1a4da07a in ppoll (__ss=0x0, __timeout=0x3fffbb79bc8, > __nfds=<optimized out>, __fds=<optimized out>) at > /usr/include/s390x-linux-gnu/bits/poll2.h:77 > #2 qemu_poll_ns (fds=<optimized out>, nfds=<optimized out>, > timeout=timeout@entry=1000000000) at ../util/qemu-timer.c:351 > #3 0x000002aa1a4d7090 in os_host_main_loop_wait (timeout=1000000000) at > ../util/main-loop.c:312 > #4 main_loop_wait (nonblocking=nonblocking@entry=0) at > ../util/main-loop.c:603 > #5 0x000002aa1a0f46d4 in qemu_main_loop () at ../softmmu/runstate.c:731 > #6 0x000002aa19f0e312 in qemu_default_main () at ../softmmu/main.c:37 > #7 0x000003ffb512440a in __libc_start_main (main=0x2aa19f0b8d8 <main>, > argc=<optimized out>, argv=0x3fffbb7a018, init=<optimized out>, > fini=<optimized out>, rtld_fini=0x3ffb8b90e50 <_dl_fini>, > stack_end=0x3fffbb79f60) at libc-start.c:308 > #8 0x000002aa19f0e23c in _start () at ../softmmu/main.c:48 > [Inferior 1 (process 1841381) detached] > > =========================================================== > PROCESS: 1841387 > gitlab-+ 1841387 1841031 0 Mar13 ? 00:00:00 ./qemu-system-x86_64 > -qtest unix:/tmp/qtest-1841031.sock -qtest-log /dev/null -chardev > socket,path=/tmp/qtest-1841031.qmp,id=char0 -mon chardev=char0,mode=control > -display none -accel kvm -accel tcg -name target,debug-threads=on -m 150M > -serial file:/tmp/migration-test-RM5901/dest_serial -incoming > unix:/tmp/migration-test-RM5901/migsocket -drive > file=/tmp/migration-test-RM5901/bootsect,format=raw -accel qtest > [New LWP 1841389] > [New LWP 1841390] > [New LWP 1841391] > [New LWP 1841397] > [Thread debugging using libthread_db enabled] > Using host libthread_db library "/lib/s390x-linux-gnu/libthread_db.so.1". > futex_wait_cancelable (private=0, expected=0, futex_word=0x2aa370039c0) at > ../sysdeps/nptl/futex-internal.h:183 > > Thread 5 (Thread 0x3ff3a1fd900 (LWP 1841397)): > #0 0x000003ffa3571b32 in __GI___poll (fds=fds@entry=0x3ff2c000b60, nfds=2, > nfds@entry=<error reading variable: value has been optimized out>, > timeout=timeout@entry=-1) at ../sysdeps/unix/sysv/linux/poll.c:29 > #1 0x000002aa348a4dfe in poll (__timeout=-1, __nfds=<optimized out>, > __fds=0x3ff2c000b60) at /usr/include/s390x-linux-gnu/bits/poll2.h:46 > #2 postcopy_ram_fault_thread (opaque=opaque@entry=0x2aa37003800) at > ../migration/postcopy-ram.c:952 > #3 0x000002aa34c442ca in qemu_thread_start (args=<optimized out>) at > ../util/qemu-thread-posix.c:541 > #4 0x000003ffa3687e66 in start_thread (arg=0x3ff3a1fd900) at > pthread_create.c:477 > #5 0x000003ffa357cbe6 in thread_start () at > ../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65 > > Thread 4 (Thread 0x3ff9322b900 (LWP 1841391)): > #0 futex_wait_cancelable (private=0, expected=0, futex_word=0x2aa3711630c) > at ../sysdeps/nptl/futex-internal.h:183 > #1 __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x2aa3551b798 > <qemu_global_mutex>, cond=0x2aa371162e0) at pthread_cond_wait.c:508 > #2 __pthread_cond_wait (cond=cond@entry=0x2aa371162e0, > mutex=mutex@entry=0x2aa3551b798 <qemu_global_mutex>) at > pthread_cond_wait.c:647 > #3 0x000002aa34c44cae in qemu_cond_wait_impl (cond=0x2aa371162e0, > mutex=0x2aa3551b798 <qemu_global_mutex>, file=0x2aa34d8b014 > "../softmmu/cpus.c", line=<optimized out>) at ../util/qemu-thread-posix.c:225 > #4 0x000002aa3486dafe in qemu_wait_io_event (cpu=cpu@entry=0x2aa370e4160) at > ../softmmu/cpus.c:424 > #5 0x000002aa34ab15ca in mttcg_cpu_thread_fn (arg=arg@entry=0x2aa370e4160) > at ../accel/tcg/tcg-accel-ops-mttcg.c:123 > #6 0x000002aa34c442ca in qemu_thread_start (args=<optimized out>) at > ../util/qemu-thread-posix.c:541 > #7 0x000003ffa3687e66 in start_thread (arg=0x3ff9322b900) at > pthread_create.c:477 > #8 0x000003ffa357cbe6 in thread_start () at > ../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65 > > Thread 3 (Thread 0x3ff93b1d900 (LWP 1841390)): > #0 0x000003ffa3571b32 in __GI___poll (fds=0x3ff44003280, nfds=3, > timeout=<optimized out>) at ../sysdeps/unix/sysv/linux/poll.c:29 > #1 0x000003ffa5d54386 in () at /lib/s390x-linux-gnu/libglib-2.0.so.0 > #2 0x000003ffa5d54790 in g_main_loop_run () at > /lib/s390x-linux-gnu/libglib-2.0.so.0 > #3 0x000002aa34af480e in iothread_run (opaque=opaque@entry=0x2aa36f28c00) at > ../iothread.c:70 > #4 0x000002aa34c442ca in qemu_thread_start (args=<optimized out>) at > ../util/qemu-thread-posix.c:541 > #5 0x000003ffa3687e66 in start_thread (arg=0x3ff93b1d900) at > pthread_create.c:477 > #6 0x000003ffa357cbe6 in thread_start () at > ../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65 > > Thread 2 (Thread 0x3ff947a3900 (LWP 1841389)): > #0 syscall () at ../sysdeps/unix/sysv/linux/s390/s390-64/syscall.S:37 > #1 0x000002aa34c45264 in qemu_futex_wait (val=<optimized out>, f=<optimized > out>) at > /home/gitlab-runner/builds/FLaZkdt1/0/qemu-project/qemu/include/qemu/futex.h:29 > #2 qemu_event_wait (ev=ev@entry=0x2aa3554cab0 <rcu_call_ready_event>) at > ../util/qemu-thread-posix.c:464 > #3 0x000002aa34c4de3a in call_rcu_thread (opaque=opaque@entry=0x0) at > ../util/rcu.c:261 > #4 0x000002aa34c442ca in qemu_thread_start (args=<optimized out>) at > ../util/qemu-thread-posix.c:541 > #5 0x000003ffa3687e66 in start_thread (arg=0x3ff947a3900) at > pthread_create.c:477 > #6 0x000003ffa357cbe6 in thread_start () at > ../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65 > > Thread 1 (Thread 0x3ffa6efe4a0 (LWP 1841387)): > #0 futex_wait_cancelable (private=0, expected=0, futex_word=0x2aa370039c0) > at ../sysdeps/nptl/futex-internal.h:183 > #1 __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x2aa37003968, > cond=0x2aa37003998) at pthread_cond_wait.c:508 > #2 __pthread_cond_wait (cond=cond@entry=0x2aa37003998, > mutex=mutex@entry=0x2aa37003968) at pthread_cond_wait.c:647 > #3 0x000002aa34c44cae in qemu_cond_wait_impl (cond=0x2aa37003998, > mutex=0x2aa37003968, file=0x2aa34e65f06 "../util/qemu-thread-posix.c", > line=<optimized out>) at ../util/qemu-thread-posix.c:225 > #4 0x000002aa34c450ce in qemu_sem_wait (sem=0x2aa37003968) at > ../util/qemu-thread-posix.c:314 > #5 0x000002aa348a444a in postcopy_ram_incoming_setup (mis=0x2aa37003800, > mis@entry=<error reading variable: value has been optimized out>) at > ../migration/postcopy-ram.c:1204 > #6 0x000002aa348abb60 in loadvm_postcopy_handle_listen (mis=<optimized out>) > at ../migration/savevm.c:2016 > #7 loadvm_process_command (f=0x2aa37201810) at ../migration/savevm.c:2379 > #8 qemu_loadvm_state_main (f=f@entry=0x2aa37201810, mis=0x2aa37003800) at > ../migration/savevm.c:2724 > #9 0x000002aa348abeee in loadvm_handle_cmd_packaged (mis=<optimized out>) at > ../migration/savevm.c:2248 > #10 loadvm_process_command (f=0x2aa370eb260) at ../migration/savevm.c:2373 > #11 qemu_loadvm_state_main (f=f@entry=0x2aa370eb260, > mis=mis@entry=0x2aa37003800) at ../migration/savevm.c:2724 > #12 0x000002aa348acb04 in qemu_loadvm_state (f=0x2aa370eb260) at > ../migration/savevm.c:2790 > #13 0x000002aa34899b54 in process_incoming_migration_co (opaque=<optimized > out>) at ../migration/migration.c:606 > #14 0x000002aa34c58f16 in coroutine_trampoline (i0=<optimized out>, > i1=<optimized out>) at ../util/coroutine-ucontext.c:177 > #15 0x000003ffa34d69c2 in __makecontext_ret () at > ../sysdeps/unix/sysv/linux/s390/s390-64/__makecontext_ret.S:23 > [Inferior 1 (process 1841387) detached] > > Process tree: > migration-test(1840499)-+-qemu-system-i38(1841012) > `-qemu-system-i38(1841019) > =========================================================== > PROCESS: 1840499 > gitlab-+ 1840499 1838397 0 Mar13 ? 00:00:02 > /home/gitlab-runner/builds/FLaZkdt1/0/qemu-project/qemu/build/tests/qtest/migration-test > --tap -k > [New LWP 1840501] > [Thread debugging using libthread_db enabled] > Using host libthread_db library "/lib/s390x-linux-gnu/libthread_db.so.1". > __libc_recv (fd=fd@entry=5, buf=buf@entry=0x3fff23798b7, len=len@entry=1, > flags=flags@entry=0) at ../sysdeps/unix/sysv/linux/recv.c:30 > 30 ../sysdeps/unix/sysv/linux/recv.c: No such file or directory. > > Thread 2 (Thread 0x3ffbe3ff900 (LWP 1840501)): > #0 syscall () at ../sysdeps/unix/sysv/linux/s390/s390-64/syscall.S:37 > #1 0x000002aa029dae34 in qemu_futex_wait (val=<optimized out>, f=<optimized > out>) at > /home/gitlab-runner/builds/FLaZkdt1/0/qemu-project/qemu/include/qemu/futex.h:29 > #2 qemu_event_wait (ev=ev@entry=0x2aa02b596b8 <rcu_call_ready_event>) at > ../util/qemu-thread-posix.c:464 > #3 0x000002aa02a079ea in call_rcu_thread (opaque=opaque@entry=0x0) at > ../util/rcu.c:261 > #4 0x000002aa029d9e9a in qemu_thread_start (args=<optimized out>) at > ../util/qemu-thread-posix.c:541 > #5 0x000003ffbed87e66 in start_thread (arg=0x3ffbe3ff900) at > pthread_create.c:477 > #6 0x000003ffbec7cbe6 in thread_start () at > ../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65 > > Thread 1 (Thread 0x3ffbf46d990 (LWP 1840499)): > #0 __libc_recv (fd=fd@entry=5, buf=buf@entry=0x3fff23798b7, len=len@entry=1, > flags=flags@entry=0) at ../sysdeps/unix/sysv/linux/recv.c:30 > #1 0x000002aa029aba22 in recv (__flags=0, __n=1, __buf=0x3fff23798b7, > __fd=5) at /usr/include/s390x-linux-gnu/bits/socket2.h:44 > #2 qmp_fd_receive (fd=<optimized out>) at ../tests/qtest/libqmp.c:73 > #3 0x000002aa029a9b8e in qtest_qmp_receive_dict (s=0x2aa0327d120) at > ../tests/qtest/libqtest.c:837 > #4 qtest_qmp_eventwait_ref (event=<optimized out>, s=<optimized out>) at > ../tests/qtest/libqtest.c:837 > #5 qtest_qmp_eventwait_ref (s=0x2aa0327d120, event=<optimized out>) at > ../tests/qtest/libqtest.c:828 > #6 0x000002aa029a9c1a in qtest_qmp_eventwait (s=<optimized out>, > event=<optimized out>) at ../tests/qtest/libqtest.c:850 > #7 0x000002aa0299ec56 in test_postcopy_common (args=0x3fff2379bb8) at > ../tests/qtest/migration-test.c:1161 > #8 0x000002aa0299edb4 in test_postcopy_preempt () at > ../tests/qtest/migration-test.c:1178 > #9 0x000003ffbef7e608 in ?? () from /lib/s390x-linux-gnu/libglib-2.0.so.0 > #10 0x000003ffbef7e392 in ?? () from /lib/s390x-linux-gnu/libglib-2.0.so.0 > #11 0x000003ffbef7e392 in ?? () from /lib/s390x-linux-gnu/libglib-2.0.so.0 > #12 0x000003ffbef7e392 in ?? () from /lib/s390x-linux-gnu/libglib-2.0.so.0 > #13 0x000003ffbef7e392 in ?? () from /lib/s390x-linux-gnu/libglib-2.0.so.0 > #14 0x000003ffbef7eada in g_test_run_suite () from > /lib/s390x-linux-gnu/libglib-2.0.so.0 > #15 0x000003ffbef7eb10 in g_test_run () from > /lib/s390x-linux-gnu/libglib-2.0.so.0 > #16 0x000002aa0299ab14 in main (argc=<optimized out>, argv=<optimized out>) > at ../tests/qtest/migration-test.c:2615 > [Inferior 1 (process 1840499) detached] > > =========================================================== > PROCESS: 1841012 > gitlab-+ 1841012 1840499 0 Mar13 ? 00:00:06 ./qemu-system-i386 -qtest > unix:/tmp/qtest-1840499.sock -qtest-log /dev/null -chardev > socket,path=/tmp/qtest-1840499.qmp,id=char0 -mon chardev=char0,mode=control > -display none -accel kvm -accel tcg -name source,debug-threads=on -m 150M > -serial file:/tmp/migration-test-8IQB11/src_serial -drive > file=/tmp/migration-test-8IQB11/bootsect,format=raw -accel qtest > [New LWP 1841014] > [New LWP 1841015] > [New LWP 1841016] > [New LWP 1841062] > [New LWP 1841063] > [Thread debugging using libthread_db enabled] > Using host libthread_db library "/lib/s390x-linux-gnu/libthread_db.so.1". > 0x000003ff9a771c8c in __ppoll (fds=0x2aa396d66e0, nfds=5, timeout=<optimized > out>, timeout@entry=0x3ffd40fa048, sigmask=sigmask@entry=0x0) at > ../sysdeps/unix/sysv/linux/ppoll.c:44 > 44 ../sysdeps/unix/sysv/linux/ppoll.c: No such file or directory. > > Thread 6 (Thread 0x3ff2bfff900 (LWP 1841063)): > #0 __libc_sendmsg (fd=<optimized out>, msg=msg@entry=0x3ff2bffa810, > flags=flags@entry=0) at ../sysdeps/unix/sysv/linux/sendmsg.c:30 > #1 0x000002aa38343b7a in qio_channel_socket_writev (ioc=<optimized out>, > iov=<optimized out>, niov=<optimized out>, fds=<optimized out>, > nfds=<optimized out>, flags=0, errp=0x3ff2bffab80) at > ../io/channel-socket.c:605 > #2 0x000002aa383491d8 in qio_channel_writev_full > (ioc=ioc@entry=0x2aa3a52fa80, iov=0x2aa3a53b300, niov=64, fds=fds@entry=0x0, > nfds=nfds@entry=0, flags=0, errp=0x3ff2bffab80) at ../io/channel.c:108 > #3 0x000002aa3834a050 in qio_channel_writev_full_all (ioc=0x2aa3a52fa80, > iov=iov@entry=0x2aa396b26b0, niov=<optimized out>, fds=fds@entry=0x0, > nfds=nfds@entry=0, flags=0, errp=0x3ff2bffab80) at ../io/channel.c:263 > #4 0x000002aa3834a0fe in qio_channel_writev_all (ioc=<optimized out>, > iov=iov@entry=0x2aa396b26b0, niov=<optimized out>, > errp=errp@entry=0x3ff2bffab80) at ../io/channel.c:242 > #5 0x000002aa3810d404 in qemu_fflush (f=f@entry=0x2aa396aa670) at > ../migration/qemu-file.c:302 > #6 0x000002aa3810d692 in qemu_fflush (f=0x2aa396aa670) at > ../migration/qemu-file.c:297 > #7 add_to_iovec (f=f@entry=0x2aa396aa670, buf=<optimized out>, > size=size@entry=4096, may_free=<optimized out>) at > ../migration/qemu-file.c:510 > #8 0x000002aa3810db76 in qemu_put_buffer_async (f=f@entry=0x2aa396aa670, > buf=<error reading variable: value has been optimized out>, > size=size@entry=4096, may_free=<optimized out>) at > ../migration/qemu-file.c:535 > #9 0x000002aa382b4d00 in save_normal_page (async=<optimized out>, > buf=<optimized out>, offset=1175552, block=0x2aa395dabb0, pss=0x3ff24002800) > at ../migration/ram.c:1400 > #10 ram_save_page (pss=0x3ff24002800, rs=0x3ff24002800) at > ../migration/ram.c:1449 > #11 ram_save_target_page_legacy (rs=0x3ff24002800, pss=0x3ff24002800) at > ../migration/ram.c:2381 > #12 0x000002aa382b1c98 in ram_save_host_page (pss=0x3ff24002800, > rs=0x3ff24002800) at ../migration/ram.c:2539 > #13 ram_find_and_save_block (rs=rs@entry=0x3ff24002800) at > ../migration/ram.c:2620 > #14 0x000002aa382b234c in ram_save_iterate (f=0x2aa396aa670, > opaque=<optimized out>) at ../migration/ram.c:3361 > #15 0x000002aa38129a94 in qemu_savevm_state_iterate (f=0x2aa396aa670, > postcopy=<optimized out>) at ../migration/savevm.c:1345 > #16 0x000002aa3811cf84 in migration_iteration_run (s=0x2aa39375710) at > ../migration/migration.c:3896 > #17 migration_thread (opaque=opaque@entry=0x2aa39375710) at > ../migration/migration.c:4124 > #18 0x000002aa384bb91a in qemu_thread_start (args=<optimized out>) at > ../util/qemu-thread-posix.c:541 > #19 0x000003ff9a887e66 in start_thread (arg=0x3ff2bfff900) at > pthread_create.c:477 > #20 0x000003ff9a77cbe6 in thread_start () at > ../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65 > > Thread 5 (Thread 0x3ff30ff9900 (LWP 1841062)): > #0 __libc_recvmsg (fd=<optimized out>, msg=msg@entry=0x3ff30ff49f0, > flags=flags@entry=0) at ../sysdeps/unix/sysv/linux/recvmsg.c:30 > #1 0x000002aa38343e34 in qio_channel_socket_readv (ioc=<optimized out>, > iov=<optimized out>, niov=<optimized out>, fds=0x0, nfds=0x0, flags=0, > errp=0x3ff30ff4ca8) at ../io/channel-socket.c:532 > #2 0x000002aa383490c0 in qio_channel_readv_full (ioc=0x2aa3a52fa80, > iov=iov@entry=0x3ff30ff4bf0, niov=niov@entry=1, fds=fds@entry=0x0, > nfds=nfds@entry=0x0, flags=0, errp=0x3ff30ff4ca8) at ../io/channel.c:74 > #3 0x000002aa38349346 in qio_channel_read (ioc=<optimized out>, > buf=buf@entry=0x2aa395b9548 "", buflen=buflen@entry=32768, > errp=errp@entry=0x3ff30ff4ca8) at ../io/channel.c:314 > #4 0x000002aa3810d29e in qemu_fill_buffer (f=0x2aa395b9510) at > ../migration/qemu-file.c:415 > #5 0x000002aa3810de78 in qemu_peek_byte (f=0x2aa395b9510, offset=<optimized > out>) at ../migration/qemu-file.c:707 > #6 0x000002aa3810e11a in qemu_get_byte (f=0x2aa395b9510) at > ../migration/qemu-file.c:720 > #7 qemu_get_be16 (f=f@entry=0x2aa395b9510) at ../migration/qemu-file.c:800 > #8 0x000002aa38119948 in source_return_path_thread > (opaque=opaque@entry=0x2aa39375710) at ../migration/migration.c:2995 > #9 0x000002aa384bb91a in qemu_thread_start (args=<optimized out>) at > ../util/qemu-thread-posix.c:541 > #10 0x000003ff9a887e66 in start_thread (arg=0x3ff30ff9900) at > pthread_create.c:477 > #11 0x000003ff9a77cbe6 in thread_start () at > ../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65 > > Thread 4 (Thread 0x3ff8a42b900 (LWP 1841016)): > #0 futex_wait_cancelable (private=0, expected=0, futex_word=0x2aa396d5718) > at ../sysdeps/nptl/futex-internal.h:183 > #1 __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x2aa38d8fcf0 > <qemu_global_mutex>, cond=0x2aa396d56f0) at pthread_cond_wait.c:508 > #2 __pthread_cond_wait (cond=cond@entry=0x2aa396d56f0, > mutex=mutex@entry=0x2aa38d8fcf0 <qemu_global_mutex>) at > pthread_cond_wait.c:647 > #3 0x000002aa384bc2fe in qemu_cond_wait_impl (cond=0x2aa396d56f0, > mutex=0x2aa38d8fcf0 <qemu_global_mutex>, file=0x2aa38602664 > "../softmmu/cpus.c", line=<optimized out>) at ../util/qemu-thread-posix.c:225 > #4 0x000002aa380ed06e in qemu_wait_io_event (cpu=cpu@entry=0x2aa396a5980) at > ../softmmu/cpus.c:424 > #5 0x000002aa38328c1a in mttcg_cpu_thread_fn (arg=arg@entry=0x2aa396a5980) > at ../accel/tcg/tcg-accel-ops-mttcg.c:123 > #6 0x000002aa384bb91a in qemu_thread_start (args=<optimized out>) at > ../util/qemu-thread-posix.c:541 > #7 0x000003ff9a887e66 in start_thread (arg=0x3ff8a42b900) at > pthread_create.c:477 > #8 0x000003ff9a77cbe6 in thread_start () at > ../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65 > > Thread 3 (Thread 0x3ff8ad1d900 (LWP 1841015)): > #0 0x000003ff9a771b32 in __GI___poll (fds=0x3ff3c003280, nfds=3, > timeout=<optimized out>) at ../sysdeps/unix/sysv/linux/poll.c:29 > #1 0x000003ff9cf54386 in () at /lib/s390x-linux-gnu/libglib-2.0.so.0 > #2 0x000003ff9cf54790 in g_main_loop_run () at > /lib/s390x-linux-gnu/libglib-2.0.so.0 > #3 0x000002aa3836be5e in iothread_run (opaque=opaque@entry=0x2aa39477800) at > ../iothread.c:70 > #4 0x000002aa384bb91a in qemu_thread_start (args=<optimized out>) at > ../util/qemu-thread-posix.c:541 > #5 0x000003ff9a887e66 in start_thread (arg=0x3ff8ad1d900) at > pthread_create.c:477 > #6 0x000003ff9a77cbe6 in thread_start () at > ../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65 > > Thread 2 (Thread 0x3ff8b9a3900 (LWP 1841014)): > #0 syscall () at ../sysdeps/unix/sysv/linux/s390/s390-64/syscall.S:37 > #1 0x000002aa384bc8b4 in qemu_futex_wait (val=<optimized out>, f=<optimized > out>) at > /home/gitlab-runner/builds/FLaZkdt1/0/qemu-project/qemu/include/qemu/futex.h:29 > #2 qemu_event_wait (ev=ev@entry=0x2aa38dbffc8 <rcu_call_ready_event>) at > ../util/qemu-thread-posix.c:464 > #3 0x000002aa384c548a in call_rcu_thread (opaque=opaque@entry=0x0) at > ../util/rcu.c:261 > #4 0x000002aa384bb91a in qemu_thread_start (args=<optimized out>) at > ../util/qemu-thread-posix.c:541 > #5 0x000003ff9a887e66 in start_thread (arg=0x3ff8b9a3900) at > pthread_create.c:477 > #6 0x000003ff9a77cbe6 in thread_start () at > ../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65 > > Thread 1 (Thread 0x3ff9e0fe4a0 (LWP 1841012)): > #0 0x000003ff9a771c8c in __ppoll (fds=0x2aa396d66e0, nfds=5, > timeout=<optimized out>, timeout@entry=0x3ffd40fa048, > sigmask=sigmask@entry=0x0) at ../sysdeps/unix/sysv/linux/ppoll.c:44 > #1 0x000002aa384d16ca in ppoll (__ss=0x0, __timeout=0x3ffd40fa048, > __nfds=<optimized out>, __fds=<optimized out>) at > /usr/include/s390x-linux-gnu/bits/poll2.h:77 > #2 qemu_poll_ns (fds=<optimized out>, nfds=<optimized out>, > timeout=timeout@entry=1000000000) at ../util/qemu-timer.c:351 > #3 0x000002aa384ce6e0 in os_host_main_loop_wait (timeout=1000000000) at > ../util/main-loop.c:312 > #4 main_loop_wait (nonblocking=nonblocking@entry=0) at > ../util/main-loop.c:603 > #5 0x000002aa380f3c44 in qemu_main_loop () at ../softmmu/runstate.c:731 > #6 0x000002aa37f0d882 in qemu_default_main () at ../softmmu/main.c:37 > #7 0x000003ff9a6a440a in __libc_start_main (main=0x2aa37f0ae48 <main>, > argc=<optimized out>, argv=0x3ffd40fa498, init=<optimized out>, > fini=<optimized out>, rtld_fini=0x3ff9e110e50 <_dl_fini>, > stack_end=0x3ffd40fa3e0) at libc-start.c:308 > #8 0x000002aa37f0d7ac in _start () at ../softmmu/main.c:48 > [Inferior 1 (process 1841012) detached] > > =========================================================== > PROCESS: 1841019 > gitlab-+ 1841019 1840499 0 Mar13 ? 00:00:00 ./qemu-system-i386 -qtest > unix:/tmp/qtest-1840499.sock -qtest-log /dev/null -chardev > socket,path=/tmp/qtest-1840499.qmp,id=char0 -mon chardev=char0,mode=control > -display none -accel kvm -accel tcg -name target,debug-threads=on -m 150M > -serial file:/tmp/migration-test-8IQB11/dest_serial -incoming > unix:/tmp/migration-test-8IQB11/migsocket -drive > file=/tmp/migration-test-8IQB11/bootsect,format=raw -accel qtest > [New LWP 1841021] > [New LWP 1841022] > [New LWP 1841023] > [New LWP 1841067] > [Thread debugging using libthread_db enabled] > Using host libthread_db library "/lib/s390x-linux-gnu/libthread_db.so.1". > futex_wait_cancelable (private=0, expected=0, futex_word=0x2aa3a92e1c0) at > ../sysdeps/nptl/futex-internal.h:183 > 183 ../sysdeps/nptl/futex-internal.h: No such file or directory. > > Thread 5 (Thread 0x3ff4a8ff900 (LWP 1841067)): > #0 0x000003ffb0071b32 in __GI___poll (fds=fds@entry=0x3ff40000b60, nfds=2, > nfds@entry=<error reading variable: value has been optimized out>, > timeout=timeout@entry=-1) at ../sysdeps/unix/sysv/linux/poll.c:29 > #1 0x000002aa382a436e in poll (__timeout=-1, __nfds=<optimized out>, > __fds=0x3ff40000b60) at /usr/include/s390x-linux-gnu/bits/poll2.h:46 > #2 postcopy_ram_fault_thread (opaque=opaque@entry=0x2aa3a92e000) at > ../migration/postcopy-ram.c:952 > #3 0x000002aa3863b91a in qemu_thread_start (args=<optimized out>) at > ../util/qemu-thread-posix.c:541 > #4 0x000003ffb0187e66 in start_thread (arg=0x3ff4a8ff900) at > pthread_create.c:477 > #5 0x000003ffb007cbe6 in thread_start () at > ../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65 > > Thread 4 (Thread 0x3ff5b7fe900 (LWP 1841023)): > #0 futex_wait_cancelable (private=0, expected=0, futex_word=0x2aa3aa3e69c) > at ../sysdeps/nptl/futex-internal.h:183 > #1 __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x2aa38f0fcf0 > <qemu_global_mutex>, cond=0x2aa3aa3e670) at pthread_cond_wait.c:508 > #2 __pthread_cond_wait (cond=cond@entry=0x2aa3aa3e670, > mutex=mutex@entry=0x2aa38f0fcf0 <qemu_global_mutex>) at > pthread_cond_wait.c:647 > #3 0x000002aa3863c2fe in qemu_cond_wait_impl (cond=0x2aa3aa3e670, > mutex=0x2aa38f0fcf0 <qemu_global_mutex>, file=0x2aa38782664 > "../softmmu/cpus.c", line=<optimized out>) at ../util/qemu-thread-posix.c:225 > #4 0x000002aa3826d06e in qemu_wait_io_event (cpu=cpu@entry=0x2aa3aa0e980) at > ../softmmu/cpus.c:424 > #5 0x000002aa384a8c1a in mttcg_cpu_thread_fn (arg=arg@entry=0x2aa3aa0e980) > at ../accel/tcg/tcg-accel-ops-mttcg.c:123 > #6 0x000002aa3863b91a in qemu_thread_start (args=<optimized out>) at > ../util/qemu-thread-posix.c:541 > #7 0x000003ffb0187e66 in start_thread (arg=0x3ff5b7fe900) at > pthread_create.c:477 > #8 0x000003ffb007cbe6 in thread_start () at > ../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65 > > Thread 3 (Thread 0x3ff5bfff900 (LWP 1841022)): > #0 0x000003ffb0071b32 in __GI___poll (fds=0x3ff54003280, nfds=3, > timeout=<optimized out>) at ../sysdeps/unix/sysv/linux/poll.c:29 > #1 0x000003ffb2854386 in () at /lib/s390x-linux-gnu/libglib-2.0.so.0 > #2 0x000003ffb2854790 in g_main_loop_run () at > /lib/s390x-linux-gnu/libglib-2.0.so.0 > #3 0x000002aa384ebe5e in iothread_run (opaque=opaque@entry=0x2aa3a7e0800) at > ../iothread.c:70 > #4 0x000002aa3863b91a in qemu_thread_start (args=<optimized out>) at > ../util/qemu-thread-posix.c:541 > #5 0x000003ffb0187e66 in start_thread (arg=0x3ff5bfff900) at > pthread_create.c:477 > #6 0x000003ffb007cbe6 in thread_start () at > ../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65 > > Thread 2 (Thread 0x3ffa12a3900 (LWP 1841021)): > #0 syscall () at ../sysdeps/unix/sysv/linux/s390/s390-64/syscall.S:37 > #1 0x000002aa3863c8b4 in qemu_futex_wait (val=<optimized out>, f=<optimized > out>) at > /home/gitlab-runner/builds/FLaZkdt1/0/qemu-project/qemu/include/qemu/futex.h:29 > #2 qemu_event_wait (ev=ev@entry=0x2aa38f3ffc8 <rcu_call_ready_event>) at > ../util/qemu-thread-posix.c:464 > #3 0x000002aa3864548a in call_rcu_thread (opaque=opaque@entry=0x0) at > ../util/rcu.c:261 > #4 0x000002aa3863b91a in qemu_thread_start (args=<optimized out>) at > ../util/qemu-thread-posix.c:541 > #5 0x000003ffb0187e66 in start_thread (arg=0x3ffa12a3900) at > pthread_create.c:477 > #6 0x000003ffb007cbe6 in thread_start () at > ../sysdeps/unix/sysv/linux/s390/s390-64/clone.S:65 > > Thread 1 (Thread 0x3ffb39fe4a0 (LWP 1841019)): > #0 futex_wait_cancelable (private=0, expected=0, futex_word=0x2aa3a92e1c0) > at ../sysdeps/nptl/futex-internal.h:183 > #1 __pthread_cond_wait_common (abstime=0x0, clockid=0, mutex=0x2aa3a92e168, > cond=0x2aa3a92e198) at pthread_cond_wait.c:508 > #2 __pthread_cond_wait (cond=cond@entry=0x2aa3a92e198, > mutex=mutex@entry=0x2aa3a92e168) at pthread_cond_wait.c:647 > #3 0x000002aa3863c2fe in qemu_cond_wait_impl (cond=0x2aa3a92e198, > mutex=0x2aa3a92e168, file=0x2aa3885b73e "../util/qemu-thread-posix.c", > line=<optimized out>) at ../util/qemu-thread-posix.c:225 > #4 0x000002aa3863c71e in qemu_sem_wait (sem=0x2aa3a92e168) at > ../util/qemu-thread-posix.c:314 > #5 0x000002aa382a39ba in postcopy_ram_incoming_setup (mis=0x2aa3a92e000, > mis@entry=<error reading variable: value has been optimized out>) at > ../migration/postcopy-ram.c:1204 > #6 0x000002aa382ab0d0 in loadvm_postcopy_handle_listen (mis=<optimized out>) > at ../migration/savevm.c:2016 > #7 loadvm_process_command (f=0x2aa3aa5c7d0) at ../migration/savevm.c:2379 > #8 qemu_loadvm_state_main (f=f@entry=0x2aa3aa5c7d0, mis=0x2aa3a92e000) at > ../migration/savevm.c:2724 > #9 0x000002aa382ab45e in loadvm_handle_cmd_packaged (mis=<optimized out>) at > ../migration/savevm.c:2248 > #10 loadvm_process_command (f=0x2aa3aa135f0) at ../migration/savevm.c:2373 > #11 qemu_loadvm_state_main (f=f@entry=0x2aa3aa135f0, > mis=mis@entry=0x2aa3a92e000) at ../migration/savevm.c:2724 > #12 0x000002aa382ac074 in qemu_loadvm_state (f=0x2aa3aa135f0) at > ../migration/savevm.c:2790 > #13 0x000002aa382990c4 in process_incoming_migration_co (opaque=<optimized > out>) at ../migration/migration.c:606 > #14 0x000002aa38650566 in coroutine_trampoline (i0=<optimized out>, > i1=<optimized out>) at ../util/coroutine-ucontext.c:177 > #15 0x000003ffaffd69c2 in __makecontext_ret () at > ../sysdeps/unix/sysv/linux/s390/s390-64/__makecontext_ret.S:23 > [Inferior 1 (process 1841019) detached] > -- Dr. David Alan Gilbert / dgilb...@redhat.com / Manchester, UK