Re: [PULL 00/30] Next patches
Richard Henderson wrote: > On 6/22/23 18:54, Juan Quintela wrote: >> The following changes since commit b455ce4c2f300c8ba47cba7232dd03261368a4cb: >>Merge tag 'q800-for-8.1-pull-request' >> ofhttps://github.com/vivier/qemu-m68k into staging (2023-06-22 >> 10:18:32 +0200) >> are available in the Git repository at: >>https://gitlab.com/juan.quintela/qemu.git tags/next-pull-request >> for you to fetch changes up to >> 23e4307eadc1497bd0a11ca91041768f15963b68: >>migration/rdma: Split qemu_fopen_rdma() into input/output >> functions (2023-06-22 18:11:58 +0200) >> >> Migration Pull request (20230621) take 2 >> In this pull request the only change is fixing 32 bits complitaion >> issue. >> Please apply. >> [take 1] >> - fix for multifd thread creation (fabiano) >> - dirtylimity (hyman) >>* migration-test will go on next PULL request, as it has failures. >> - Improve error description (tejus) >> - improve -incoming and set parameters before calling incoming (wei) >> - migration atomic counters reviewed patches (quintela) >> - migration-test refacttoring reviewed (quintela) > > New failure with check-cfi-x86_64: > > https://gitlab.com/qemu-project/qemu/-/jobs/4527202764#L188 > > /builds/qemu-project/qemu/build/pyvenv/bin/meson test --no-rebuild -t > 0 --num-processes 1 --print-errorlogs > 1/350 qemu:qtest+qtest-x86_64 / qtest-x86_64/qom-test > OK 6.55s 8 subtests passed > ▶ 2/350 ERROR:../tests/qtest/migration-test.c:320:check_guests_ram: > assertion failed: (bad == 0) ERROR > 2/350 qemu:qtest+qtest-x86_64 / qtest-x86_64/migration-test > ERROR 151.99s killed by signal 6 SIGABRT > G_TEST_DBUS_DAEMON=/builds/qemu-project/qemu/tests/dbus-vmstate-daemon.sh > MALLOC_PERTURB_=3 QTEST_QEMU_IMG=./qemu-img > QTEST_QEMU_STORAGE_DAEMON_BINARY=./storage-daemon/qemu-storage-daemon > QTEST_QEMU_BINARY=./qemu-system-x86_64 > /builds/qemu-project/qemu/build/tests/qtest/migration-test --tap >-k > ― ✀ ― > stderr: > qemu-system-x86_64: Unable to read from socket: Connection reset by peer > Memory content inconsistency at 4f65000 first_byte = 30 last_byte = 2f > current = 88 hit_edge = 1 > ** > ERROR:../tests/qtest/migration-test.c:320:check_guests_ram: assertion failed: > (bad == 0) > > (test program exited with status code -6) > ―― Still running in bisect mode (this takes forever). [cc'ing stefan and kevin] And now I get this problem with gcov: https://gitlab.com/juan.quintela/qemu/-/jobs/4546094720 357/423 qemu:block / io-qcow2-copy-before-write ERROR 6.23s exit status 1 >>> PYTHON=/builds/juan.quintela/qemu/build/pyvenv/bin/python3 >>> MALLOC_PERTURB_=154 /builds/juan.quintela/qemu/build/pyvenv/bin/python3 >>> /builds/juan.quintela/qemu/build/../tests/qemu-iotests/check -tap -qcow2 >>> copy-before-write --source-dir >>> /builds/juan.quintela/qemu/tests/qemu-iotests --build-dir >>> /builds/juan.quintela/qemu/build/tests/qemu-iotests ― ✀ ― stderr: --- /builds/juan.quintela/qemu/tests/qemu-iotests/tests/copy-before-write.out +++ /builds/juan.quintela/qemu/build/scratch/qcow2-file-copy-before-write/copy-before-write.out.bad @@ -1,5 +1,21 @@ - +...F +== +FAIL: test_timeout_break_snapshot (__main__.TestCbwError) +-- +Traceback (most recent call last): + File "/builds/juan.quintela/qemu/tests/qemu-iotests/tests/copy-before-write", line 210, in test_timeout_break_snapshot +self.assertEqual(log, """\ +AssertionError: 'wrot[195 chars]read 1048576/1048576 bytes at offset 0\n1 MiB,[46 chars]c)\n' != 'wrot[195 chars]read failed: Permission denied\n' + wrote 524288/524288 bytes at offset 0 + 512 KiB, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) + wrote 524288/524288 bytes at offset 524288 + 512 KiB, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) ++ read failed: Permission denied +- read 1048576/1048576 bytes at offset 0 +- 1 MiB, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec) + + -- Ran 4 tests -OK +FAILED (failures=1) (test program exited with status code 1) ―― I have no clue how I can make qtests to fail with my changes. Specially with a read permission. Any clue? Later, Juan. PD. Yeap, continuing the bisect.
Re: [PULL 00/30] Next patches
On 6/26/23 15:05, Juan Quintela wrote: The "full logs" are https://gitlab.com/qemu-project/qemu/-/jobs/4527202764/artifacts/download?file_type=trace Not useful. I was hoping that there is something like when one runs ./tests/qtest/migration-test I thought I saw some patch today that to save more artifacts. But the bottom line is that we don't emit enough stuff from any of our tests to debug them from logs -- we're too used to using other methods. And I don't understand what CFI is (and I don't rule out that posibility) or I can't understand how checking indirect functions call can make migration-test die without a single CFI error message? CFI (control flow inspection/validation/somesuch) adds checking along call paths, which may affect timing. This is almost certainly some sort of race condition. Do we have a way to run on that image: ./tests/qtest/migration-test in a loop until it fails, and at least see what test is failing? Not as is, no. You'd have to create a new CI job, and for that you'll need advice beyond myself. r~
Re: [PULL 00/30] Next patches
Richard Henderson wrote: > On 6/22/23 18:54, Juan Quintela wrote: >> The following changes since commit b455ce4c2f300c8ba47cba7232dd03261368a4cb: >>Merge tag 'q800-for-8.1-pull-request' >> ofhttps://github.com/vivier/qemu-m68k into staging (2023-06-22 >> 10:18:32 +0200) >> are available in the Git repository at: >>https://gitlab.com/juan.quintela/qemu.git tags/next-pull-request >> for you to fetch changes up to >> 23e4307eadc1497bd0a11ca91041768f15963b68: >>migration/rdma: Split qemu_fopen_rdma() into input/output >> functions (2023-06-22 18:11:58 +0200) >> >> Migration Pull request (20230621) take 2 >> In this pull request the only change is fixing 32 bits complitaion >> issue. >> Please apply. >> [take 1] >> - fix for multifd thread creation (fabiano) >> - dirtylimity (hyman) >>* migration-test will go on next PULL request, as it has failures. >> - Improve error description (tejus) >> - improve -incoming and set parameters before calling incoming (wei) >> - migration atomic counters reviewed patches (quintela) >> - migration-test refacttoring reviewed (quintela) > > New failure with check-cfi-x86_64: I am looking at the whole series. I can't see a single function that is new/change prototypes/etc that is changed on this series. So is this problem related to CFI? Or it is a migration problem that somehow only happens when one use CFI? Inquiring minds what to know. Any clue? Later, Juan. > > https://gitlab.com/qemu-project/qemu/-/jobs/4527202764#L188 > > /builds/qemu-project/qemu/build/pyvenv/bin/meson test --no-rebuild -t > 0 --num-processes 1 --print-errorlogs > 1/350 qemu:qtest+qtest-x86_64 / qtest-x86_64/qom-test > OK 6.55s 8 subtests passed > ▶ 2/350 ERROR:../tests/qtest/migration-test.c:320:check_guests_ram: > assertion failed: (bad == 0) ERROR > 2/350 qemu:qtest+qtest-x86_64 / qtest-x86_64/migration-test > ERROR 151.99s killed by signal 6 SIGABRT > G_TEST_DBUS_DAEMON=/builds/qemu-project/qemu/tests/dbus-vmstate-daemon.sh > MALLOC_PERTURB_=3 QTEST_QEMU_IMG=./qemu-img > QTEST_QEMU_STORAGE_DAEMON_BINARY=./storage-daemon/qemu-storage-daemon > QTEST_QEMU_BINARY=./qemu-system-x86_64 > /builds/qemu-project/qemu/build/tests/qtest/migration-test --tap >-k > ― ✀ ― > stderr: > qemu-system-x86_64: Unable to read from socket: Connection reset by peer > Memory content inconsistency at 4f65000 first_byte = 30 last_byte = 2f > current = 88 hit_edge = 1 > ** > ERROR:../tests/qtest/migration-test.c:320:check_guests_ram: assertion failed: > (bad == 0) > > (test program exited with status code -6) > ―― > > > r~
Re: [PULL 00/30] Next patches
Richard Henderson wrote: > On 6/26/23 00:01, Juan Quintela wrote: >> Richard Henderson wrote: >>> On 6/22/23 18:54, Juan Quintela wrote: The following changes since commit b455ce4c2f300c8ba47cba7232dd03261368a4cb: Merge tag 'q800-for-8.1-pull-request' ofhttps://github.com/vivier/qemu-m68k into staging (2023-06-22 10:18:32 +0200) are available in the Git repository at: https://gitlab.com/juan.quintela/qemu.git tags/next-pull-request for you to fetch changes up to 23e4307eadc1497bd0a11ca91041768f15963b68: migration/rdma: Split qemu_fopen_rdma() into input/output functions (2023-06-22 18:11:58 +0200) Migration Pull request (20230621) take 2 In this pull request the only change is fixing 32 bits complitaion issue. Please apply. [take 1] - fix for multifd thread creation (fabiano) - dirtylimity (hyman) * migration-test will go on next PULL request, as it has failures. - Improve error description (tejus) - improve -incoming and set parameters before calling incoming (wei) - migration atomic counters reviewed patches (quintela) - migration-test refacttoring reviewed (quintela) >>> >>> New failure with check-cfi-x86_64: >>> >>> https://gitlab.com/qemu-project/qemu/-/jobs/4527202764#L188 >> First of all, is there a way to get to the test log? In particular, >> I >> am interested in knowing at least what test has failed (yes, >> migration-test don't tell you much more). >> After a bit more wrestling, I have been able to get things compiling >> with this command: >> $ /mnt/code/qemu/full/configure --enable-cfi >> --target-list=x86_64-softmmu --enable-cfi-debug --cc=clang --cxx=clang++ >> --disable-docs --enable-safe-stack --disable-slirp >> It should basically be the one that check-cfi-x86_64 is using if I >> understand the build recipes correctly (that is a BIG IF). >> And it passes for me with flying colors. >> Here I have Fedora38, builder has F37. >> >>> /builds/qemu-project/qemu/build/pyvenv/bin/meson test --no-rebuild -t >>> 0 --num-processes 1 --print-errorlogs >>>1/350 qemu:qtest+qtest-x86_64 / qtest-x86_64/qom-test >>>OK 6.55s 8 subtests passed >>> ▶ 2/350 ERROR:../tests/qtest/migration-test.c:320:check_guests_ram: >>> assertion failed: (bad == 0) ERROR >>>2/350 qemu:qtest+qtest-x86_64 / qtest-x86_64/migration-test >>>ERROR 151.99s killed by signal 6 SIGABRT >> >>> >>> G_TEST_DBUS_DAEMON=/builds/qemu-project/qemu/tests/dbus-vmstate-daemon.sh >>> MALLOC_PERTURB_=3 QTEST_QEMU_IMG=./qemu-img >>> QTEST_QEMU_STORAGE_DAEMON_BINARY=./storage-daemon/qemu-storage-daemon >>> QTEST_QEMU_BINARY=./qemu-system-x86_64 >>> /builds/qemu-project/qemu/build/tests/qtest/migration-test --tap >>> -k >>> ― ✀ >>> ― >>> stderr: >>> qemu-system-x86_64: Unable to read from socket: Connection reset by peer >> This is the interesting bit, why is the conection closed. >> >>> Memory content inconsistency at 4f65000 first_byte = 30 last_byte = 2f >>> current = 88 hit_edge = 1 >>> ** >>> ERROR:../tests/qtest/migration-test.c:320:check_guests_ram: assertion >>> failed: (bad == 0) >>> >>> (test program exited with status code -6) >> This makes zero sense, except if we haven't migrated all the guest >> state, that it is what it has happened. >> Is there a place on the web interface to see the full logs? Or that >> is >> the only thing that the CI system stores? > > The "full logs" are > > https://gitlab.com/qemu-project/qemu/-/jobs/4527202764/artifacts/download?file_type=trace Not useful. I was hoping that there is something like when one runs ./tests/qtest/migration-test Anyways, to make things faster: - created /mnt/code/qemu/full/configure --enable-cfi --target-list=x86_64-softmmu --enable-cfi-debug --cc=clang --cxx=clang++ --disable-docs --enable-safe-stack --disable-slirp worked as a charm. - Your test run: qemu-system-x86_64: Unable to read from socket: Connection reset by peer one of the sides die, so anything else after that don't matter. And I don't understand what CFI is (and I don't rule out that posibility) or I can't understand how checking indirect functions call can make migration-test die without a single CFI error message? - I tried myself CI pipeline, some exact source: https://gitlab.com/juan.quintela/qemu/-/commit/23e4307eadc1497bd0a11ca91041768f15963b68/pipelines?ref=sent%2Fmigration-20230621b This is what fails: https://gitlab.com/juan.quintela/qemu/-/jobs/4527782025 16/395 ERROR:../tests/qtest/qos-test.c:191:subprocess_run_one_test: child process (/x86_64/pc/i440FX-pcihost/pci-bus-pc/pci-bus/virtio-net-pci/virtio-net/virtio-net-tests/vhost-user/reconnect/subprocess [4569]) failed unexpectedly ERROR 16/395 qemu:qtest+qtest-x86_64 / qt
Re: [PULL 00/30] Next patches
On 6/26/23 00:01, Juan Quintela wrote: Richard Henderson wrote: On 6/22/23 18:54, Juan Quintela wrote: The following changes since commit b455ce4c2f300c8ba47cba7232dd03261368a4cb: Merge tag 'q800-for-8.1-pull-request' ofhttps://github.com/vivier/qemu-m68k into staging (2023-06-22 10:18:32 +0200) are available in the Git repository at: https://gitlab.com/juan.quintela/qemu.git tags/next-pull-request for you to fetch changes up to 23e4307eadc1497bd0a11ca91041768f15963b68: migration/rdma: Split qemu_fopen_rdma() into input/output functions (2023-06-22 18:11:58 +0200) Migration Pull request (20230621) take 2 In this pull request the only change is fixing 32 bits complitaion issue. Please apply. [take 1] - fix for multifd thread creation (fabiano) - dirtylimity (hyman) * migration-test will go on next PULL request, as it has failures. - Improve error description (tejus) - improve -incoming and set parameters before calling incoming (wei) - migration atomic counters reviewed patches (quintela) - migration-test refacttoring reviewed (quintela) New failure with check-cfi-x86_64: https://gitlab.com/qemu-project/qemu/-/jobs/4527202764#L188 First of all, is there a way to get to the test log? In particular, I am interested in knowing at least what test has failed (yes, migration-test don't tell you much more). After a bit more wrestling, I have been able to get things compiling with this command: $ /mnt/code/qemu/full/configure --enable-cfi --target-list=x86_64-softmmu --enable-cfi-debug --cc=clang --cxx=clang++ --disable-docs --enable-safe-stack --disable-slirp It should basically be the one that check-cfi-x86_64 is using if I understand the build recipes correctly (that is a BIG IF). And it passes for me with flying colors. Here I have Fedora38, builder has F37. /builds/qemu-project/qemu/build/pyvenv/bin/meson test --no-rebuild -t 0 --num-processes 1 --print-errorlogs 1/350 qemu:qtest+qtest-x86_64 / qtest-x86_64/qom-test OK 6.55s 8 subtests passed ▶ 2/350 ERROR:../tests/qtest/migration-test.c:320:check_guests_ram: assertion failed: (bad == 0) ERROR 2/350 qemu:qtest+qtest-x86_64 / qtest-x86_64/migration-test ERROR 151.99s killed by signal 6 SIGABRT G_TEST_DBUS_DAEMON=/builds/qemu-project/qemu/tests/dbus-vmstate-daemon.sh MALLOC_PERTURB_=3 QTEST_QEMU_IMG=./qemu-img QTEST_QEMU_STORAGE_DAEMON_BINARY=./storage-daemon/qemu-storage-daemon QTEST_QEMU_BINARY=./qemu-system-x86_64 /builds/qemu-project/qemu/build/tests/qtest/migration-test --tap -k ― ✀ ― stderr: qemu-system-x86_64: Unable to read from socket: Connection reset by peer This is the interesting bit, why is the conection closed. Memory content inconsistency at 4f65000 first_byte = 30 last_byte = 2f current = 88 hit_edge = 1 ** ERROR:../tests/qtest/migration-test.c:320:check_guests_ram: assertion failed: (bad == 0) (test program exited with status code -6) This makes zero sense, except if we haven't migrated all the guest state, that it is what it has happened. Is there a place on the web interface to see the full logs? Or that is the only thing that the CI system stores? The "full logs" are https://gitlab.com/qemu-project/qemu/-/jobs/4527202764/artifacts/download?file_type=trace r~
Re: [PULL 00/30] Next patches
Richard Henderson wrote: > On 6/22/23 18:54, Juan Quintela wrote: >> The following changes since commit b455ce4c2f300c8ba47cba7232dd03261368a4cb: >>Merge tag 'q800-for-8.1-pull-request' >> ofhttps://github.com/vivier/qemu-m68k into staging (2023-06-22 >> 10:18:32 +0200) >> are available in the Git repository at: >>https://gitlab.com/juan.quintela/qemu.git tags/next-pull-request >> for you to fetch changes up to >> 23e4307eadc1497bd0a11ca91041768f15963b68: >>migration/rdma: Split qemu_fopen_rdma() into input/output >> functions (2023-06-22 18:11:58 +0200) >> >> Migration Pull request (20230621) take 2 >> In this pull request the only change is fixing 32 bits complitaion >> issue. >> Please apply. >> [take 1] >> - fix for multifd thread creation (fabiano) >> - dirtylimity (hyman) >>* migration-test will go on next PULL request, as it has failures. >> - Improve error description (tejus) >> - improve -incoming and set parameters before calling incoming (wei) >> - migration atomic counters reviewed patches (quintela) >> - migration-test refacttoring reviewed (quintela) > > New failure with check-cfi-x86_64: > > https://gitlab.com/qemu-project/qemu/-/jobs/4527202764#L188 First of all, is there a way to get to the test log? In particular, I am interested in knowing at least what test has failed (yes, migration-test don't tell you much more). After a bit more wrestling, I have been able to get things compiling with this command: $ /mnt/code/qemu/full/configure --enable-cfi --target-list=x86_64-softmmu --enable-cfi-debug --cc=clang --cxx=clang++ --disable-docs --enable-safe-stack --disable-slirp It should basically be the one that check-cfi-x86_64 is using if I understand the build recipes correctly (that is a BIG IF). And it passes for me with flying colors. Here I have Fedora38, builder has F37. > /builds/qemu-project/qemu/build/pyvenv/bin/meson test --no-rebuild -t > 0 --num-processes 1 --print-errorlogs > 1/350 qemu:qtest+qtest-x86_64 / qtest-x86_64/qom-test > OK 6.55s 8 subtests passed > ▶ 2/350 ERROR:../tests/qtest/migration-test.c:320:check_guests_ram: > assertion failed: (bad == 0) ERROR > 2/350 qemu:qtest+qtest-x86_64 / qtest-x86_64/migration-test > ERROR 151.99s killed by signal 6 SIGABRT > G_TEST_DBUS_DAEMON=/builds/qemu-project/qemu/tests/dbus-vmstate-daemon.sh > MALLOC_PERTURB_=3 QTEST_QEMU_IMG=./qemu-img > QTEST_QEMU_STORAGE_DAEMON_BINARY=./storage-daemon/qemu-storage-daemon > QTEST_QEMU_BINARY=./qemu-system-x86_64 > /builds/qemu-project/qemu/build/tests/qtest/migration-test --tap >-k > ― ✀ ― > stderr: > qemu-system-x86_64: Unable to read from socket: Connection reset by peer This is the interesting bit, why is the conection closed. > Memory content inconsistency at 4f65000 first_byte = 30 last_byte = 2f > current = 88 hit_edge = 1 > ** > ERROR:../tests/qtest/migration-test.c:320:check_guests_ram: assertion failed: > (bad == 0) > > (test program exited with status code -6) This makes zero sense, except if we haven't migrated all the guest state, that it is what it has happened. Is there a place on the web interface to see the full logs? Or that is the only thing that the CI system stores? Later, Juan.
Re: [PULL 00/30] Next patches
Richard Henderson wrote: > On 6/22/23 18:54, Juan Quintela wrote: >> The following changes since commit b455ce4c2f300c8ba47cba7232dd03261368a4cb: >>Merge tag 'q800-for-8.1-pull-request' >> ofhttps://github.com/vivier/qemu-m68k into staging (2023-06-22 >> 10:18:32 +0200) >> are available in the Git repository at: >>https://gitlab.com/juan.quintela/qemu.git tags/next-pull-request >> for you to fetch changes up to >> 23e4307eadc1497bd0a11ca91041768f15963b68: >>migration/rdma: Split qemu_fopen_rdma() into input/output >> functions (2023-06-22 18:11:58 +0200) >> >> Migration Pull request (20230621) take 2 >> In this pull request the only change is fixing 32 bits complitaion >> issue. >> Please apply. >> [take 1] >> - fix for multifd thread creation (fabiano) >> - dirtylimity (hyman) >>* migration-test will go on next PULL request, as it has failures. >> - Improve error description (tejus) >> - improve -incoming and set parameters before calling incoming (wei) >> - migration atomic counters reviewed patches (quintela) >> - migration-test refacttoring reviewed (quintela) I had the feeling when I wake up that today was going to be a great day. Confirmed. > New failure with check-cfi-x86_64: Aha. CFI. Something that I don't know what it is failing on me. /me googles. /me enables cfi+lto and compiles with clang. 50/491] Compiling C object subprojects/berkeley-testfloat-3/libtestfloat.a.p/source_test_az_f128_rx.c.o [51/491] Compiling C object subprojects/berkeley-testfloat-3/libtestfloat.a.p/source_test_az_f128.c.o [52/491] Compiling C object subprojects/berkeley-testfloat-3/libtestfloat.a.p/source_test_abz_f128.c.o [53/491] Compiling C object subprojects/berkeley-testfloat-3/libtestfloat.a.p/source_test_abcz_f128.c.o [54/491] Compiling C object subprojects/berkeley-testfloat-3/libtestfloat.a.p/source_test_ab_f128_z_bool.c.o [55/491] Linking target qemu-system-x86_64 FAILED: qemu-system-x86_64 clang++ -m64 -mcx16 @qemu-system-x86_64.rsp /usr/bin/ld: cannot find libchardev.fa: Too many open files /usr/bin/ld: cannot find libqmp.fa: Too many open files /usr/bin/ld: cannot find libpage-vary-common.a: Too many open files /usr/bin/ld: cannot find libqemuutil.a: Too many open files /usr/bin/ld: cannot find subprojects/libvhost-user/libvhost-user-glib.a: Too many open files /usr/bin/ld: cannot find subprojects/libvhost-user/libvhost-user.a: Too many open files /usr/bin/ld: cannot find tcg/libtcg_softmmu.fa: Too many open files /usr/bin/ld: cannot find libmigration.fa: Too many open files /usr/bin/ld: cannot find libhwcore.fa: Too many open files /usr/bin/ld: cannot find libqom.fa: Too many open files /usr/bin/ld: cannot find gdbstub/libgdb_softmmu.fa: Too many open files /usr/bin/ld: cannot find libio.fa: Too many open files /usr/bin/ld: cannot find libcrypto.fa: Too many open files /usr/bin/ld: cannot find libauthz.fa: Too many open files /usr/bin/ld: cannot find libblockdev.fa: Too many open files /usr/bin/ld: cannot find libblock.fa: Too many open files /usr/bin/ld: cannot find libchardev.fa: Too many open files /usr/bin/ld: cannot find libqmp.fa: Too many open files /usr/bin/ld: cannot find /usr/lib64/libpixman-1.so: Too many open files /usr/bin/ld: cannot find /usr/lib64/libepoxy.so: Too many open files /usr/bin/ld: cannot find /usr/lib64/libxenctrl.so: Too many open files /usr/bin/ld: cannot find /usr/lib64/libxenstore.so: Too many open files /usr/bin/ld: cannot find /usr/lib64/libxenforeignmemory.so: Too many open files /usr/bin/ld: cannot find /usr/lib64/libxengnttab.so: Too many open files /usr/bin/ld: cannot find /usr/lib64/libxenevtchn.so: Too many open files Confirmed, today is going to be a great day. No check-cfi target for me. /me investigates what is going on. Found this and retries. AR=llvm-ar CC=clang CXX=clang++ /mnt/code/qemu/full/configure --enable-cfi --target-list=x86_64-softmmu Gives the same error. After a while of desesperation trying to disable features, etc, etc Just doing a plain ulimit -n 4096 fixed the problem. Here we go. Later, Juan.
Re: [PULL 00/30] Next patches
On 6/22/23 18:54, Juan Quintela wrote: The following changes since commit b455ce4c2f300c8ba47cba7232dd03261368a4cb: Merge tag 'q800-for-8.1-pull-request' ofhttps://github.com/vivier/qemu-m68k into staging (2023-06-22 10:18:32 +0200) are available in the Git repository at: https://gitlab.com/juan.quintela/qemu.git tags/next-pull-request for you to fetch changes up to 23e4307eadc1497bd0a11ca91041768f15963b68: migration/rdma: Split qemu_fopen_rdma() into input/output functions (2023-06-22 18:11:58 +0200) Migration Pull request (20230621) take 2 In this pull request the only change is fixing 32 bits complitaion issue. Please apply. [take 1] - fix for multifd thread creation (fabiano) - dirtylimity (hyman) * migration-test will go on next PULL request, as it has failures. - Improve error description (tejus) - improve -incoming and set parameters before calling incoming (wei) - migration atomic counters reviewed patches (quintela) - migration-test refacttoring reviewed (quintela) New failure with check-cfi-x86_64: https://gitlab.com/qemu-project/qemu/-/jobs/4527202764#L188 /builds/qemu-project/qemu/build/pyvenv/bin/meson test --no-rebuild -t 0 --num-processes 1 --print-errorlogs 1/350 qemu:qtest+qtest-x86_64 / qtest-x86_64/qom-test OK 6.55s 8 subtests passed ▶ 2/350 ERROR:../tests/qtest/migration-test.c:320:check_guests_ram: assertion failed: (bad == 0) ERROR 2/350 qemu:qtest+qtest-x86_64 / qtest-x86_64/migration-test ERROR 151.99s killed by signal 6 SIGABRT >>> G_TEST_DBUS_DAEMON=/builds/qemu-project/qemu/tests/dbus-vmstate-daemon.sh MALLOC_PERTURB_=3 QTEST_QEMU_IMG=./qemu-img QTEST_QEMU_STORAGE_DAEMON_BINARY=./storage-daemon/qemu-storage-daemon QTEST_QEMU_BINARY=./qemu-system-x86_64 /builds/qemu-project/qemu/build/tests/qtest/migration-test --tap -k ― ✀ ― stderr: qemu-system-x86_64: Unable to read from socket: Connection reset by peer Memory content inconsistency at 4f65000 first_byte = 30 last_byte = 2f current = 88 hit_edge = 1 ** ERROR:../tests/qtest/migration-test.c:320:check_guests_ram: assertion failed: (bad == 0) (test program exited with status code -6) ―― r~
[PULL 00/30] Next patches
The following changes since commit b455ce4c2f300c8ba47cba7232dd03261368a4cb: Merge tag 'q800-for-8.1-pull-request' of https://github.com/vivier/qemu-m68k into staging (2023-06-22 10:18:32 +0200) are available in the Git repository at: https://gitlab.com/juan.quintela/qemu.git tags/next-pull-request for you to fetch changes up to 23e4307eadc1497bd0a11ca91041768f15963b68: migration/rdma: Split qemu_fopen_rdma() into input/output functions (2023-06-22 18:11:58 +0200) Migration Pull request (20230621) take 2 In this pull request the only change is fixing 32 bits complitaion issue. Please apply. [take 1] - fix for multifd thread creation (fabiano) - dirtylimity (hyman) * migration-test will go on next PULL request, as it has failures. - Improve error description (tejus) - improve -incoming and set parameters before calling incoming (wei) - migration atomic counters reviewed patches (quintela) - migration-test refacttoring reviewed (quintela) Fabiano Rosas (2): migration/multifd: Rename threadinfo.c functions migration/multifd: Protect accesses to migration_threads Hyman Huang(黄勇) (8): softmmu/dirtylimit: Add parameter check for hmp "set_vcpu_dirty_limit" qapi/migration: Introduce x-vcpu-dirty-limit-period parameter qapi/migration: Introduce vcpu-dirty-limit parameters migration: Introduce dirty-limit capability migration: Refactor auto-converge capability logic migration: Put the detection logic before auto-converge checking migration: Implement dirty-limit convergence algo migration: Extend query-migrate to provide dirty page limit info Juan Quintela (16): migration-test: Be consistent for ppc migration-test: Make machine_opts regular with other options migration-test: Create arch_opts migration-test: machine_opts is really arch specific migration-test: Create kvm_opts migration-test: bootpath is the same for all tests and for all archs migration-test: Add bootfile_create/delete() functions migration-test: dirtylimit checks for x86_64 arch before migration-test: simplify shmem_opts handling qemu-file: Rename qemu_file_transferred_ fast -> noflush migration: Change qemu_file_transferred to noflush migration: Use qemu_file_transferred_noflush() for block migration. qemu_file: Make qemu_file_is_writable() static qemu-file: Simplify qemu_file_shutdown() qemu-file: Make qemu_file_get_error_obj() static migration/rdma: Split qemu_fopen_rdma() into input/output functions Tejus GK (2): migration: Update error description whenever migration fails migration: Refactor repeated call of yank_unregister_instance Wei Wang (2): migration: enforce multifd and postcopy preempt to be set before incoming qtest/migration-tests.c: use "-incoming defer" for postcopy tests qapi/migration.json| 74 +--- include/sysemu/dirtylimit.h| 2 + migration/options.h| 1 + migration/qemu-file.h | 14 ++-- migration/threadinfo.h | 7 +- migration/block.c | 4 +- migration/migration-hmp-cmds.c | 26 +++ migration/migration.c | 40 +++ migration/multifd.c| 4 +- migration/options.c| 87 +++ migration/qemu-file.c | 24 ++- migration/ram.c| 59 +--- migration/rdma.c | 39 +-- migration/savevm.c | 6 +- migration/threadinfo.c | 19 - migration/vmstate.c| 4 +- softmmu/dirtylimit.c | 97 +++--- tests/qtest/migration-test.c | 123 ++--- migration/trace-events | 1 + 19 files changed, 472 insertions(+), 159 deletions(-) base-commit: 5f9dd6a8ce3961db4ce47411ed2097ad88bdf5fc prerequisite-patch-id: 99c8bffa9428838925e330eb2881bab476122579 prerequisite-patch-id: 77ba427fd916aeb395e95aa0e7190f84e98e96ab prerequisite-patch-id: 9983d46fa438d7075a37be883529e37ae41e4228 prerequisite-patch-id: 207f7529924b12dcb57f6557d6db6f79ceb2d682 prerequisite-patch-id: 5ad1799a13845dbf893a28a202b51a6b50d95d90 prerequisite-patch-id: c51959aacd6d65ee84fcd4f1b2aed3dd6f6af879 prerequisite-patch-id: da9dbb6799b2da002c0896574334920097e4c50a prerequisite-patch-id: c1110ffafbaf5465fb277a20db809372291f7846 prerequisite-patch-id: 8307c92bedd07446214b35b40206eb6793a7384d prerequisite-patch-id: 0a6106cd4a508d5e700a7ff6c25edfdd03c8ca3d prerequisite-patch-id: 83205051de22382e75bf4acdf69e59315801fa0d prerequisite-patch-id: 8c9b3cba89d555c071a410041e6da41806106a7e prerequisite-patch-id: 0ff62a33b9a242226ccc1f5424a516de803c9fe5 prerequisite-patch-id: 25b8ae1ebe09ace14457c454cfcb23077c37346c prerequisite-patch-id: 466ea91d5be41fe345dacd4d17bbbe5ce13118c2 prerequisite-patch-id: d1045858f9729ac62eccf2e83ebf95cfebae2cb5 prerequisite-patch-id: 0276ec0207
Re: [PULL 00/30] Next patches
Richard Henderson wrote: > On 6/22/23 04:12, Juan Quintela wrote: >> The following changes since commit 67fe6ae41da64368bc4936b196fee2bf61f8c720: >>Merge tag 'pull-tricore-20230621-1' >> ofhttps://github.com/bkoppelmann/qemu into staging (2023-06-21 >> 20:08:48 +0200) >> are available in the Git repository at: >>https://gitlab.com/juan.quintela/qemu.git tags/next-pull-request >> for you to fetch changes up to >> c53dc569d0a0fb76eaa83f353253a897914948f9: >>migration/rdma: Split qemu_fopen_rdma() into input/output >> functions (2023-06-22 02:45:30 +0200) >> >> Migration Pull request (20230621) >> In this pull request: >> - fix for multifd thread creation (fabiano) >> - dirtylimity (hyman) >>* migration-test will go on next PULL request, as it has failures. >> - Improve error description (tejus) >> - improve -incoming and set parameters before calling incoming (wei) >> - migration atomic counters reviewed patches (quintela) >> - migration-test refacttoring reviewed (quintela) >> Please apply. > > You really need to test at least one 32-bit host regularly. > It should be trivial for you to do an i686 build somewhere. > > https://gitlab.com/qemu-project/qemu/-/jobs/4518975360#L4817 > https://gitlab.com/qemu-project/qemu/-/jobs/4518975263#L3486 > https://gitlab.com/qemu-project/qemu/-/jobs/4518975261#L3145 > https://gitlab.com/qemu-project/qemu/-/jobs/4518975298#L3372 > https://gitlab.com/qemu-project/qemu/-/jobs/4518975301#L3221 > > ../softmmu/dirtylimit.c:558:58: error: format specifies type 'long' > but the argument has type 'int64_t' (aka 'long long') > [-Werror,-Wformat] > error_setg(&err, "invalid dirty page limit %ld", dirty_rate); >~~~ ^~ >%lld Grrr, sorry. Will not happen again. Later, Juan. > > > r~
Re: [PULL 00/30] Next patches
On 6/22/23 04:12, Juan Quintela wrote: The following changes since commit 67fe6ae41da64368bc4936b196fee2bf61f8c720: Merge tag 'pull-tricore-20230621-1' ofhttps://github.com/bkoppelmann/qemu into staging (2023-06-21 20:08:48 +0200) are available in the Git repository at: https://gitlab.com/juan.quintela/qemu.git tags/next-pull-request for you to fetch changes up to c53dc569d0a0fb76eaa83f353253a897914948f9: migration/rdma: Split qemu_fopen_rdma() into input/output functions (2023-06-22 02:45:30 +0200) Migration Pull request (20230621) In this pull request: - fix for multifd thread creation (fabiano) - dirtylimity (hyman) * migration-test will go on next PULL request, as it has failures. - Improve error description (tejus) - improve -incoming and set parameters before calling incoming (wei) - migration atomic counters reviewed patches (quintela) - migration-test refacttoring reviewed (quintela) Please apply. You really need to test at least one 32-bit host regularly. It should be trivial for you to do an i686 build somewhere. https://gitlab.com/qemu-project/qemu/-/jobs/4518975360#L4817 https://gitlab.com/qemu-project/qemu/-/jobs/4518975263#L3486 https://gitlab.com/qemu-project/qemu/-/jobs/4518975261#L3145 https://gitlab.com/qemu-project/qemu/-/jobs/4518975298#L3372 https://gitlab.com/qemu-project/qemu/-/jobs/4518975301#L3221 ../softmmu/dirtylimit.c:558:58: error: format specifies type 'long' but the argument has type 'int64_t' (aka 'long long') [-Werror,-Wformat] error_setg(&err, "invalid dirty page limit %ld", dirty_rate); ~~~ ^~ %lld r~
[PULL 00/30] Next patches
The following changes since commit 67fe6ae41da64368bc4936b196fee2bf61f8c720: Merge tag 'pull-tricore-20230621-1' of https://github.com/bkoppelmann/qemu into staging (2023-06-21 20:08:48 +0200) are available in the Git repository at: https://gitlab.com/juan.quintela/qemu.git tags/next-pull-request for you to fetch changes up to c53dc569d0a0fb76eaa83f353253a897914948f9: migration/rdma: Split qemu_fopen_rdma() into input/output functions (2023-06-22 02:45:30 +0200) Migration Pull request (20230621) In this pull request: - fix for multifd thread creation (fabiano) - dirtylimity (hyman) * migration-test will go on next PULL request, as it has failures. - Improve error description (tejus) - improve -incoming and set parameters before calling incoming (wei) - migration atomic counters reviewed patches (quintela) - migration-test refacttoring reviewed (quintela) Please apply. Fabiano Rosas (2): migration/multifd: Rename threadinfo.c functions migration/multifd: Protect accesses to migration_threads Hyman Huang(黄勇) (8): softmmu/dirtylimit: Add parameter check for hmp "set_vcpu_dirty_limit" qapi/migration: Introduce x-vcpu-dirty-limit-period parameter qapi/migration: Introduce vcpu-dirty-limit parameters migration: Introduce dirty-limit capability migration: Refactor auto-converge capability logic migration: Put the detection logic before auto-converge checking migration: Implement dirty-limit convergence algo migration: Extend query-migrate to provide dirty page limit info Juan Quintela (16): migration-test: Be consistent for ppc migration-test: Make machine_opts regular with other options migration-test: Create arch_opts migration-test: machine_opts is really arch specific migration-test: Create kvm_opts migration-test: bootpath is the same for all tests and for all archs migration-test: Add bootfile_create/delete() functions migration-test: dirtylimit checks for x86_64 arch before migration-test: simplify shmem_opts handling qemu-file: Rename qemu_file_transferred_ fast -> noflush migration: Change qemu_file_transferred to noflush migration: Use qemu_file_transferred_noflush() for block migration. qemu_file: Make qemu_file_is_writable() static qemu-file: Simplify qemu_file_shutdown() qemu-file: Make qemu_file_get_error_obj() static migration/rdma: Split qemu_fopen_rdma() into input/output functions Tejus GK (2): migration: Update error description whenever migration fails migration: Refactor repeated call of yank_unregister_instance Wei Wang (2): migration: enforce multifd and postcopy preempt to be set before incoming qtest/migration-tests.c: use "-incoming defer" for postcopy tests qapi/migration.json| 74 +--- include/sysemu/dirtylimit.h| 2 + migration/options.h| 1 + migration/qemu-file.h | 14 ++-- migration/threadinfo.h | 7 +- migration/block.c | 4 +- migration/migration-hmp-cmds.c | 26 +++ migration/migration.c | 40 +++ migration/multifd.c| 4 +- migration/options.c| 87 +++ migration/qemu-file.c | 24 ++- migration/ram.c| 59 +--- migration/rdma.c | 39 +-- migration/savevm.c | 6 +- migration/threadinfo.c | 19 - migration/vmstate.c| 4 +- softmmu/dirtylimit.c | 97 +++--- tests/qtest/migration-test.c | 123 ++--- migration/trace-events | 1 + 19 files changed, 472 insertions(+), 159 deletions(-) base-commit: 5f9dd6a8ce3961db4ce47411ed2097ad88bdf5fc prerequisite-patch-id: 99c8bffa9428838925e330eb2881bab476122579 prerequisite-patch-id: 77ba427fd916aeb395e95aa0e7190f84e98e96ab prerequisite-patch-id: 9983d46fa438d7075a37be883529e37ae41e4228 prerequisite-patch-id: 207f7529924b12dcb57f6557d6db6f79ceb2d682 prerequisite-patch-id: 5ad1799a13845dbf893a28a202b51a6b50d95d90 prerequisite-patch-id: c51959aacd6d65ee84fcd4f1b2aed3dd6f6af879 prerequisite-patch-id: da9dbb6799b2da002c0896574334920097e4c50a prerequisite-patch-id: c1110ffafbaf5465fb277a20db809372291f7846 prerequisite-patch-id: 8307c92bedd07446214b35b40206eb6793a7384d prerequisite-patch-id: 0a6106cd4a508d5e700a7ff6c25edfdd03c8ca3d prerequisite-patch-id: 83205051de22382e75bf4acdf69e59315801fa0d prerequisite-patch-id: 8c9b3cba89d555c071a410041e6da41806106a7e prerequisite-patch-id: 0ff62a33b9a242226ccc1f5424a516de803c9fe5 prerequisite-patch-id: 25b8ae1ebe09ace14457c454cfcb23077c37346c prerequisite-patch-id: 466ea91d5be41fe345dacd4d17bbbe5ce13118c2 prerequisite-patch-id: d1045858f9729ac62eccf2e83ebf95cfebae2cb5 prerequisite-patch-id: 0276ec02073bda5426de39e2f2e81eef080b4f54 prerequisite-patch-id: 7afb4450a163cc1a
RE: [PULL 00/30] Next patches
Hi, All, Very appreciated for your time on reviewing our patch. The second CI failure caused by our patch has been addressed. One simple way is moving "#endif" in qemu/tests/bench/xbzrle-bench.c from line 46 to line 450. We have submitted patch v7 to update this modification. Thanks for your time again. Best Regards, Ling -Original Message- From: Stefan Hajnoczi Sent: Wednesday, November 16, 2022 2:58 AM To: Juan Quintela ; Xu, Ling1 ; Zhao, Zhou ; Jin, Jun I Cc: qemu-de...@nongnu.org; Michael Tokarev ; Marc-André Lureau ; David Hildenbrand ; Laurent Vivier ; Paolo Bonzini ; Daniel P. Berrangé ; Peter Xu ; Stefan Hajnoczi ; Dr. David Alan Gilbert ; Thomas Huth ; qemu-block@nongnu.org; qemu-triv...@nongnu.org; Philippe Mathieu-Daudé ; Fam Zheng Subject: Re: [PULL 00/30] Next patches On Tue, 15 Nov 2022 at 10:40, Juan Quintela wrote: > > The following changes since commit 98f10f0e2613ba1ac2ad3f57a5174014f6dcb03d: > > Merge tag 'pull-target-arm-20221114' of > https://git.linaro.org/people/pmaydell/qemu-arm into staging > (2022-11-14 13:31:17 -0500) > > are available in the Git repository at: > > https://gitlab.com/juan.quintela/qemu.git tags/next-pull-request > > for you to fetch changes up to d896a7a40db13fc2d05828c94ddda2747530089c: > > migration: Block migration comment or code is wrong (2022-11-15 > 10:31:06 +0100) > > > Migration PULL request (take 2) > > Hi > > This time properly signed. > > [take 1] > It includes: > - Leonardo fix for zero_copy flush > - Fiona fix for return value of readv/writev > - Peter Xu cleanups > - Peter Xu preempt patches > - Patches ready from zero page (me) > - AVX2 support (ling) > - fix for slow networking and reordering of first packets (manish) > > Please, apply. > > > > Fiona Ebner (1): > migration/channel-block: fix return value for > qio_channel_block_{readv,writev} > > Juan Quintela (5): > multifd: Create page_size fields into both MultiFD{Recv,Send}Params > multifd: Create page_count fields into both MultiFD{Recv,Send}Params > migration: Export ram_transferred_ram() > migration: Export ram_release_page() > migration: Block migration comment or code is wrong > > Leonardo Bras (1): > migration/multifd/zero-copy: Create helper function for flushing > > Peter Xu (20): > migration: Fix possible infinite loop of ram save process > migration: Fix race on qemu_file_shutdown() > migration: Disallow postcopy preempt to be used with compress > migration: Use non-atomic ops for clear log bitmap > migration: Disable multifd explicitly with compression > migration: Take bitmap mutex when completing ram migration > migration: Add postcopy_preempt_active() > migration: Cleanup xbzrle zero page cache update logic > migration: Trivial cleanup save_page_header() on same block check > migration: Remove RAMState.f references in compression code > migration: Yield bitmap_mutex properly when sending/sleeping > migration: Use atomic ops properly for page accountings > migration: Teach PSS about host page > migration: Introduce pss_channel > migration: Add pss_init() > migration: Make PageSearchStatus part of RAMState > migration: Move last_sent_block into PageSearchStatus > migration: Send requested page directly in rp-return thread > migration: Remove old preempt code around state maintainance > migration: Drop rs->f > > ling xu (2): > Update AVX512 support for xbzrle_encode_buffer > Unit test code and benchmark code This commit causes the following CI failure: cc -m64 -mcx16 -Ilibauthz.fa.p -I. -I.. -Iqapi -Itrace -Iui/shader -I/usr/include/glib-2.0 -I/usr/lib/x86_64-linux-gnu/glib-2.0/include -fdiagnostics-color=auto -Wall -Winvalid-pch -Werror -std=gnu11 -O2 -g -isystem /builds/qemu-project/qemu/linux-headers -isystem linux-headers -iquote . -iquote /builds/qemu-project/qemu -iquote /builds/qemu-project/qemu/include -iquote /builds/qemu-project/qemu/tcg/i386 -pthread -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 -D_GNU_SOURCE -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE -Wstrict-prototypes -Wredundant-decls -Wundef -Wwrite-strings -Wmissing-prototypes -fno-strict-aliasing -fno-common -fwrapv -Wold-style-declaration -Wold-style-definition -Wtype-limits -Wformat-security -Wformat-y2k -Winit-self -Wignored-qualifiers -Wempty-body -Wnested-externs -Wendif-labels -Wexpansion-to-defined -Wimplicit-fallthrough=2 -Wno-missing-include-dirs -Wno-shift-negative-value -Wno-psabi -fstack-protector-strong -fPIE -MD -MQ libauthz.fa.p/authz_simple.c.o -MF libauthz.fa.p/authz_simple.c.o.d -o libauthz.fa.p
Re: [PULL 00/30] Next patches
Please only include bug fixes for 7.2 in pull requests during QEMU hard freeze. The AVX2 support has issues (see my other email) and anything else that isn't a bug fix should be dropped too. Stefan
Re: [PULL 00/30] Next patches
On Tue, 15 Nov 2022 at 10:40, Juan Quintela wrote: > > The following changes since commit 98f10f0e2613ba1ac2ad3f57a5174014f6dcb03d: > > Merge tag 'pull-target-arm-20221114' of > https://git.linaro.org/people/pmaydell/qemu-arm into staging (2022-11-14 > 13:31:17 -0500) > > are available in the Git repository at: > > https://gitlab.com/juan.quintela/qemu.git tags/next-pull-request > > for you to fetch changes up to d896a7a40db13fc2d05828c94ddda2747530089c: > > migration: Block migration comment or code is wrong (2022-11-15 10:31:06 > +0100) > > > Migration PULL request (take 2) > > Hi > > This time properly signed. > > [take 1] > It includes: > - Leonardo fix for zero_copy flush > - Fiona fix for return value of readv/writev > - Peter Xu cleanups > - Peter Xu preempt patches > - Patches ready from zero page (me) > - AVX2 support (ling) > - fix for slow networking and reordering of first packets (manish) > > Please, apply. > > > > Fiona Ebner (1): > migration/channel-block: fix return value for > qio_channel_block_{readv,writev} > > Juan Quintela (5): > multifd: Create page_size fields into both MultiFD{Recv,Send}Params > multifd: Create page_count fields into both MultiFD{Recv,Send}Params > migration: Export ram_transferred_ram() > migration: Export ram_release_page() > migration: Block migration comment or code is wrong > > Leonardo Bras (1): > migration/multifd/zero-copy: Create helper function for flushing > > Peter Xu (20): > migration: Fix possible infinite loop of ram save process > migration: Fix race on qemu_file_shutdown() > migration: Disallow postcopy preempt to be used with compress > migration: Use non-atomic ops for clear log bitmap > migration: Disable multifd explicitly with compression > migration: Take bitmap mutex when completing ram migration > migration: Add postcopy_preempt_active() > migration: Cleanup xbzrle zero page cache update logic > migration: Trivial cleanup save_page_header() on same block check > migration: Remove RAMState.f references in compression code > migration: Yield bitmap_mutex properly when sending/sleeping > migration: Use atomic ops properly for page accountings > migration: Teach PSS about host page > migration: Introduce pss_channel > migration: Add pss_init() > migration: Make PageSearchStatus part of RAMState > migration: Move last_sent_block into PageSearchStatus > migration: Send requested page directly in rp-return thread > migration: Remove old preempt code around state maintainance > migration: Drop rs->f > > ling xu (2): > Update AVX512 support for xbzrle_encode_buffer > Unit test code and benchmark code This commit causes the following CI failure: cc -m64 -mcx16 -Ilibauthz.fa.p -I. -I.. -Iqapi -Itrace -Iui/shader -I/usr/include/glib-2.0 -I/usr/lib/x86_64-linux-gnu/glib-2.0/include -fdiagnostics-color=auto -Wall -Winvalid-pch -Werror -std=gnu11 -O2 -g -isystem /builds/qemu-project/qemu/linux-headers -isystem linux-headers -iquote . -iquote /builds/qemu-project/qemu -iquote /builds/qemu-project/qemu/include -iquote /builds/qemu-project/qemu/tcg/i386 -pthread -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 -D_GNU_SOURCE -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE -Wstrict-prototypes -Wredundant-decls -Wundef -Wwrite-strings -Wmissing-prototypes -fno-strict-aliasing -fno-common -fwrapv -Wold-style-declaration -Wold-style-definition -Wtype-limits -Wformat-security -Wformat-y2k -Winit-self -Wignored-qualifiers -Wempty-body -Wnested-externs -Wendif-labels -Wexpansion-to-defined -Wimplicit-fallthrough=2 -Wno-missing-include-dirs -Wno-shift-negative-value -Wno-psabi -fstack-protector-strong -fPIE -MD -MQ libauthz.fa.p/authz_simple.c.o -MF libauthz.fa.p/authz_simple.c.o.d -o libauthz.fa.p/authz_simple.c.o -c ../authz/simple.c In file included from ../authz/simple.c:23: ../authz/trace.h:1:10: fatal error: trace/trace-authz.h: No such file or directory 1 | #include "trace/trace-authz.h" | ^ https://gitlab.com/qemu-project/qemu/-/jobs/3326576115 I think the issue is that the test links against objects that aren't present when qemu-user only build is performed. That's my first guess, I might be wrong but it is definitely this commit that causes the failure (I bisected it). There is a second CI failure here: clang -m64 -mcx16 -Itests/bench/xbzrle-bench.p -Itests/bench -I../tests/bench -I. -Iqapi -Itrace -Iui -Iui/shader -I/usr/include/glib-2.0 -I/usr/lib64/glib-2.0/include -I/usr/include/sysprof-4 -flto -fcolor-diagnostics -Wall -Winvalid-pch -Werror -std=gnu11 -O2 -g -isystem /builds/qemu-project/qemu/linux-headers -isystem linux-headers -iquote . -iquote /builds/qemu-project/qemu -iquote /builds/qemu-project/qemu/include -iquote /builds/qemu-project/qemu/tcg/i386 -pthread -D_GNU_SOURCE -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE -Wstrict-prototypes -Wred
Re: [PULL 00/30] Next patches
Please don't merge this PULL request, It contains changes to the "io" subsystem in patch 3 that I have not reviewed nor acked yet, and which should be been split as a separate patch from the migration changes too. With regards, Daniel On Tue, Nov 15, 2022 at 04:34:44PM +0100, Juan Quintela wrote: > The following changes since commit 98f10f0e2613ba1ac2ad3f57a5174014f6dcb03d: > > Merge tag 'pull-target-arm-20221114' of > https://git.linaro.org/people/pmaydell/qemu-arm into staging (2022-11-14 > 13:31:17 -0500) > > are available in the Git repository at: > > https://gitlab.com/juan.quintela/qemu.git tags/next-pull-request > > for you to fetch changes up to d896a7a40db13fc2d05828c94ddda2747530089c: > > migration: Block migration comment or code is wrong (2022-11-15 10:31:06 > +0100) > > > Migration PULL request (take 2) > > Hi > > This time properly signed. > > [take 1] > It includes: > - Leonardo fix for zero_copy flush > - Fiona fix for return value of readv/writev > - Peter Xu cleanups > - Peter Xu preempt patches > - Patches ready from zero page (me) > - AVX2 support (ling) > - fix for slow networking and reordering of first packets (manish) > > Please, apply. > > > > Fiona Ebner (1): > migration/channel-block: fix return value for > qio_channel_block_{readv,writev} > > Juan Quintela (5): > multifd: Create page_size fields into both MultiFD{Recv,Send}Params > multifd: Create page_count fields into both MultiFD{Recv,Send}Params > migration: Export ram_transferred_ram() > migration: Export ram_release_page() > migration: Block migration comment or code is wrong > > Leonardo Bras (1): > migration/multifd/zero-copy: Create helper function for flushing > > Peter Xu (20): > migration: Fix possible infinite loop of ram save process > migration: Fix race on qemu_file_shutdown() > migration: Disallow postcopy preempt to be used with compress > migration: Use non-atomic ops for clear log bitmap > migration: Disable multifd explicitly with compression > migration: Take bitmap mutex when completing ram migration > migration: Add postcopy_preempt_active() > migration: Cleanup xbzrle zero page cache update logic > migration: Trivial cleanup save_page_header() on same block check > migration: Remove RAMState.f references in compression code > migration: Yield bitmap_mutex properly when sending/sleeping > migration: Use atomic ops properly for page accountings > migration: Teach PSS about host page > migration: Introduce pss_channel > migration: Add pss_init() > migration: Make PageSearchStatus part of RAMState > migration: Move last_sent_block into PageSearchStatus > migration: Send requested page directly in rp-return thread > migration: Remove old preempt code around state maintainance > migration: Drop rs->f > > ling xu (2): > Update AVX512 support for xbzrle_encode_buffer > Unit test code and benchmark code > > manish.mishra (1): > migration: check magic value for deciding the mapping of channels > > meson.build | 16 + > include/exec/ram_addr.h | 11 +- > include/exec/ramblock.h | 3 + > include/io/channel.h | 25 ++ > include/qemu/bitmap.h | 1 + > migration/migration.h | 7 - > migration/multifd.h | 10 +- > migration/postcopy-ram.h | 2 +- > migration/ram.h | 23 + > migration/xbzrle.h| 4 + > io/channel-socket.c | 27 ++ > io/channel.c | 39 ++ > migration/block.c | 4 +- > migration/channel-block.c | 6 +- > migration/migration.c | 109 +++-- > migration/multifd-zlib.c | 14 +- > migration/multifd-zstd.c | 12 +- > migration/multifd.c | 69 +-- > migration/postcopy-ram.c | 5 +- > migration/qemu-file.c | 27 +- > migration/ram.c | 794 +- > migration/xbzrle.c| 124 ++ > tests/bench/xbzrle-bench.c| 465 > tests/unit/test-xbzrle.c | 39 +- > util/bitmap.c | 45 ++ > meson_options.txt | 2 + > scripts/meson-buildoptions.sh | 14 +- > tests/bench/meson.build | 4 + > 28 files changed, 1379 insertions(+), 522 deletions(-) > create mode 100644 tests/bench/xbzrle-bench.c > > -- > 2.38.1 > With regards, Daniel -- |: https://berrange.com -o-https://www.flickr.com/photos/dberrange :| |: https://libvirt.org -o-https://fstop138.berrange.com :| |: https://entangle-photo.org-o-https://www.instagram.com/dberrange :|
[PULL 00/30] Next patches
The following changes since commit 98f10f0e2613ba1ac2ad3f57a5174014f6dcb03d: Merge tag 'pull-target-arm-20221114' of https://git.linaro.org/people/pmaydell/qemu-arm into staging (2022-11-14 13:31:17 -0500) are available in the Git repository at: https://gitlab.com/juan.quintela/qemu.git tags/next-pull-request for you to fetch changes up to d896a7a40db13fc2d05828c94ddda2747530089c: migration: Block migration comment or code is wrong (2022-11-15 10:31:06 +0100) Migration PULL request (take 2) Hi This time properly signed. [take 1] It includes: - Leonardo fix for zero_copy flush - Fiona fix for return value of readv/writev - Peter Xu cleanups - Peter Xu preempt patches - Patches ready from zero page (me) - AVX2 support (ling) - fix for slow networking and reordering of first packets (manish) Please, apply. Fiona Ebner (1): migration/channel-block: fix return value for qio_channel_block_{readv,writev} Juan Quintela (5): multifd: Create page_size fields into both MultiFD{Recv,Send}Params multifd: Create page_count fields into both MultiFD{Recv,Send}Params migration: Export ram_transferred_ram() migration: Export ram_release_page() migration: Block migration comment or code is wrong Leonardo Bras (1): migration/multifd/zero-copy: Create helper function for flushing Peter Xu (20): migration: Fix possible infinite loop of ram save process migration: Fix race on qemu_file_shutdown() migration: Disallow postcopy preempt to be used with compress migration: Use non-atomic ops for clear log bitmap migration: Disable multifd explicitly with compression migration: Take bitmap mutex when completing ram migration migration: Add postcopy_preempt_active() migration: Cleanup xbzrle zero page cache update logic migration: Trivial cleanup save_page_header() on same block check migration: Remove RAMState.f references in compression code migration: Yield bitmap_mutex properly when sending/sleeping migration: Use atomic ops properly for page accountings migration: Teach PSS about host page migration: Introduce pss_channel migration: Add pss_init() migration: Make PageSearchStatus part of RAMState migration: Move last_sent_block into PageSearchStatus migration: Send requested page directly in rp-return thread migration: Remove old preempt code around state maintainance migration: Drop rs->f ling xu (2): Update AVX512 support for xbzrle_encode_buffer Unit test code and benchmark code manish.mishra (1): migration: check magic value for deciding the mapping of channels meson.build | 16 + include/exec/ram_addr.h | 11 +- include/exec/ramblock.h | 3 + include/io/channel.h | 25 ++ include/qemu/bitmap.h | 1 + migration/migration.h | 7 - migration/multifd.h | 10 +- migration/postcopy-ram.h | 2 +- migration/ram.h | 23 + migration/xbzrle.h| 4 + io/channel-socket.c | 27 ++ io/channel.c | 39 ++ migration/block.c | 4 +- migration/channel-block.c | 6 +- migration/migration.c | 109 +++-- migration/multifd-zlib.c | 14 +- migration/multifd-zstd.c | 12 +- migration/multifd.c | 69 +-- migration/postcopy-ram.c | 5 +- migration/qemu-file.c | 27 +- migration/ram.c | 794 +- migration/xbzrle.c| 124 ++ tests/bench/xbzrle-bench.c| 465 tests/unit/test-xbzrle.c | 39 +- util/bitmap.c | 45 ++ meson_options.txt | 2 + scripts/meson-buildoptions.sh | 14 +- tests/bench/meson.build | 4 + 28 files changed, 1379 insertions(+), 522 deletions(-) create mode 100644 tests/bench/xbzrle-bench.c -- 2.38.1