[Bug 1867786] Re: Qemu PPC64 freezes with multi-core CPU
Hi Laurent, confirm that after changing the network adapter to the e1000e it worked flawlessly for hours with 4 cores on Macbook Pro. Thanks! -- You received this bug notification because you are a member of qemu- devel-ml, which is subscribed to QEMU. https://bugs.launchpad.net/bugs/1867786 Title: Qemu PPC64 freezes with multi-core CPU Status in QEMU: New Bug description: I installed Debian 10 on a Qemu PPC64 VM running with the following flags: qemu-system-ppc64 \ -nographic -nodefaults -monitor pty -serial stdio \ -M pseries -cpu POWER9 -smp cores=4,threads=1 -m 4G \ -drive file=debian-ppc64el-qemu.qcow2,format=qcow2,if=virtio \ -netdev user,id=network01,$ports -device rtl8139,netdev=network01 \ Within a couple minutes on any operation (could be a Go application or simply changing the hostname with hostnamectl, the VM freezes and prints this on the console: ``` root@debian:~# [ 950.428255] rcu: INFO: rcu_sched self-detected stall on CPU [ 950.428453] rcu: 3-: (5318 ticks this GP) idle=8e2/1/0x4004 softirq=5957/5960 fqs=2544 [ 976.244481] watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [zsh:462] Message from syslogd@debian at Mar 17 11:35:24 ... kernel:[ 976.244481] watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [zsh:462] [ 980.110018] rcu: INFO: rcu_sched detected expedited stalls on CPUs/tasks: { 3-... } 5276 jiffies s: 93 root: 0x8/. [ 980.77] rcu: blocking rcu_node structures: [ 1013.442268] rcu: INFO: rcu_sched self-detected stall on CPU [ 1013.442365] rcu: 3-: (21071 ticks this GP) idle=8e2/1/0x4004 softirq=5957/5960 fqs=9342 ``` If I change to 1 core on the command line, I haven't seen these freezes. To manage notifications about this bug go to: https://bugs.launchpad.net/qemu/+bug/1867786/+subscriptions
[Bug 1867786] Re: Qemu PPC64 freezes with multi-core CPU
I just built from latest master and got the kernel trace below. ❯ qemu-system-ppc64 --version QEMU emulator version 4.2.90 (v4.2.0-2811-g83019e81d1-dirty) Copyright (c) 2003-2020 Fabrice Bellard and the QEMU Project developers qemu-system-ppc64 \ -nographic -nodefaults -monitor pty -serial stdio \ -M pseries -cpu POWER9 -smp cores=4,threads=1 -m 4G \ -drive file=debian-ppc64el-qemu.qcow2,format=qcow2,if=virtio \ -netdev user,id=network01,hostfwd=tcp::$LocalSSHPort-:22 -device rtl8139,netdev=network01 \ [ 376.219450] watchdog: BUG: soft lockup - CPU#3 stuck for 22s! [swapper/3:0] [ 376.226712] Modules linked in: ctr(E) vmx_crypto(E) gf128mul(E) sunrpc(E) ip_tables(E) x_tables(E) autofs4(E) ext4(E) crc16(E) mbcache(E) jbd2(E) crc32c_generic(E) virtio_blk(E) 8139too(E) virtio_pci(E) virtio_ring(E) 8139cp(E) virtio(E) mii(E) [ 376.235692] CPU: 3 PID: 0 Comm: swapper/3 Tainted: GE 5.5.0-rc5-powerpc64le #1 Debian 5.5~rc5-1~exp1 [ 376.236245] NIP: c000af8c LR: c0019664 CTR: c0af2c80 [ 376.236365] REGS: c000fffcf920 TRAP: 0901 Tainted: GE (5.5.0-rc5-powerpc64le Debian 5.5~rc5-1~exp1) [ 376.236376] MSR: 80009033 CR: 44002248 XER: [ 376.236479] CFAR: c0af2ce0 IRQMASK: 0 GPR00: c0af2e38 c000fffcfbb0 c1365700 0500 GPR04: fef9 002be1f69c00 002beaa729fa c000fffec880 GPR08: 0004 80ff 0001 c008004c6ff0 GPR12: 2000 c000fffec880 [ 376.238452] NIP [c000af8c] replay_interrupt_return+0x0/0x4 [ 376.238488] LR [c0019664] arch_local_irq_restore.part.0+0x54/0x70 [ 376.238984] Call Trace: [ 376.240707] [c000fffcfbb0] [c08ce910] napi_gro_receive+0x1e0/0x210 (unreliable) [ 376.240824] [c000fffcfbd0] [c0af2e38] _raw_spin_unlock_irqrestore+0x98/0xb0 [ 376.242114] [c000fffcfbf0] [c008004c5588] cp_rx_poll+0x580/0x610 [8139cp] [ 376.242131] [c000fffcfcf0] [c08cf6c8] net_rx_action+0x1f8/0x550 [ 376.242139] [c000fffcfe10] [c0af3a8c] __do_softirq+0x16c/0x3d8 [ 376.242172] [c000fffcff30] [c01329e8] irq_exit+0xd8/0x120 [ 376.242181] [c000fffcff60] [c0019fb4] __do_irq+0x84/0x1c0 [ 376.242193] [c000fffcff90] [c002cbec] call_do_irq+0x14/0x24 [ 376.242201] [c000fd4b7980] [c001a178] do_IRQ+0x88/0xf0 [ 376.242209] [c000fd4b79c0] [c0008d98] hardware_interrupt_common+0x158/0x160 [ 376.242243] --- interrupt: 501 at plpar_hcall_norets+0x1c/0x28 LR = check_and_cede_processor+0x48/0x60 [ 376.243892] [c000fd4b7cc0] [c000fd4b7cf0] 0xc000fd4b7cf0 (unreliable) [ 376.243922] [c000fd4b7d20] [c086c710] shared_cede_loop+0x50/0x160 [ 376.243942] [c000fd4b7d50] [c0868844] cpuidle_enter_state+0xa4/0x590 [ 376.243953] [c000fd4b7dd0] [c0868dcc] cpuidle_enter+0x4c/0x70 [ 376.243983] [c000fd4b7e10] [c0177d4c] call_cpuidle+0x4c/0x90 [ 376.243991] [c000fd4b7e30] [c0178358] do_idle+0x2f8/0x400 [ 376.243998] [c000fd4b7ed0] [c01786a8] cpu_startup_entry+0x38/0x40 [ 376.244011] [c000fd4b7f00] [c004e910] start_secondary+0x640/0x670 [ 376.244020] [c000fd4b7f90] [c000b354] start_secondary_prolog+0x10/0x14 [ 376.244093] Instruction dump: [ 376.244751] 7d200026 618c8000 2c030900 4182e348 2c030500 4182dcd0 2c030f00 4182f318 [ 376.244797] 2c030a00 4182ffc8 6000 6000 <4e800020> 7c781b78 480003d9 480003f1 -- You received this bug notification because you are a member of qemu- devel-ml, which is subscribed to QEMU. https://bugs.launchpad.net/bugs/1867786 Title: Qemu PPC64 freezes with multi-core CPU Status in QEMU: New Bug description: I installed Debian 10 on a Qemu PPC64 VM running with the following flags: qemu-system-ppc64 \ -nographic -nodefaults -monitor pty -serial stdio \ -M pseries -cpu POWER9 -smp cores=4,threads=1 -m 4G \ -drive file=debian-ppc64el-qemu.qcow2,format=qcow2,if=virtio \ -netdev user,id=network01,$ports -device rtl8139,netdev=network01 \ Within a couple minutes on any operation (could be a Go application or simply changing the hostname with hostnamectl, the VM freezes and prints this on the console: ``` root@debian:~# [ 950.428255] rcu: INFO: rcu_sched self-detected stall on CPU [ 950.428453] rcu: 3-: (5318 ticks this GP) idle=8e2/1/0x4004 softirq=5957/5960 fqs=2544 [ 976.244481] watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [zsh:462] Message from syslogd@debian at Mar 17 11:35:24 ... kernel:[ 976.244481] watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [zsh:462] [ 980.110018] rcu: INFO: rcu_sched detected expedited stalls on CPUs/tasks: { 3-... } 5276 jiffies s: 93
[Bug 1867786] Re: Qemu PPC64 freezes with multi-core CPU
Hi, any news about this? Can I provide any additional info since it might be a Mac issue. Thanks -- You received this bug notification because you are a member of qemu- devel-ml, which is subscribed to QEMU. https://bugs.launchpad.net/bugs/1867786 Title: Qemu PPC64 freezes with multi-core CPU Status in QEMU: New Bug description: I installed Debian 10 on a Qemu PPC64 VM running with the following flags: qemu-system-ppc64 \ -nographic -nodefaults -monitor pty -serial stdio \ -M pseries -cpu POWER9 -smp cores=4,threads=1 -m 4G \ -drive file=debian-ppc64el-qemu.qcow2,format=qcow2,if=virtio \ -netdev user,id=network01,$ports -device rtl8139,netdev=network01 \ Within a couple minutes on any operation (could be a Go application or simply changing the hostname with hostnamectl, the VM freezes and prints this on the console: ``` root@debian:~# [ 950.428255] rcu: INFO: rcu_sched self-detected stall on CPU [ 950.428453] rcu: 3-: (5318 ticks this GP) idle=8e2/1/0x4004 softirq=5957/5960 fqs=2544 [ 976.244481] watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [zsh:462] Message from syslogd@debian at Mar 17 11:35:24 ... kernel:[ 976.244481] watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [zsh:462] [ 980.110018] rcu: INFO: rcu_sched detected expedited stalls on CPUs/tasks: { 3-... } 5276 jiffies s: 93 root: 0x8/. [ 980.77] rcu: blocking rcu_node structures: [ 1013.442268] rcu: INFO: rcu_sched self-detected stall on CPU [ 1013.442365] rcu: 3-: (21071 ticks this GP) idle=8e2/1/0x4004 softirq=5957/5960 fqs=9342 ``` If I change to 1 core on the command line, I haven't seen these freezes. To manage notifications about this bug go to: https://bugs.launchpad.net/qemu/+bug/1867786/+subscriptions
[Bug 1867786] Re: Qemu PPC64 freezes with multi-core CPU
Hi Laurent, I'm on a MacOS Mojave running Qemu installed by homebrew from master branch on the day I've opened the bug. The option to install was: `brew install --HEAD qemu -s --verbose`. Maybe it's a Mac related problem? -- You received this bug notification because you are a member of qemu- devel-ml, which is subscribed to QEMU. https://bugs.launchpad.net/bugs/1867786 Title: Qemu PPC64 freezes with multi-core CPU Status in QEMU: New Bug description: I installed Debian 10 on a Qemu PPC64 VM running with the following flags: qemu-system-ppc64 \ -nographic -nodefaults -monitor pty -serial stdio \ -M pseries -cpu POWER9 -smp cores=4,threads=1 -m 4G \ -drive file=debian-ppc64el-qemu.qcow2,format=qcow2,if=virtio \ -netdev user,id=network01,$ports -device rtl8139,netdev=network01 \ Within a couple minutes on any operation (could be a Go application or simply changing the hostname with hostnamectl, the VM freezes and prints this on the console: ``` root@debian:~# [ 950.428255] rcu: INFO: rcu_sched self-detected stall on CPU [ 950.428453] rcu: 3-: (5318 ticks this GP) idle=8e2/1/0x4004 softirq=5957/5960 fqs=2544 [ 976.244481] watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [zsh:462] Message from syslogd@debian at Mar 17 11:35:24 ... kernel:[ 976.244481] watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [zsh:462] [ 980.110018] rcu: INFO: rcu_sched detected expedited stalls on CPUs/tasks: { 3-... } 5276 jiffies s: 93 root: 0x8/. [ 980.77] rcu: blocking rcu_node structures: [ 1013.442268] rcu: INFO: rcu_sched self-detected stall on CPU [ 1013.442365] rcu: 3-: (21071 ticks this GP) idle=8e2/1/0x4004 softirq=5957/5960 fqs=9342 ``` If I change to 1 core on the command line, I haven't seen these freezes. To manage notifications about this bug go to: https://bugs.launchpad.net/qemu/+bug/1867786/+subscriptions
[Bug 1867786] Re: Qemu PPC64 freezes with multi-core CPU
I just reverted to 4.2.0 and it works fine. No freezes for the past hour. ❯ qemu-system-ppc64 --version QEMU emulator version 4.2.0 Copyright (c) 2003-2019 Fabrice Bellard and the QEMU Project developers Couldn't bisect to find the bad commit. Carlos -- You received this bug notification because you are a member of qemu- devel-ml, which is subscribed to QEMU. https://bugs.launchpad.net/bugs/1867786 Title: Qemu PPC64 freezes with multi-core CPU Status in QEMU: New Bug description: I installed Debian 10 on a Qemu PPC64 VM running with the following flags: qemu-system-ppc64 \ -nographic -nodefaults -monitor pty -serial stdio \ -M pseries -cpu POWER9 -smp cores=4,threads=1 -m 4G \ -drive file=debian-ppc64el-qemu.qcow2,format=qcow2,if=virtio \ -netdev user,id=network01,$ports -device rtl8139,netdev=network01 \ Within a couple minutes on any operation (could be a Go application or simply changing the hostname with hostnamectl, the VM freezes and prints this on the console: ``` root@debian:~# [ 950.428255] rcu: INFO: rcu_sched self-detected stall on CPU [ 950.428453] rcu: 3-: (5318 ticks this GP) idle=8e2/1/0x4004 softirq=5957/5960 fqs=2544 [ 976.244481] watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [zsh:462] Message from syslogd@debian at Mar 17 11:35:24 ... kernel:[ 976.244481] watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [zsh:462] [ 980.110018] rcu: INFO: rcu_sched detected expedited stalls on CPUs/tasks: { 3-... } 5276 jiffies s: 93 root: 0x8/. [ 980.77] rcu: blocking rcu_node structures: [ 1013.442268] rcu: INFO: rcu_sched self-detected stall on CPU [ 1013.442365] rcu: 3-: (21071 ticks this GP) idle=8e2/1/0x4004 softirq=5957/5960 fqs=9342 ``` If I change to 1 core on the command line, I haven't seen these freezes. To manage notifications about this bug go to: https://bugs.launchpad.net/qemu/+bug/1867786/+subscriptions
[Bug 1867786] Re: Qemu PPC64 freezes with multi-core CPU
It's soft emulation, running Qemu 4.2.50 (from master branch) on MacOS Mojave. -- You received this bug notification because you are a member of qemu- devel-ml, which is subscribed to QEMU. https://bugs.launchpad.net/bugs/1867786 Title: Qemu PPC64 freezes with multi-core CPU Status in QEMU: New Bug description: I installed Debian 10 on a Qemu PPC64 VM running with the following flags: qemu-system-ppc64 \ -nographic -nodefaults -monitor pty -serial stdio \ -M pseries -cpu POWER9 -smp cores=4,threads=1 -m 4G \ -drive file=debian-ppc64el-qemu.qcow2,format=qcow2,if=virtio \ -netdev user,id=network01,$ports -device rtl8139,netdev=network01 \ Within a couple minutes on any operation (could be a Go application or simply changing the hostname with hostnamectl, the VM freezes and prints this on the console: ``` root@debian:~# [ 950.428255] rcu: INFO: rcu_sched self-detected stall on CPU [ 950.428453] rcu: 3-: (5318 ticks this GP) idle=8e2/1/0x4004 softirq=5957/5960 fqs=2544 [ 976.244481] watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [zsh:462] Message from syslogd@debian at Mar 17 11:35:24 ... kernel:[ 976.244481] watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [zsh:462] [ 980.110018] rcu: INFO: rcu_sched detected expedited stalls on CPUs/tasks: { 3-... } 5276 jiffies s: 93 root: 0x8/. [ 980.77] rcu: blocking rcu_node structures: [ 1013.442268] rcu: INFO: rcu_sched self-detected stall on CPU [ 1013.442365] rcu: 3-: (21071 ticks this GP) idle=8e2/1/0x4004 softirq=5957/5960 fqs=9342 ``` If I change to 1 core on the command line, I haven't seen these freezes. To manage notifications about this bug go to: https://bugs.launchpad.net/qemu/+bug/1867786/+subscriptions
[Bug 1867786] Re: Qemu PPC64 freezes with multi-core CPU
** Tags added: ppc -- You received this bug notification because you are a member of qemu- devel-ml, which is subscribed to QEMU. https://bugs.launchpad.net/bugs/1867786 Title: Qemu PPC64 freezes with multi-core CPU Status in QEMU: New Bug description: I installed Debian 10 on a Qemu PPC64 VM running with the following flags: qemu-system-ppc64 \ -nographic -nodefaults -monitor pty -serial stdio \ -M pseries -cpu POWER9 -smp cores=4,threads=1 -m 4G \ -drive file=debian-ppc64el-qemu.qcow2,format=qcow2,if=virtio \ -netdev user,id=network01,$ports -device rtl8139,netdev=network01 \ Within a couple minutes on any operation (could be a Go application or simply changing the hostname with hostnamectl, the VM freezes and prints this on the console: ``` root@debian:~# [ 950.428255] rcu: INFO: rcu_sched self-detected stall on CPU [ 950.428453] rcu: 3-: (5318 ticks this GP) idle=8e2/1/0x4004 softirq=5957/5960 fqs=2544 [ 976.244481] watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [zsh:462] Message from syslogd@debian at Mar 17 11:35:24 ... kernel:[ 976.244481] watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [zsh:462] [ 980.110018] rcu: INFO: rcu_sched detected expedited stalls on CPUs/tasks: { 3-... } 5276 jiffies s: 93 root: 0x8/. [ 980.77] rcu: blocking rcu_node structures: [ 1013.442268] rcu: INFO: rcu_sched self-detected stall on CPU [ 1013.442365] rcu: 3-: (21071 ticks this GP) idle=8e2/1/0x4004 softirq=5957/5960 fqs=9342 ``` If I change to 1 core on the command line, I haven't seen these freezes. To manage notifications about this bug go to: https://bugs.launchpad.net/qemu/+bug/1867786/+subscriptions
[Bug 1867786] [NEW] Qemu PPC64 freezes with multi-core CPU
Public bug reported: I installed Debian 10 on a Qemu PPC64 VM running with the following flags: qemu-system-ppc64 \ -nographic -nodefaults -monitor pty -serial stdio \ -M pseries -cpu POWER9 -smp cores=4,threads=1 -m 4G \ -drive file=debian-ppc64el-qemu.qcow2,format=qcow2,if=virtio \ -netdev user,id=network01,$ports -device rtl8139,netdev=network01 \ Within a couple minutes on any operation (could be a Go application or simply changing the hostname with hostnamectl, the VM freezes and prints this on the console: ``` root@debian:~# [ 950.428255] rcu: INFO: rcu_sched self-detected stall on CPU [ 950.428453] rcu: 3-: (5318 ticks this GP) idle=8e2/1/0x4004 softirq=5957/5960 fqs=2544 [ 976.244481] watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [zsh:462] Message from syslogd@debian at Mar 17 11:35:24 ... kernel:[ 976.244481] watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [zsh:462] [ 980.110018] rcu: INFO: rcu_sched detected expedited stalls on CPUs/tasks: { 3-... } 5276 jiffies s: 93 root: 0x8/. [ 980.77] rcu: blocking rcu_node structures: [ 1013.442268] rcu: INFO: rcu_sched self-detected stall on CPU [ 1013.442365] rcu: 3-: (21071 ticks this GP) idle=8e2/1/0x4004 softirq=5957/5960 fqs=9342 ``` If I change to 1 core on the command line, I haven't seen these freezes. ** Affects: qemu Importance: Undecided Status: New -- You received this bug notification because you are a member of qemu- devel-ml, which is subscribed to QEMU. https://bugs.launchpad.net/bugs/1867786 Title: Qemu PPC64 freezes with multi-core CPU Status in QEMU: New Bug description: I installed Debian 10 on a Qemu PPC64 VM running with the following flags: qemu-system-ppc64 \ -nographic -nodefaults -monitor pty -serial stdio \ -M pseries -cpu POWER9 -smp cores=4,threads=1 -m 4G \ -drive file=debian-ppc64el-qemu.qcow2,format=qcow2,if=virtio \ -netdev user,id=network01,$ports -device rtl8139,netdev=network01 \ Within a couple minutes on any operation (could be a Go application or simply changing the hostname with hostnamectl, the VM freezes and prints this on the console: ``` root@debian:~# [ 950.428255] rcu: INFO: rcu_sched self-detected stall on CPU [ 950.428453] rcu: 3-: (5318 ticks this GP) idle=8e2/1/0x4004 softirq=5957/5960 fqs=2544 [ 976.244481] watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [zsh:462] Message from syslogd@debian at Mar 17 11:35:24 ... kernel:[ 976.244481] watchdog: BUG: soft lockup - CPU#3 stuck for 23s! [zsh:462] [ 980.110018] rcu: INFO: rcu_sched detected expedited stalls on CPUs/tasks: { 3-... } 5276 jiffies s: 93 root: 0x8/. [ 980.77] rcu: blocking rcu_node structures: [ 1013.442268] rcu: INFO: rcu_sched self-detected stall on CPU [ 1013.442365] rcu: 3-: (21071 ticks this GP) idle=8e2/1/0x4004 softirq=5957/5960 fqs=9342 ``` If I change to 1 core on the command line, I haven't seen these freezes. To manage notifications about this bug go to: https://bugs.launchpad.net/qemu/+bug/1867786/+subscriptions
[Bug 1847232] Re: qemu TCG in s390x mode issue with calculating HASH
Tried applying the -cpu parameter into Qemu 4.1.1 but I got: qemu-system-riscv64: unable to find CPU model 'qemu' My command is: qemu-system-riscv64 \ -machine virt \ -cpu qemu,vx=off \ -nographic \ -smp 4 \ -m 4G \ -bios fw_payload.bin \ -device virtio-blk-device,drive=hd0 \ -object rng-random,filename=/dev/urandom,id=rng0 \ -device virtio-rng-device,rng=rng0 \ -drive file=riscv64-debianrootfs-qemu.qcow2,format=qcow2,id=hd0 \ -device virtio-net-device,netdev=usernet \ -netdev user,id=usernet,hostfwd=tcp::2-:22" -- You received this bug notification because you are a member of qemu- devel-ml, which is subscribed to QEMU. https://bugs.launchpad.net/bugs/1847232 Title: qemu TCG in s390x mode issue with calculating HASH Status in QEMU: Fix Released Bug description: When using go on s390x on Debian x64 (buster) (host) and debian s390x (sid) (guest) I run into the following problem : The following occurs while trying to build a custom project : go: github.com/FactomProject/basen@v0.0.0-20150613233007-fe3947df716e: Get https://proxy.golang.org/github.com/%21factom%21project/basen/@v/v0.0.0-20150613233007-fe3947df716e.mod: local error: tls: bad record MAC Doing a git bisect I find that this problem only occurs on and after commit 08ef92d556c584c7faf594ff3af46df456276e1b Before that commit, all works fine. Past this commit, build always fails. Without any proof, It looks like a hash calculation bug related to using z/Arch vector facilities... To manage notifications about this bug go to: https://bugs.launchpad.net/qemu/+bug/1847232/+subscriptions