Re: [Kernel-packages] [Bug 1367932] Re: qemu VM crashes the host
On 09/12/2014 07:33 AM, Christopher M. Penalver wrote: ** Tags added: bios-outdated-0502 I'm not sure about this flag since the outdated BIOS version was 305 and the 502 one is the latest. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1367932 Title: qemu VM crashes the host Status in “linux” package in Ubuntu: Incomplete Bug description: My qemu host keeps crashing every once in a while and this seems to happen when there is some load and/or network traffic happening in the 2 guests it powers. This time I was able to capture a crash trace: Sep 10 16:49:45 ocelot kernel: [204709.569951] general protection fault: [#1] SMP Sep 10 16:49:45 ocelot kernel: [204709.570004] Modules linked in: vhost_net vhost macvtap macvlan bridge nf_conntrack_ipv6 nf_defrag_ipv6 ip6table_filter ip6_tables xt_LOG xt_tcpudp nf_conntrack_ipv4 nf_defrag_ipv4 xt_owner xt_conn track nf_conntrack iptable_filter ip_tables x_tables eeepc_wmi asus_wmi sparse_keymap video 8021q garp stp mrp llc radeon kvm_amd kvm ttm drm_kms_helper drm sp5100_tco serio_raw k10temp i2c_algo_bit i2c_piix4 wmi mac_hid configfs n ls_iso8859_1 hid_generic usbhid hid psmouse r8169 mii ahci libahci Sep 10 16:49:45 ocelot kernel: [204709.570337] CPU: 0 PID: 2944 Comm: qemu-system-x86 Not tainted 3.13.0-36-generic #63-Ubuntu Sep 10 16:49:45 ocelot kernel: [204709.570375] Hardware name: System manufacturer System Product Name/C60M1-I, BIOS 0305 08/07/2012 Sep 10 16:49:45 ocelot kernel: [204709.570414] task: 8802120f1800 ti: 88020f428000 task.ti: 88020f428000 Sep 10 16:49:45 ocelot kernel: [204709.570446] RIP: 0010:[81092ef8] [81092ef8] preempt_notifier_unregister+0x18/0x40 Sep 10 16:49:45 ocelot kernel: [204709.570497] RSP: 0018:88020f429e00 EFLAGS: 00010206 Sep 10 16:49:45 ocelot kernel: [204709.570523] RAX: 0020 RBX: 88020f43 RCX: 0176 Sep 10 16:49:45 ocelot kernel: [204709.572483] RDX: 8802120f1a18 RSI: 81730c20 RDI: 88020f430008 Sep 10 16:49:45 ocelot kernel: [204709.574491] RBP: 88020f429e00 R08: a013e180 R09: Sep 10 16:49:45 ocelot kernel: [204709.576508] R10: 00ff R11: R12: Sep 10 16:49:45 ocelot kernel: [204709.578511] R13: R14: R15: Sep 10 16:49:45 ocelot kernel: [204709.580492] FS: 7f77aefe2700() GS:88021ec0() knlGS: Sep 10 16:49:45 ocelot kernel: [204709.582461] CS: 0010 DS: ES: CR0: 8005003b Sep 10 16:49:45 ocelot kernel: [204709.584402] CR2: 09f39cad593d CR3: 0002110b6000 CR4: 07f0 Sep 10 16:49:45 ocelot kernel: [204709.586351] Stack: Sep 10 16:49:45 ocelot kernel: [204709.588261] 88020f429e18 a0141d8b 88020f43 88020f429ec0 Sep 10 16:49:45 ocelot kernel: [204709.590194] a0141eae 810d8e51 00010f429e78 7f77bf54c000 Sep 10 16:49:45 ocelot kernel: [204709.592119] 880212f14a80 01c0 7f77bf54c1c0 0081 Sep 10 16:49:45 ocelot kernel: [204709.594027] Call Trace: Sep 10 16:49:45 ocelot kernel: [204709.595921] [a0141d8b] vcpu_put+0x1b/0x30 [kvm] Sep 10 16:49:45 ocelot kernel: [204709.597806] [a0141eae] kvm_vcpu_ioctl+0x10e/0x5b0 [kvm] Sep 10 16:49:45 ocelot kernel: [204709.599645] [810d8e51] ? futex_wake+0x1b1/0x1d0 Sep 10 16:49:45 ocelot kernel: [204709.601449] [81636f85] ? sk_run_filter+0x295/0x700 Sep 10 16:49:45 ocelot kernel: [204709.603222] [811d0390] do_vfs_ioctl+0x2e0/0x4c0 Sep 10 16:49:45 ocelot kernel: [204709.604957] [8110dfa3] ? __secure_computing+0x73/0x260 Sep 10 16:49:45 ocelot kernel: [204709.606676] [811d05f1] SyS_ioctl+0x81/0xa0 Sep 10 16:49:45 ocelot kernel: [204709.608358] [8172f1bf] tracesys+0xe1/0xe6 Sep 10 16:49:45 ocelot kernel: [204709.610003] Code: 05 18 02 00 00 48 89 47 08 5d c3 0f 1f 84 00 00 00 00 00 66 66 66 66 90 48 8b 07 48 8b 57 08 55 48 85 c0 48 89 e5 48 89 02 74 04 48 89 50 08 48 b8 00 01 10 00 00 00 ad de 48 89 07 48 b8 00 02 Sep 10 16:49:45 ocelot kernel: [204709.613642] RIP [81092ef8] preempt_notifier_unregister+0x18/0x40 Sep 10 16:49:45 ocelot kernel: [204709.615392] RSP 88020f429e00 Sep 10 16:49:45 ocelot kernel: [204709.622204] ---[ end trace 8804eab7229156e0 ]--- CPU 0 is powering an OpenBSD 5.5 64 bit guests that is pinned to this CPU. At the time of the crash, the other guest (Trusty 64 bit) was running and pinned on CPU 1. $ lsb_release -rd Description: Ubuntu 14.04.1 LTS Release: 14.04 # Note: Even if I run a kernel from -proposed, the crashed happened before. $ apt-cache policy linux-image-3.13.0-36-generic
Re: [Kernel-packages] [Bug 1367932] Re: qemu VM crashes the host
On 09/10/2014 06:03 PM, Joseph Salisbury wrote: id this issue occur in a previous version of Ubuntu, or is this a new issue? The problem also happened when the host was running Saucy and the OpenBSD guest was at version 5.4. Looking at the trace more closely, I noticed __secure_computing+0x73/0x260 could it be related to seccomp filtering that I enabled on QEMU (had that on with Saucy too)? Would it be possible for you to test the latest upstream kernel? Refer to https://wiki.ubuntu.com/KernelMainlineBuilds . Please test the latest v3.17 kernel[0]. I will test the latest upstream eventually but I just noticed a newer BIOS/EFI was available. The changelog says Improve system stability so I'll give that a try and see if I can reproduce the issue with Ubuntu's stock kernel and this new BIOS/EFI. Thanks Joseph -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1367932 Title: qemu VM crashes the host Status in “linux” package in Ubuntu: Incomplete Bug description: My qemu host keeps crashing every once in a while and this seems to happen when there is some load and/or network traffic happening in the 2 guests it powers. This time I was able to capture a crash trace: Sep 10 16:49:45 ocelot kernel: [204709.569951] general protection fault: [#1] SMP Sep 10 16:49:45 ocelot kernel: [204709.570004] Modules linked in: vhost_net vhost macvtap macvlan bridge nf_conntrack_ipv6 nf_defrag_ipv6 ip6table_filter ip6_tables xt_LOG xt_tcpudp nf_conntrack_ipv4 nf_defrag_ipv4 xt_owner xt_conn track nf_conntrack iptable_filter ip_tables x_tables eeepc_wmi asus_wmi sparse_keymap video 8021q garp stp mrp llc radeon kvm_amd kvm ttm drm_kms_helper drm sp5100_tco serio_raw k10temp i2c_algo_bit i2c_piix4 wmi mac_hid configfs n ls_iso8859_1 hid_generic usbhid hid psmouse r8169 mii ahci libahci Sep 10 16:49:45 ocelot kernel: [204709.570337] CPU: 0 PID: 2944 Comm: qemu-system-x86 Not tainted 3.13.0-36-generic #63-Ubuntu Sep 10 16:49:45 ocelot kernel: [204709.570375] Hardware name: System manufacturer System Product Name/C60M1-I, BIOS 0305 08/07/2012 Sep 10 16:49:45 ocelot kernel: [204709.570414] task: 8802120f1800 ti: 88020f428000 task.ti: 88020f428000 Sep 10 16:49:45 ocelot kernel: [204709.570446] RIP: 0010:[81092ef8] [81092ef8] preempt_notifier_unregister+0x18/0x40 Sep 10 16:49:45 ocelot kernel: [204709.570497] RSP: 0018:88020f429e00 EFLAGS: 00010206 Sep 10 16:49:45 ocelot kernel: [204709.570523] RAX: 0020 RBX: 88020f43 RCX: 0176 Sep 10 16:49:45 ocelot kernel: [204709.572483] RDX: 8802120f1a18 RSI: 81730c20 RDI: 88020f430008 Sep 10 16:49:45 ocelot kernel: [204709.574491] RBP: 88020f429e00 R08: a013e180 R09: Sep 10 16:49:45 ocelot kernel: [204709.576508] R10: 00ff R11: R12: Sep 10 16:49:45 ocelot kernel: [204709.578511] R13: R14: R15: Sep 10 16:49:45 ocelot kernel: [204709.580492] FS: 7f77aefe2700() GS:88021ec0() knlGS: Sep 10 16:49:45 ocelot kernel: [204709.582461] CS: 0010 DS: ES: CR0: 8005003b Sep 10 16:49:45 ocelot kernel: [204709.584402] CR2: 09f39cad593d CR3: 0002110b6000 CR4: 07f0 Sep 10 16:49:45 ocelot kernel: [204709.586351] Stack: Sep 10 16:49:45 ocelot kernel: [204709.588261] 88020f429e18 a0141d8b 88020f43 88020f429ec0 Sep 10 16:49:45 ocelot kernel: [204709.590194] a0141eae 810d8e51 00010f429e78 7f77bf54c000 Sep 10 16:49:45 ocelot kernel: [204709.592119] 880212f14a80 01c0 7f77bf54c1c0 0081 Sep 10 16:49:45 ocelot kernel: [204709.594027] Call Trace: Sep 10 16:49:45 ocelot kernel: [204709.595921] [a0141d8b] vcpu_put+0x1b/0x30 [kvm] Sep 10 16:49:45 ocelot kernel: [204709.597806] [a0141eae] kvm_vcpu_ioctl+0x10e/0x5b0 [kvm] Sep 10 16:49:45 ocelot kernel: [204709.599645] [810d8e51] ? futex_wake+0x1b1/0x1d0 Sep 10 16:49:45 ocelot kernel: [204709.601449] [81636f85] ? sk_run_filter+0x295/0x700 Sep 10 16:49:45 ocelot kernel: [204709.603222] [811d0390] do_vfs_ioctl+0x2e0/0x4c0 Sep 10 16:49:45 ocelot kernel: [204709.604957] [8110dfa3] ? __secure_computing+0x73/0x260 Sep 10 16:49:45 ocelot kernel: [204709.606676] [811d05f1] SyS_ioctl+0x81/0xa0 Sep 10 16:49:45 ocelot kernel: [204709.608358] [8172f1bf] tracesys+0xe1/0xe6 Sep 10 16:49:45 ocelot kernel: [204709.610003] Code: 05 18 02 00 00 48 89 47 08 5d c3 0f 1f 84 00 00 00 00 00 66 66 66 66 90 48 8b 07 48 8b 57 08 55 48 85 c0 48 89 e5 48 89 02 74 04 48 89 50 08 48 b8 00 01 10 00 00 00 ad de 48 89 07 48 b8 00 02 Sep 10
Re: [Kernel-packages] [Bug 1367932] Re: qemu VM crashes the host
Hi Chris, On 09/11/2014 01:16 PM, Chris J Arges wrote: How often does this occur? It depends: can be once a week or 3 days in a row. It almost always happened at night (during backup jobs). Have you been able to reproduce this issue without pinning your VMs to cpus? Can you still reproduce the issue after disabling seccomp filtering? Good idea, I will try to play with both settings but I will first try to reproduce it with the newer BIOS/EFI version. Another approach would be to get a full system crash using the following: https://wiki.ubuntu.com/Kernel/CrashdumpRecipe Interesting, enabling this now to capture useful dump next crash. Thanks! Simon -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1367932 Title: qemu VM crashes the host Status in “linux” package in Ubuntu: Incomplete Bug description: My qemu host keeps crashing every once in a while and this seems to happen when there is some load and/or network traffic happening in the 2 guests it powers. This time I was able to capture a crash trace: Sep 10 16:49:45 ocelot kernel: [204709.569951] general protection fault: [#1] SMP Sep 10 16:49:45 ocelot kernel: [204709.570004] Modules linked in: vhost_net vhost macvtap macvlan bridge nf_conntrack_ipv6 nf_defrag_ipv6 ip6table_filter ip6_tables xt_LOG xt_tcpudp nf_conntrack_ipv4 nf_defrag_ipv4 xt_owner xt_conn track nf_conntrack iptable_filter ip_tables x_tables eeepc_wmi asus_wmi sparse_keymap video 8021q garp stp mrp llc radeon kvm_amd kvm ttm drm_kms_helper drm sp5100_tco serio_raw k10temp i2c_algo_bit i2c_piix4 wmi mac_hid configfs n ls_iso8859_1 hid_generic usbhid hid psmouse r8169 mii ahci libahci Sep 10 16:49:45 ocelot kernel: [204709.570337] CPU: 0 PID: 2944 Comm: qemu-system-x86 Not tainted 3.13.0-36-generic #63-Ubuntu Sep 10 16:49:45 ocelot kernel: [204709.570375] Hardware name: System manufacturer System Product Name/C60M1-I, BIOS 0305 08/07/2012 Sep 10 16:49:45 ocelot kernel: [204709.570414] task: 8802120f1800 ti: 88020f428000 task.ti: 88020f428000 Sep 10 16:49:45 ocelot kernel: [204709.570446] RIP: 0010:[81092ef8] [81092ef8] preempt_notifier_unregister+0x18/0x40 Sep 10 16:49:45 ocelot kernel: [204709.570497] RSP: 0018:88020f429e00 EFLAGS: 00010206 Sep 10 16:49:45 ocelot kernel: [204709.570523] RAX: 0020 RBX: 88020f43 RCX: 0176 Sep 10 16:49:45 ocelot kernel: [204709.572483] RDX: 8802120f1a18 RSI: 81730c20 RDI: 88020f430008 Sep 10 16:49:45 ocelot kernel: [204709.574491] RBP: 88020f429e00 R08: a013e180 R09: Sep 10 16:49:45 ocelot kernel: [204709.576508] R10: 00ff R11: R12: Sep 10 16:49:45 ocelot kernel: [204709.578511] R13: R14: R15: Sep 10 16:49:45 ocelot kernel: [204709.580492] FS: 7f77aefe2700() GS:88021ec0() knlGS: Sep 10 16:49:45 ocelot kernel: [204709.582461] CS: 0010 DS: ES: CR0: 8005003b Sep 10 16:49:45 ocelot kernel: [204709.584402] CR2: 09f39cad593d CR3: 0002110b6000 CR4: 07f0 Sep 10 16:49:45 ocelot kernel: [204709.586351] Stack: Sep 10 16:49:45 ocelot kernel: [204709.588261] 88020f429e18 a0141d8b 88020f43 88020f429ec0 Sep 10 16:49:45 ocelot kernel: [204709.590194] a0141eae 810d8e51 00010f429e78 7f77bf54c000 Sep 10 16:49:45 ocelot kernel: [204709.592119] 880212f14a80 01c0 7f77bf54c1c0 0081 Sep 10 16:49:45 ocelot kernel: [204709.594027] Call Trace: Sep 10 16:49:45 ocelot kernel: [204709.595921] [a0141d8b] vcpu_put+0x1b/0x30 [kvm] Sep 10 16:49:45 ocelot kernel: [204709.597806] [a0141eae] kvm_vcpu_ioctl+0x10e/0x5b0 [kvm] Sep 10 16:49:45 ocelot kernel: [204709.599645] [810d8e51] ? futex_wake+0x1b1/0x1d0 Sep 10 16:49:45 ocelot kernel: [204709.601449] [81636f85] ? sk_run_filter+0x295/0x700 Sep 10 16:49:45 ocelot kernel: [204709.603222] [811d0390] do_vfs_ioctl+0x2e0/0x4c0 Sep 10 16:49:45 ocelot kernel: [204709.604957] [8110dfa3] ? __secure_computing+0x73/0x260 Sep 10 16:49:45 ocelot kernel: [204709.606676] [811d05f1] SyS_ioctl+0x81/0xa0 Sep 10 16:49:45 ocelot kernel: [204709.608358] [8172f1bf] tracesys+0xe1/0xe6 Sep 10 16:49:45 ocelot kernel: [204709.610003] Code: 05 18 02 00 00 48 89 47 08 5d c3 0f 1f 84 00 00 00 00 00 66 66 66 66 90 48 8b 07 48 8b 57 08 55 48 85 c0 48 89 e5 48 89 02 74 04 48 89 50 08 48 b8 00 01 10 00 00 00 ad de 48 89 07 48 b8 00 02 Sep 10 16:49:45 ocelot kernel: [204709.613642] RIP [81092ef8] preempt_notifier_unregister+0x18/0x40 Sep 10 16:49:45 ocelot kernel: [204709.615392] RSP