Also seeing this issue. Long kernel panic backtrace at the end of the message. The kernel seems to fully crash only when I have Docker running in a volume with an NFS export, and then I mount the NFS volume. The underlying volume is ZFS, but I'm not entirely sure if that has much to do with it. I can consistently reproduce this by spamming umounts and mounts:
for i in $(seq 1 100); do echo $i: umount; sudo umount -l -f /data; echo $i: mount; mount /data; echo; done; The spam doesn't crash the system when Docker is stopped - only when Docker is actively running. I saw this related bug in the kernel: https://bugzilla.kernel.org/show_bug.cgi?id=208003 And this fix in mainline: https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?h=v5.9-rc1&id=ad0f75e5f57ccbceec13274e1e242f2b5a6397ed Looks like the fix is in kernel 4.19.134: https://git.kernel.org/pub/scm/linux/kernel/git/stable/linux.git/log/?h=v4.19.134 ("cgroup: fix cgroup_sk_alloc() for sk_clone_lock()") Since the latest Debian buster kernel is based on 4.19.132, I suppose the best thing to do is to wait for a new kernel version to be minted that (hopefully) contains the fix? Aug 19 14:32:11 cascadia kernel: general protection fault: 0000 [#1] SMP PTI Aug 19 14:32:11 cascadia kernel: CPU: 9 PID: 4424 Comm: nfsd Tainted: P OE 4.19.0-10-amd64 #1 Debian 4.19.132-1 Aug 19 14:32:11 cascadia kernel: Hardware name: Supermicro Super Server/X10SDV-TLN4F, BIOS 1.3 02/13/2018 Aug 19 14:32:11 cascadia kernel: RIP: 0010:__cgroup_bpf_run_filter_skb+0xbd/0x1e0 Aug 19 14:32:11 cascadia kernel: Code: 00 00 00 49 89 7f 18 48 89 0c 24 44 89 e1 48 29 c8 48 89 4c 24 08 49 89 87 d8 00 00 00 89 d2 48 8d 84 d6 b0 03 00 00 48 8b 00 <48> 8b 58 10 4c 8d 70 10 48 85 db 0f 84 01 01 00 00 4d 8d 6f 30 bd Aug 19 14:32:11 cascadia kernel: RSP: 0000:ffffb5290ff9fa08 EFLAGS: 00010286 Aug 19 14:32:11 cascadia kernel: RAX: f70b7912beaa0ef3 RBX: ffff9bb45783eee8 RCX: 0000000000000000 Aug 19 14:32:11 cascadia kernel: RDX: 0000000000000001 RSI: ffff9bb45b922800 RDI: ffff9bb3f78eee80 Aug 19 14:32:11 cascadia kernel: RBP: ffff9bb3f78eee80 R08: ffff9bb45783eee8 R09: 0000000000000c32 Aug 19 14:32:11 cascadia kernel: R10: 0000000000000001 R11: ffff9bb373296780 R12: 0000000000000000 Aug 19 14:32:11 cascadia kernel: R13: 0000000000000000 R14: ffff9bb3f78ef1c0 R15: ffff9bb45783eee8 Aug 19 14:32:11 cascadia kernel: FS: 0000000000000000(0000) GS:ffff9bb45fa40000(0000) knlGS:0000000000000000 Aug 19 14:32:11 cascadia kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 19 14:32:11 cascadia kernel: CR2: 000055f6f1a7b010 CR3: 00000007ccc0a004 CR4: 00000000003606e0 Aug 19 14:32:11 cascadia kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 Aug 19 14:32:11 cascadia kernel: DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Aug 19 14:32:11 cascadia kernel: Call Trace: Aug 19 14:32:11 cascadia kernel: ip_finish_output+0x228/0x270 Aug 19 14:32:11 cascadia kernel: ? nf_hook_slow+0x44/0xc0 Aug 19 14:32:11 cascadia kernel: ip_output+0x6c/0xe0 Aug 19 14:32:11 cascadia kernel: ? ip_append_data.part.49+0xd0/0xd0 Aug 19 14:32:11 cascadia kernel: __ip_queue_xmit+0x15d/0x410 Aug 19 14:32:11 cascadia kernel: __tcp_transmit_skb+0x527/0xb10 Aug 19 14:32:11 cascadia kernel: tcp_write_xmit+0x384/0x1000 Aug 19 14:32:11 cascadia kernel: do_tcp_sendpages+0x2d4/0x600 Aug 19 14:32:11 cascadia kernel: tcp_sendpage_locked+0x44/0x60 Aug 19 14:32:11 cascadia kernel: tcp_sendpage+0x37/0x50 Aug 19 14:32:11 cascadia kernel: inet_sendpage+0x3f/0xf0 Aug 19 14:32:11 cascadia kernel: kernel_sendpage+0x1a/0x30 Aug 19 14:32:11 cascadia kernel: svc_send_common+0xf5/0x150 [sunrpc] Aug 19 14:32:11 cascadia kernel: ? nfsd_destroy+0x50/0x50 [nfsd] Aug 19 14:32:11 cascadia kernel: svc_sendto+0x117/0x220 [sunrpc] Aug 19 14:32:11 cascadia kernel: ? dput.part.33+0x32/0x140 Aug 19 14:32:11 cascadia kernel: ? fh_put+0x93/0xf0 [nfsd] Aug 19 14:32:11 cascadia kernel: ? copy_cred+0x3f/0xb0 [nfsd] Aug 19 14:32:11 cascadia kernel: ? put_client_renew_locked+0xcd/0xe0 [nfsd] Aug 19 14:32:11 cascadia kernel: ? refcount_dec_and_lock+0xd/0x40 Aug 19 14:32:11 cascadia kernel: ? auth_domain_put+ 0x15/0x70 [sunrpc] Aug 19 14:32:11 cascadia kernel: ? svc_authorise+0x34/0x40 [sunrpc] Aug 19 14:32:11 cascadia kernel: ? svc_process_common+0x11e/0x740 [sunrpc] Aug 19 14:32:11 cascadia kernel: ? svc_tcp_sendto+0x36/0x50 [sunrpc] Aug 19 14:32:11 cascadia kernel: svc_tcp_sendto+0x36/0x50 [sunrpc] Aug 19 14:32:11 cascadia kernel: svc_send+0x73/0x160 [sunrpc] Aug 19 14:32:11 cascadia kernel: nfsd+0xe3/0x140 [nfsd] Aug 19 14:32:11 cascadia kernel: kthread+0x112/0x130 Aug 19 14:32:11 cascadia kernel: ? kthread_bind+0x30/0x30 Aug 19 14:32:11 cascadia kernel: ret_from_fork+0x35/0x40 Aug 19 14:32:11 cascadia kernel: Modules linked in: veth xt_nat xt_tcpudp xt_conntrack ipt_MASQUERADE nf_conntrack_netlink xfrm_user xfrm_algo nft_counter xt_addrtype nft_compat nft_chain_nat_ipv4 nf_nat_ipv4 nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter bridge stp llc rpcsec_gss_krb5 devlink nf_tables nfnetlink aufs(OE) wireguard(E) ip6_udp_tunnel udp_tunnel overlay intel_rapl sb_edac x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel pcc_cpufreq zfs(POE) kvm irqbypass zunicode(POE) intel_cstate zlua(POE) zavl(POE) intel_uncore icp(POE) ipmi_ssif mxm_wmi ast ttm drm_kms_helper intel_rapl_perf pcspkr drm intel_pch_thermal iTCO_wdt iTCO_vendor_support joydev cdc_acm evdev sg mei_me mei ioatdma ipmi_si wmi acpi_pad button nfsd auth_rpcgss nfs_acl lockd grace zcommon(POE) sunrpc znvpair(POE) spl(OE) Aug 19 14:32:11 cascadia kernel: ipmi_devintf ipmi_msghandler ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 fscrypto ecb btrfs xor zstd_decompress zstd_compress xxhash raid6_pq libcrc32c crc32c_generic algif_skcipher af_alg dm_crypt dm_mod hid_generic usbhid hid sd_mod crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel pcbc ahci xhci_pci libahci xhci_hcd mpt3sas ehci_pci libata ehci_hcd usbcore raid_class aesni_intel ixgbe scsi_transport_sas igb aes_x86_64 scsi_mod nvme crypto_simd cryptd glue_helper lpc_ich nvme_core i2c_i801 mfd_core i2c_algo_bit dca usb_common mdio Aug 19 14:32:11 cascadia kernel: ---[ end trace acf9c2d544d7fd2c ]--- Aug 19 14:32:11 cascadia kernel: RIP: 0010:__cgroup_bpf_run_filter_skb+0xbd/0x1e0 Aug 19 14:32:11 cascadia kernel: Code: 00 00 00 49 89 7f 18 48 89 0c 24 44 89 e1 48 29 c8 48 89 4c 24 08 49 89 87 d8 00 00 00 89 d2 48 8d 84 d6 b0 03 00 00 48 8b 00 <48> 8b 58 10 4c 8d 70 10 48 85 db 0f 84 01 01 00 00 4d 8d 6f 30 bd Aug 19 14:32:11 cascadia kernel: RSP: 0000:ffffb5290ff9fa08 EFLAGS: 00010286 Aug 19 14:32:11 cascadia kernel: RAX: f70b7912beaa0ef3 RBX: ffff9bb45783eee8 RCX: 0000000000000000 Aug 19 14:32:11 cascadia kernel: RDX: 0000000000000001 RSI: ffff9bb45b922800 RDI: ffff9bb3f78eee80 Aug 19 14:32:11 cascadia kernel: RBP: ffff9bb3f78eee80 R08: ffff9bb45783eee8 R09: 0000000000000c32 Aug 19 14:32:11 cascadia kernel: R10: 0000000000000001 R11: ffff9bb373296780 R12: 0000000000000000 Aug 19 14:32:11 cascadia kernel: R13: 0000000000000000 R14: ffff9bb3f78ef1c0 R15: ffff9bb45783eee8 Aug 19 14:32:11 cascadia kernel: FS: 0000000000000000(0000) GS:ffff9bb45fa40000(0000) knlGS:0000000000000000 Aug 19 14:32:11 cascadia kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 19 14:32:11 cascadia kernel: CR2: 000055f6f1a7b010 CR3: 00000007ccc0a004 CR4: 00000000003606e0 Aug 19 14:32:11 cascadia kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 Aug 19 14:32:11 cascadia kernel: DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Aug 19 14:32:11 cascadia kernel: general protection fault: 0000 [#2] SMP PTI Aug 19 14:32:11 cascadia kernel: CPU: 2 PID: 13041 Comm: C2 CompilerThre Tainted: P D OE 4.19.0-10-amd64 #1 Debian 4.19.132-1 Aug 19 14:32:11 cascadia kernel: Hardware name: Supermicro Super Server/X10SDV-TLN4F, BIOS 1.3 02/13/2018 Aug 19 14:32:11 cascadia kernel: RIP: 0010:__cgroup_bpf_run_filter_skb+0xbd/0x1e0 Aug 19 14:32:11 cascadia kernel: Code: 00 00 00 49 89 7f 18 48 89 0c 24 44 89 e1 48 29 c8 48 89 4c 24 08 49 89 87 d8 00 00 00 89 d2 48 8d 84 d6 b0 03 00 00 48 8b 00 <48> 8b 58 10 4c 8d 70 10 48 85 db 0f 84 01 01 00 00 4d 8d 6f 30 bd Aug 19 14:32:11 cascadia kernel: RSP: 0000:ffff9bb45f883c00 EFLAGS: 00010296 Aug 19 14:32:11 cascadia kernel: RAX: f3f4ae25351c25db RBX: ffff9bb453a7c300 RCX: 0000000000000014 Aug 19 14:32:11 cascadia kernel: RDX: 0000000000000000 RSI: ffff9bb45b922800 RDI: ffff9bb3f78eee80 Aug 19 14:32:11 cascadia kernel: RBP: ffff9bb3f78eee80 R08: 0000000000000001 R09: 0000000000000801 Aug 19 14:32:11 cascadia kernel: R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000014 Aug 19 14:32:11 cascadia kernel: R13: 0000000000000020 R14: ffff9bb43d882862 R15: ffff9bb453a7c300 Aug 19 14:32:11 cascadia kernel: FS: 00007f28a1043b10(0000) GS:ffff9bb45f880000(0000) knlGS:0000000000000000 Aug 19 14:32:11 cascadia kernel: CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 19 14:32:11 cascadia kernel: CR2: 000055b71d84fb10 CR3: 0000000749b5a004 CR4: 00000000003606e0 Aug 19 14:32:11 cascadia kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 Aug 19 14:32:11 cascadia kernel: DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Aug 19 14:32:11 cascadia kernel: Call Trace: Aug 19 14:32:11 cascadia kernel: <IRQ> Aug 19 14:32:11 cascadia kernel: sk_filter_trim_cap+0xcd/0x1b0 Aug 19 14:32:11 cascadia kernel: tcp_v4_rcv+0xa41/0xc20 Aug 19 14:32:11 cascadia kernel: ip_local_deliver_finish+0x63/0x1e0 Aug 19 14:32:11 cascadia kernel: ip_local_deliver+0xe0/0xf0 Aug 19 14:32:11 cascadia kernel: ? ip_sublist_rcv_finish+0x80/0x80 Aug 19 14:32:11 cascadia kernel: ip_rcv+0xbc/0xd0 Aug 19 14:32:11 cascadia kernel: ? ip_rcv_finish_core.isra.18+0x360/0x360 Aug 19 14:32:11 cascadia kernel: __netif_receive_skb_one_core+0x5a/0x80 Aug 19 14:32:11 cascadia kernel: netif_receive_skb_internal+0x2f/0xa0 Aug 19 14:32:11 cascadia kernel: napi_gro_receive+0xba/0xe0 Aug 19 14:32:11 cascadia kernel: igb_poll+0x481/0xeb0 [igb] Aug 19 14:32:11 cascadia kernel: net_rx_action+0x149/0x3b0 Aug 19 14:32:11 cascadia kernel: __do_softirq+0xde/0x2d8 Aug 19 14:32:11 cascadia kernel: irq_exit+0xba/0xc0 Aug 19 14:32:11 cascadia kernel: do_IRQ+0x7f/0xe0 Aug 19 14:32:11 cascadia kernel: common_interrupt+0xf/0xf Aug 19 14:32:11 cascadia kernel: </IRQ> Aug 19 14:32:11 cascadia kernel: RIP: 0033:0x7f28b5f3147a Aug 19 14:32:11 cascadia kernel: Code: 89 c2 48 c1 e0 02 48 8b 4d 18 39 d3 7c 0f c7 04 01 00 00 00 00 ff c2 48 83 c0 04 eb e9 8d 43 01 89 45 00 48 8b 45 18 8b 04 98 <5a> 5b 5d c3 31 c0 48 39 f1 0f 84 d6 00 00 00 66 44 8b 41 2c 41 80 Aug 19 14:32:11 cascadia kernel: RSP: 002b:00007f28a1040560 EFLAGS: 00000297 ORIG_RAX: ffffffffffffffdb Aug 19 14:32:11 cascadia kernel: RAX: 0000000000000000 RBX: 0000000000003a31 RCX: 000055b71dfb23a8 Aug 19 14:32:11 cascadia kernel: RDX: 000055b71dfb23a8 RSI: 0000000000003a31 RDI: 000055b7202930b0 Aug 19 14:32:11 cascadia kernel: RBP: 000055b7202930b0 R08: 000055b71e475e50 R09: 000055b71dfb2010 Aug 19 14:32:11 cascadia kernel: R10: 0000000000000018 R11: 000055b71df0b480 R12: 000055b71dfb23a8 Aug 19 14:32:11 cascadia kernel: R13: 000055b7212a1f10 R14: 0000000000000000 R15: 00007f28a1040790 Aug 19 14:32:11 cascadia kernel: Modules linked in: veth xt_nat xt_tcpudp xt_conntrack ipt_MASQUERADE nf_conntrack_netlink xfrm_user xfrm_algo nft_counter xt_addrtype nft_compat nft_chain_nat_ipv4 nf_nat_ipv4 nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 br_netfilter bridge stp llc rpcsec_gss_krb5 devlink nf_tables nfnetlink aufs(OE) wireguard(E) ip6_udp_tunnel udp_tunnel overlay intel_rapl sb_edac x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel pcc_cpufreq zfs(POE) kvm irqbypass zunicode(POE) intel_cstate zlua(POE) zavl(POE) intel_uncore icp(POE) ipmi_ssif mxm_wmi ast ttm drm_kms_helper intel_rapl_perf pcspkr drm intel_pch_thermal iTCO_wdt iTCO_vendor_support joydev cdc_acm evdev sg mei_me mei ioatdma ipmi_si wmi acpi_pad button nfsd auth_rpcgss nfs_acl lockd grace zcommon(POE) sunrpc znvpair(POE) spl(OE) Aug 19 14:32:11 cascadia kernel: ipmi_devintf ipmi_msghandler ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 fscrypto ecb btrfs xor zstd_decompress zstd_compress xxhash raid6_pq libcrc32c crc32c_generic algif_skcipher af_alg dm_crypt dm_mod hid_generic usbhid hid sd_mod crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel pcbc ahci xhci_pci libahci xhci_hcd mpt3sas ehci_pci libata ehci_hcd usbcore raid_class aesni_intel ixgbe scsi_transport_sas igb aes_x86_64 scsi_mod nvme crypto_simd cryptd glue_helper lpc_ich nvme_core i2c_i801 mfd_core i2c_algo_bit dca usb_common mdio Aug 19 14:32:11 cascadia kernel: ---[ end trace acf9c2d544d7fd2d ]--- Kevin Tran
