[Kernel-packages] [Bug 1837788] [NEW] bcache kernel warning when attaching device
Public bug reported: See attached dmesg, each time this server is rebooted it emits a concerning bcache warning. ProblemType: Bug DistroRelease: Ubuntu 18.04 Package: linux-image-4.15.0-54-generic 4.15.0-54.58 ProcVersionSignature: Ubuntu 4.15.0-54.58-generic 4.15.18 Uname: Linux 4.15.0-54-generic x86_64 AlsaVersion: Advanced Linux Sound Architecture Driver Version k4.15.0-54-generic. AplayDevices: Error: [Errno 2] No such file or directory: 'aplay': 'aplay' ApportVersion: 2.20.9-0ubuntu7.7 Architecture: amd64 ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord': 'arecord' AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/by-path', '/dev/snd/hwC0D2', '/dev/snd/pcmC0D2c', '/dev/snd/pcmC0D3c', '/dev/snd/pcmC0D3p', '/dev/snd/pcmC0D0c', '/dev/snd/pcmC0D0p', '/dev/snd/controlC0', '/dev/snd/hwC1D0', '/dev/snd/pcmC1D3p', '/dev/snd/controlC1', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1: Card0.Amixer.info: Error: [Errno 2] No such file or directory: 'amixer': 'amixer' Card0.Amixer.values: Error: [Errno 2] No such file or directory: 'amixer': 'amixer' Card1.Amixer.info: Error: [Errno 2] No such file or directory: 'amixer': 'amixer' Card1.Amixer.values: Error: [Errno 2] No such file or directory: 'amixer': 'amixer' Date: Wed Jul 24 12:28:06 2019 InstallationDate: Installed on 2013-10-04 (2119 days ago) InstallationMedia: Ubuntu-Server 13.10 "Saucy Salamander" - Beta amd64 (20130925.1) MachineType: Supermicro X9DAi ProcEnviron: TERM=xterm-256color PATH=(custom, no user) XDG_RUNTIME_DIR= LANG=en_US.UTF-8 SHELL=/bin/bash ProcFB: 0 EFI VGA ProcKernelCmdLine: BOOT_IMAGE=/vmlinuz-4.15.0-54-generic root=UUID=8577302d-1f37-40a6-afcd-385beb26059f ro nomodeset elevator=deadline nvme_core.default_ps_max_latency_us=0 nopti noibrs noibpb RelatedPackageVersions: linux-restricted-modules-4.15.0-54-generic N/A linux-backports-modules-4.15.0-54-generic N/A linux-firmware 1.173.9 RfKill: Error: [Errno 2] No such file or directory: 'rfkill': 'rfkill' SourcePackage: linux UpgradeStatus: Upgraded to bionic on 2018-06-09 (409 days ago) dmi.bios.date: 05/09/2015 dmi.bios.vendor: American Megatrends Inc. dmi.bios.version: 3.2 dmi.board.asset.tag: To be filled by O.E.M. dmi.board.name: X9DAi dmi.board.vendor: Supermicro dmi.board.version: 0123456789 dmi.chassis.asset.tag: To Be Filled By O.E.M. dmi.chassis.type: 3 dmi.chassis.vendor: Supermicro dmi.chassis.version: 0123456789 dmi.modalias: dmi:bvnAmericanMegatrendsInc.:bvr3.2:bd05/09/2015:svnSupermicro:pnX9DAi:pvr0123456789:rvnSupermicro:rnX9DAi:rvr0123456789:cvnSupermicro:ct3:cvr0123456789: dmi.product.family: To be filled by O.E.M. dmi.product.name: X9DAi dmi.product.version: 0123456789 dmi.sys.vendor: Supermicro ** Affects: linux (Ubuntu) Importance: Undecided Status: New ** Tags: amd64 apport-bug bionic -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1837788 Title: bcache kernel warning when attaching device Status in linux package in Ubuntu: New Bug description: See attached dmesg, each time this server is rebooted it emits a concerning bcache warning. ProblemType: Bug DistroRelease: Ubuntu 18.04 Package: linux-image-4.15.0-54-generic 4.15.0-54.58 ProcVersionSignature: Ubuntu 4.15.0-54.58-generic 4.15.18 Uname: Linux 4.15.0-54-generic x86_64 AlsaVersion: Advanced Linux Sound Architecture Driver Version k4.15.0-54-generic. AplayDevices: Error: [Errno 2] No such file or directory: 'aplay': 'aplay' ApportVersion: 2.20.9-0ubuntu7.7 Architecture: amd64 ArecordDevices: Error: [Errno 2] No such file or directory: 'arecord': 'arecord' AudioDevicesInUse: Error: command ['fuser', '-v', '/dev/snd/by-path', '/dev/snd/hwC0D2', '/dev/snd/pcmC0D2c', '/dev/snd/pcmC0D3c', '/dev/snd/pcmC0D3p', '/dev/snd/pcmC0D0c', '/dev/snd/pcmC0D0p', '/dev/snd/controlC0', '/dev/snd/hwC1D0', '/dev/snd/pcmC1D3p', '/dev/snd/controlC1', '/dev/snd/seq', '/dev/snd/timer'] failed with exit code 1: Card0.Amixer.info: Error: [Errno 2] No such file or directory: 'amixer': 'amixer' Card0.Amixer.values: Error: [Errno 2] No such file or directory: 'amixer': 'amixer' Card1.Amixer.info: Error: [Errno 2] No such file or directory: 'amixer': 'amixer' Card1.Amixer.values: Error: [Errno 2] No such file or directory: 'amixer': 'amixer' Date: Wed Jul 24 12:28:06 2019 InstallationDate: Installed on 2013-10-04 (2119 days ago) InstallationMedia: Ubuntu-Server 13.10 "Saucy Salamander" - Beta amd64 (20130925.1) MachineType: Supermicro X9DAi ProcEnviron: TERM=xterm-256color PATH=(custom, no user) XDG_RUNTIME_DIR= LANG=en_US.UTF-8 SHELL=/bin/bash ProcFB: 0 EFI VGA ProcKernelCmdLine: BOOT_IMAGE=/vmlinuz-4.15.0-54-generic root=UUID=8577302d-1f37-40a6-afcd-385beb26059f ro nomodeset elevator=deadline nvme_core.default_ps_max_latency_us=0 nopti noibrs no
[Kernel-packages] [Bug 1576297] Re: BTRFS Page allocation failure with Bacula.
Spoke too soon, though it may be a slightly different issue, but still appears to be BTRFS related. This is still on 4.6.0-040600rc6-generic, the memory on this server is 1GB. [121025.879323] SLUB: Unable to allocate memory on node -1, gfp=0x2080020(GFP_ATOMIC) [121025.879324] cache: kmalloc-256, object size: 256, buffer size: 256, default order: 0, min order: 0 [121025.879324] node 0: slabs: 148, objs: 2368, free: 0 [121025.879517] kworker/u4:2: page allocation failure: order:0, mode:0x2200020(GFP_NOWAIT|__GFP_HIGH|__GFP_NOTRACK) [121025.879519] CPU: 1 PID: 9038 Comm: kworker/u4:2 Not tainted 4.6.0-040600rc6-generic #201605012031 [121025.879520] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 [121025.879572] Workqueue: btrfs-worker btrfs_worker_helper [btrfs] [121025.879574] 0086 d14aff48 88003fd03960 813ef3b3 [121025.879576] 88003fd039f0 8119b3d4 [121025.879577] 0220002079d790e3 88003fffb6e0 82110ae0 0060 [121025.879579] Call Trace: [121025.879580][] dump_stack+0x63/0x90 [121025.879584] [] warn_alloc_failed+0x104/0x160 [121025.879586] [] __alloc_pages_nodemask+0x4f9/0xc30 [121025.879588] [] ? vprintk_emit+0x2a1/0x4d0 [121025.879590] [] alloc_pages_current+0x8c/0x110 [121025.879592] [] new_slab+0x452/0x5c0 [121025.879593] [] ___slab_alloc+0x249/0x480 [121025.879595] [] ? __build_skb+0x2a/0xe0 [121025.879596] [] ? __build_skb+0x2a/0xe0 [121025.879598] [] __slab_alloc+0x20/0x40 [121025.879599] [] kmem_cache_alloc+0x192/0x1d0 [121025.879600] [] ? __build_skb+0x2a/0xe0 [121025.879601] [] __build_skb+0x2a/0xe0 [121025.879603] [] __napi_alloc_skb+0x98/0xd0 [121025.879605] [] page_to_skb.isra.28+0x66/0x310 [121025.879607] [] virtnet_receive+0x2df/0xa00 [121025.879609] [] ? update_rq_clock.part.81+0x18/0x40 [121025.879610] [] virtnet_poll+0x1d/0x80 [121025.879612] [] net_rx_action+0x225/0x360 [121025.879615] [] __do_softirq+0xf6/0x27e [121025.879616] [] irq_exit+0xa3/0xb0 [121025.879617] [] do_IRQ+0x54/0xd0 [121025.879619] [] common_interrupt+0x82/0x82 [121025.879619][] ? shrink_inactive_list+0x199/0x500 [121025.879623] [] ? shrink_inactive_list+0x405/0x500 [121025.879626] [] shrink_zone_memcg+0x5ad/0x7a0 [121025.879627] [] ? shrink_slab.part.39+0x240/0x3e0 [121025.879634] [] ? css_next_descendant_pre+0x4c/0x60 [121025.879636] [] ? css_next_descendant_pre+0x4c/0x60 [121025.879638] [] shrink_zone+0xe0/0x300 [121025.879640] [] do_try_to_free_pages+0x17e/0x430 [121025.879642] [] try_to_free_pages+0xce/0x180 [121025.879644] [] __alloc_pages_nodemask+0x5c4/0xc30 [121025.879646] [] ? set_next_entity+0x49/0xd0 [121025.879647] [] alloc_pages_current+0x8c/0x110 [121025.879649] [] new_slab+0x452/0x5c0 [121025.879651] [] ___slab_alloc+0x249/0x480 [121025.879661] [] ? btrfs_csum_one_bio+0x6a/0x430 [btrfs] [121025.879668] [] ? chksum_update+0x17/0x20 [121025.879669] [] ? crypto_shash_update+0x30/0xe0 [121025.879679] [] ? btrfs_csum_one_bio+0x6a/0x430 [btrfs] [121025.879681] [] __slab_alloc+0x20/0x40 [121025.879682] [] __kmalloc+0x1c4/0x230 [121025.879691] [] ? run_one_async_free+0x20/0x20 [btrfs] [121025.879700] [] btrfs_csum_one_bio+0x6a/0x430 [btrfs] [121025.879709] [] ? run_one_async_free+0x20/0x20 [btrfs] [121025.879718] [] __btrfs_submit_bio_start+0x1d/0x30 [btrfs] [121025.879727] [] run_one_async_start+0x26/0x30 [btrfs] [121025.879738] [] btrfs_scrubparity_helper+0xca/0x2e0 [btrfs] [121025.879749] [] btrfs_worker_helper+0xe/0x10 [btrfs] [121025.879753] [] process_one_work+0x168/0x480 [121025.879755] [] worker_thread+0x4b/0x500 [121025.879757] [] ? process_one_work+0x480/0x480 [121025.879758] [] kthread+0xd8/0xf0 [121025.879760] [] ret_from_fork+0x22/0x40 [121025.879763] [] ? kthread_create_on_node+0x1a0/0x1a0 [121025.879764] Mem-Info: [121025.879766] active_anon:18131 inactive_anon:23781 isolated_anon:0 active_file:84105 inactive_file:84587 isolated_file:19 unevictable:1762 dirty:869 writeback:23497 unstable:0 slab_reclaimable:25801 slab_unreclaimable:5224 mapped:33650 shmem:34217 pagetables:1605 bounce:0 free:1897 free_pcp:20 free_cma:0 [121025.879769] Node 0 DMA free:3920kB min:60kB low:72kB high:84kB active_anon:188kB inactive_anon:1324kB active_file:2540kB inactive_file:2664kB unevictable:112kB isolated(anon):0kB isolated(file):0kB present:15992kB managed:15908kB mlocked:112kB dirty:0kB writeback:80kB mapped:884kB shmem:1356kB slab_reclaimable:2296kB slab_unreclaimable:284kB kernel_stack:64kB pagetables:80kB unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no [121025.879772] lowmem_reserve[]: 0 973 973 973 973 [121025.879775] Node 0 DMA32 free:3668kB min:3824kB low:4820kB high:5816kB active_anon:72336kB inactive_anon:93800kB active_file:333880kB inactive_file:335684kB unevictable
[Kernel-packages] [Bug 1576297] Re: BTRFS Page allocation failure with Bacula.
I can confirm after a couple days running 4.6.0-040600rc6-generic, the error messages no longer appear. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1576297 Title: BTRFS Page allocation failure with Bacula. Status in linux package in Ubuntu: Incomplete Bug description: As soon as bacula starts running I see the below errors in the kernel log, and the server eventually hangs at some point. I'm backing up our servers to a local BTRFS volume on a local drive, nothing fancy and it used to work really well in Ubuntu 14.04. Apr 27 21:05:18 backup kernel: [343463.805173] kworker/u4:5: page allocation failure: order:0, mode:0x2204020 Apr 27 21:05:18 backup kernel: [343463.805178] CPU: 1 PID: 19811 Comm: kworker/u4:5 Not tainted 4.4.0-21-generic #37-Ubuntu Apr 27 21:05:18 backup kernel: [343463.805179] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 Apr 27 21:05:18 backup kernel: [343463.805199] Workqueue: btrfs-submit btrfs_submit_helper [btrfs] Apr 27 21:05:18 backup kernel: [343463.805201] 0086 5236f502 880019f2b548 813e93c3 Apr 27 21:05:18 backup kernel: [343463.805203] 02204020 880019f2b5d8 81192fba Apr 27 21:05:18 backup kernel: [343463.805205] 88007fff9d40 88007fffb6e0 0060 Apr 27 21:05:18 backup kernel: [343463.805206] Call Trace: Apr 27 21:05:18 backup kernel: [343463.805211] [] dump_stack+0x63/0x90 Apr 27 21:05:18 backup kernel: [343463.805214] [] warn_alloc_failed+0xfa/0x150 Apr 27 21:05:18 backup kernel: [343463.805217] [] __alloc_pages_nodemask+0x341/0xb60 Apr 27 21:05:18 backup kernel: [343463.805220] [] alloc_pages_current+0x8c/0x110 Apr 27 21:05:18 backup kernel: [343463.805222] [] new_slab+0x28f/0x490 Apr 27 21:05:18 backup kernel: [343463.805224] [] ___slab_alloc+0x22b/0x460 Apr 27 21:05:18 backup kernel: [343463.805227] [] ? alloc_indirect.isra.4+0x1d/0x50 Apr 27 21:05:18 backup kernel: [343463.805228] [] ? alloc_indirect.isra.4+0x1d/0x50 Apr 27 21:05:18 backup kernel: [343463.805230] [] __slab_alloc+0x20/0x40 Apr 27 21:05:18 backup kernel: [343463.805231] [] __kmalloc+0x1d5/0x250 Apr 27 21:05:18 backup kernel: [343463.805233] [] alloc_indirect.isra.4+0x1d/0x50 Apr 27 21:05:18 backup kernel: [343463.805234] [] virtqueue_add_sgs+0x2ca/0x3a0 Apr 27 21:05:18 backup kernel: [343463.805237] [] __virtblk_add_req+0xbd/0x220 Apr 27 21:05:18 backup kernel: [343463.805239] [] ? mempool_alloc_slab+0x15/0x20 Apr 27 21:05:18 backup kernel: [343463.805242] [] ? blk_rq_map_sg+0x223/0x570 Apr 27 21:05:18 backup kernel: [343463.805243] [] virtio_queue_rq+0x112/0x280 Apr 27 21:05:18 backup kernel: [343463.805245] [] __blk_mq_run_hw_queue+0x1d6/0x380 Apr 27 21:05:18 backup kernel: [343463.805247] [] blk_mq_run_hw_queue+0x8e/0xb0 Apr 27 21:05:18 backup kernel: [343463.805248] [] blk_mq_insert_requests+0xf6/0x1c0 Apr 27 21:05:18 backup kernel: [343463.805250] [] blk_mq_flush_plug_list+0x128/0x150 Apr 27 21:05:18 backup kernel: [343463.805251] [] blk_flush_plug_list+0xd6/0x240 Apr 27 21:05:18 backup kernel: [343463.805253] [] blk_finish_plug+0x2c/0x40 Apr 27 21:05:18 backup kernel: [343463.805264] [] run_scheduled_bios+0x363/0x530 [btrfs] Apr 27 21:05:18 backup kernel: [343463.805275] [] pending_bios_fn+0x15/0x20 [btrfs] Apr 27 21:05:18 backup kernel: [343463.805285] [] btrfs_scrubparity_helper+0xca/0x2f0 [btrfs] Apr 27 21:05:18 backup kernel: [343463.805294] [] btrfs_submit_helper+0xe/0x10 [btrfs] Apr 27 21:05:18 backup kernel: [343463.805297] [] process_one_work+0x162/0x480 Apr 27 21:05:18 backup kernel: [343463.805298] [] worker_thread+0x4b/0x4c0 Apr 27 21:05:18 backup kernel: [343463.805300] [] ? process_one_work+0x480/0x480 Apr 27 21:05:18 backup kernel: [343463.805301] [] ? process_one_work+0x480/0x480 Apr 27 21:05:18 backup kernel: [343463.805303] [] kthread+0xd8/0xf0 Apr 27 21:05:18 backup kernel: [343463.805305] [] ? kthread_create_on_node+0x1e0/0x1e0 Apr 27 21:05:18 backup kernel: [343463.805308] [] ret_from_fork+0x3f/0x70 Apr 27 21:05:18 backup kernel: [343463.805309] [] ? kthread_create_on_node+0x1e0/0x1e0 Apr 27 21:05:18 backup kernel: [343463.805310] Mem-Info: Apr 27 21:05:18 backup kernel: [343463.805313] active_anon:43184 inactive_anon:51940 isolated_anon:0 Apr 27 21:05:18 backup kernel: [343463.805313] active_file:123451 inactive_file:249283 isolated_file:0 Apr 27 21:05:18 backup kernel: [343463.805313] unevictable:1752 dirty:32219 writeback:6149 unstable:0 Apr 27 21:05:18 backup kernel: [343463.805313] slab_reclaimable:18341 slab_unreclaimable:4095 Apr 27 21:05:18 backup kernel: [343463.805313] mapped:58659 shmem:79658 pagetables:1755 bounce:0 Apr 27 21:05:18 backup kernel: [343463.80531
[Kernel-packages] [Bug 1576297] Re: BTRFS Page allocation failure with Bacula.
Okay, I have installed 4.6 and ran a manual backup job, no error messages yet. I will let it run overnight and let you know the results tomorrow. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1576297 Title: BTRFS Page allocation failure with Bacula. Status in linux package in Ubuntu: Incomplete Bug description: As soon as bacula starts running I see the below errors in the kernel log, and the server eventually hangs at some point. I'm backing up our servers to a local BTRFS volume on a local drive, nothing fancy and it used to work really well in Ubuntu 14.04. Apr 27 21:05:18 backup kernel: [343463.805173] kworker/u4:5: page allocation failure: order:0, mode:0x2204020 Apr 27 21:05:18 backup kernel: [343463.805178] CPU: 1 PID: 19811 Comm: kworker/u4:5 Not tainted 4.4.0-21-generic #37-Ubuntu Apr 27 21:05:18 backup kernel: [343463.805179] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 Apr 27 21:05:18 backup kernel: [343463.805199] Workqueue: btrfs-submit btrfs_submit_helper [btrfs] Apr 27 21:05:18 backup kernel: [343463.805201] 0086 5236f502 880019f2b548 813e93c3 Apr 27 21:05:18 backup kernel: [343463.805203] 02204020 880019f2b5d8 81192fba Apr 27 21:05:18 backup kernel: [343463.805205] 88007fff9d40 88007fffb6e0 0060 Apr 27 21:05:18 backup kernel: [343463.805206] Call Trace: Apr 27 21:05:18 backup kernel: [343463.805211] [] dump_stack+0x63/0x90 Apr 27 21:05:18 backup kernel: [343463.805214] [] warn_alloc_failed+0xfa/0x150 Apr 27 21:05:18 backup kernel: [343463.805217] [] __alloc_pages_nodemask+0x341/0xb60 Apr 27 21:05:18 backup kernel: [343463.805220] [] alloc_pages_current+0x8c/0x110 Apr 27 21:05:18 backup kernel: [343463.805222] [] new_slab+0x28f/0x490 Apr 27 21:05:18 backup kernel: [343463.805224] [] ___slab_alloc+0x22b/0x460 Apr 27 21:05:18 backup kernel: [343463.805227] [] ? alloc_indirect.isra.4+0x1d/0x50 Apr 27 21:05:18 backup kernel: [343463.805228] [] ? alloc_indirect.isra.4+0x1d/0x50 Apr 27 21:05:18 backup kernel: [343463.805230] [] __slab_alloc+0x20/0x40 Apr 27 21:05:18 backup kernel: [343463.805231] [] __kmalloc+0x1d5/0x250 Apr 27 21:05:18 backup kernel: [343463.805233] [] alloc_indirect.isra.4+0x1d/0x50 Apr 27 21:05:18 backup kernel: [343463.805234] [] virtqueue_add_sgs+0x2ca/0x3a0 Apr 27 21:05:18 backup kernel: [343463.805237] [] __virtblk_add_req+0xbd/0x220 Apr 27 21:05:18 backup kernel: [343463.805239] [] ? mempool_alloc_slab+0x15/0x20 Apr 27 21:05:18 backup kernel: [343463.805242] [] ? blk_rq_map_sg+0x223/0x570 Apr 27 21:05:18 backup kernel: [343463.805243] [] virtio_queue_rq+0x112/0x280 Apr 27 21:05:18 backup kernel: [343463.805245] [] __blk_mq_run_hw_queue+0x1d6/0x380 Apr 27 21:05:18 backup kernel: [343463.805247] [] blk_mq_run_hw_queue+0x8e/0xb0 Apr 27 21:05:18 backup kernel: [343463.805248] [] blk_mq_insert_requests+0xf6/0x1c0 Apr 27 21:05:18 backup kernel: [343463.805250] [] blk_mq_flush_plug_list+0x128/0x150 Apr 27 21:05:18 backup kernel: [343463.805251] [] blk_flush_plug_list+0xd6/0x240 Apr 27 21:05:18 backup kernel: [343463.805253] [] blk_finish_plug+0x2c/0x40 Apr 27 21:05:18 backup kernel: [343463.805264] [] run_scheduled_bios+0x363/0x530 [btrfs] Apr 27 21:05:18 backup kernel: [343463.805275] [] pending_bios_fn+0x15/0x20 [btrfs] Apr 27 21:05:18 backup kernel: [343463.805285] [] btrfs_scrubparity_helper+0xca/0x2f0 [btrfs] Apr 27 21:05:18 backup kernel: [343463.805294] [] btrfs_submit_helper+0xe/0x10 [btrfs] Apr 27 21:05:18 backup kernel: [343463.805297] [] process_one_work+0x162/0x480 Apr 27 21:05:18 backup kernel: [343463.805298] [] worker_thread+0x4b/0x4c0 Apr 27 21:05:18 backup kernel: [343463.805300] [] ? process_one_work+0x480/0x480 Apr 27 21:05:18 backup kernel: [343463.805301] [] ? process_one_work+0x480/0x480 Apr 27 21:05:18 backup kernel: [343463.805303] [] kthread+0xd8/0xf0 Apr 27 21:05:18 backup kernel: [343463.805305] [] ? kthread_create_on_node+0x1e0/0x1e0 Apr 27 21:05:18 backup kernel: [343463.805308] [] ret_from_fork+0x3f/0x70 Apr 27 21:05:18 backup kernel: [343463.805309] [] ? kthread_create_on_node+0x1e0/0x1e0 Apr 27 21:05:18 backup kernel: [343463.805310] Mem-Info: Apr 27 21:05:18 backup kernel: [343463.805313] active_anon:43184 inactive_anon:51940 isolated_anon:0 Apr 27 21:05:18 backup kernel: [343463.805313] active_file:123451 inactive_file:249283 isolated_file:0 Apr 27 21:05:18 backup kernel: [343463.805313] unevictable:1752 dirty:32219 writeback:6149 unstable:0 Apr 27 21:05:18 backup kernel: [343463.805313] slab_reclaimable:18341 slab_unreclaimable:4095 Apr 27 21:05:18 backup kernel: [343463.805313] mapped:58659 shmem:79658 pagetables:1755 bounce:0
[Kernel-packages] [Bug 1576297] [NEW] BTRFS Page allocation failure with Bacula.
Public bug reported: As soon as bacula starts running I see the below errors in the kernel log, and the server eventually hangs at some point. I'm backing up our servers to a local BTRFS volume on a local drive, nothing fancy and it used to work really well in Ubuntu 14.04. Apr 27 21:05:18 backup kernel: [343463.805173] kworker/u4:5: page allocation failure: order:0, mode:0x2204020 Apr 27 21:05:18 backup kernel: [343463.805178] CPU: 1 PID: 19811 Comm: kworker/u4:5 Not tainted 4.4.0-21-generic #37-Ubuntu Apr 27 21:05:18 backup kernel: [343463.805179] Hardware name: Bochs Bochs, BIOS Bochs 01/01/2011 Apr 27 21:05:18 backup kernel: [343463.805199] Workqueue: btrfs-submit btrfs_submit_helper [btrfs] Apr 27 21:05:18 backup kernel: [343463.805201] 0086 5236f502 880019f2b548 813e93c3 Apr 27 21:05:18 backup kernel: [343463.805203] 02204020 880019f2b5d8 81192fba Apr 27 21:05:18 backup kernel: [343463.805205] 88007fff9d40 88007fffb6e0 0060 Apr 27 21:05:18 backup kernel: [343463.805206] Call Trace: Apr 27 21:05:18 backup kernel: [343463.805211] [] dump_stack+0x63/0x90 Apr 27 21:05:18 backup kernel: [343463.805214] [] warn_alloc_failed+0xfa/0x150 Apr 27 21:05:18 backup kernel: [343463.805217] [] __alloc_pages_nodemask+0x341/0xb60 Apr 27 21:05:18 backup kernel: [343463.805220] [] alloc_pages_current+0x8c/0x110 Apr 27 21:05:18 backup kernel: [343463.805222] [] new_slab+0x28f/0x490 Apr 27 21:05:18 backup kernel: [343463.805224] [] ___slab_alloc+0x22b/0x460 Apr 27 21:05:18 backup kernel: [343463.805227] [] ? alloc_indirect.isra.4+0x1d/0x50 Apr 27 21:05:18 backup kernel: [343463.805228] [] ? alloc_indirect.isra.4+0x1d/0x50 Apr 27 21:05:18 backup kernel: [343463.805230] [] __slab_alloc+0x20/0x40 Apr 27 21:05:18 backup kernel: [343463.805231] [] __kmalloc+0x1d5/0x250 Apr 27 21:05:18 backup kernel: [343463.805233] [] alloc_indirect.isra.4+0x1d/0x50 Apr 27 21:05:18 backup kernel: [343463.805234] [] virtqueue_add_sgs+0x2ca/0x3a0 Apr 27 21:05:18 backup kernel: [343463.805237] [] __virtblk_add_req+0xbd/0x220 Apr 27 21:05:18 backup kernel: [343463.805239] [] ? mempool_alloc_slab+0x15/0x20 Apr 27 21:05:18 backup kernel: [343463.805242] [] ? blk_rq_map_sg+0x223/0x570 Apr 27 21:05:18 backup kernel: [343463.805243] [] virtio_queue_rq+0x112/0x280 Apr 27 21:05:18 backup kernel: [343463.805245] [] __blk_mq_run_hw_queue+0x1d6/0x380 Apr 27 21:05:18 backup kernel: [343463.805247] [] blk_mq_run_hw_queue+0x8e/0xb0 Apr 27 21:05:18 backup kernel: [343463.805248] [] blk_mq_insert_requests+0xf6/0x1c0 Apr 27 21:05:18 backup kernel: [343463.805250] [] blk_mq_flush_plug_list+0x128/0x150 Apr 27 21:05:18 backup kernel: [343463.805251] [] blk_flush_plug_list+0xd6/0x240 Apr 27 21:05:18 backup kernel: [343463.805253] [] blk_finish_plug+0x2c/0x40 Apr 27 21:05:18 backup kernel: [343463.805264] [] run_scheduled_bios+0x363/0x530 [btrfs] Apr 27 21:05:18 backup kernel: [343463.805275] [] pending_bios_fn+0x15/0x20 [btrfs] Apr 27 21:05:18 backup kernel: [343463.805285] [] btrfs_scrubparity_helper+0xca/0x2f0 [btrfs] Apr 27 21:05:18 backup kernel: [343463.805294] [] btrfs_submit_helper+0xe/0x10 [btrfs] Apr 27 21:05:18 backup kernel: [343463.805297] [] process_one_work+0x162/0x480 Apr 27 21:05:18 backup kernel: [343463.805298] [] worker_thread+0x4b/0x4c0 Apr 27 21:05:18 backup kernel: [343463.805300] [] ? process_one_work+0x480/0x480 Apr 27 21:05:18 backup kernel: [343463.805301] [] ? process_one_work+0x480/0x480 Apr 27 21:05:18 backup kernel: [343463.805303] [] kthread+0xd8/0xf0 Apr 27 21:05:18 backup kernel: [343463.805305] [] ? kthread_create_on_node+0x1e0/0x1e0 Apr 27 21:05:18 backup kernel: [343463.805308] [] ret_from_fork+0x3f/0x70 Apr 27 21:05:18 backup kernel: [343463.805309] [] ? kthread_create_on_node+0x1e0/0x1e0 Apr 27 21:05:18 backup kernel: [343463.805310] Mem-Info: Apr 27 21:05:18 backup kernel: [343463.805313] active_anon:43184 inactive_anon:51940 isolated_anon:0 Apr 27 21:05:18 backup kernel: [343463.805313] active_file:123451 inactive_file:249283 isolated_file:0 Apr 27 21:05:18 backup kernel: [343463.805313] unevictable:1752 dirty:32219 writeback:6149 unstable:0 Apr 27 21:05:18 backup kernel: [343463.805313] slab_reclaimable:18341 slab_unreclaimable:4095 Apr 27 21:05:18 backup kernel: [343463.805313] mapped:58659 shmem:79658 pagetables:1755 bounce:0 Apr 27 21:05:18 backup kernel: [343463.805313] free:12908 free_pcp:138 free_cma:0 Apr 27 21:05:18 backup kernel: [343463.805315] Node 0 DMA free:9992kB min:40kB low:48kB high:60kB active_anon:28kB inactive_anon:396kB active_file:256kB inactive_file:884kB unevictable:92kB isolated(anon):0kB isolated(file):0kB present:15992kB managed:15908kB mlocked:92kB dirty:936kB writeback:0kB mapped:60kB shmem:316kB slab_reclaimable:3424kB slab_unreclaimable:308kB kernel_stack:192kB pagetables:60kB unstable:0kB bounce:0