On Tue, Apr 11, 2017 at 06:15:02PM +0200, Adam Borowski wrote: > On Tue, Apr 11, 2017 at 09:15:31AM +0200, Marc Haber wrote: > > I have wrecked another btrfs file system, probably for good this time. > > > > It's a 80 GB filesystem from 2015, in my secondary notebook, on an > > encrypted SSD. The btrfs holds the root filesystem and the rest of the > > system as well. > > > > I have a cronjob that makes snapshots of the system directories daily, > > and of /home every ten minutes. A second cronjob cleans up old snapshots > > so that the number of snapshots present is about between 400 and 600. > > This is the key feature that made me decide for btrfs in the first > > place. > > > > Last week (I was on kernel 4.10.8 with Debian unstable), I was forced to > > promote the secondary laptop to the primary one which resulted in > > serious work being done on the first time. Over time, the filesystem > > filled up without me noticing and was finally 100% full. > > CoW and log-structured filesystems in general tend to take 100% full > conditions far worse than traditional filesystems, but it still should > result only in performance degradation and/or metadata-vs-data issues rather > than a fatal error. So if this is the cause, you obviously hit a bug.
Given that btrfs has a reputation of not gracefully handling out of space situations, the trouble was expected. > > I then cleaned up about four gigs by deleting a couple of redundant ISO > > images and some snapshots that were not due for regular deletion yet. I > > then started a btrfs balance / -d50, unfortunately without stopping the > > snapshot-making cronjob. This resulted in the notebook becoming > > unuseable for extended periods of time, without even being able to log > > in. After running for some 30 hours, the notebook ran out of battery > > (don't ask, stupid me). > > Ouch, this is generally harmless unless your disk lies about barriers. > Btrfs absolutely depends on them, and tends to suffer catastrophic > corruption if writes were reordered when they shouldn't. So if the disk would actually lie, I would have had much trouble even earlier. It's an SSD from 2013 or 2014, I think from Kingston. The box is offline and remote at the moment, so I cannot give the exact type. Between the btrfs and the actual disk there was a dm-crypt/LUKS layer and LVM, but I can reproduce the crash from an image on a different host now. > Even in such a case, using an older root would help, although that > possibility is almost certainly gone now. How would I try that? A pointer to the docs is fine. > > After rebooting, the btrfs balance proceeded immediately after mounting > > the root fs. System unuseable again. After a day, I finally had a root > > shell and was able to issue a btrfs cancel /. Unfortunately, the system > > didn't care about that command and happily continued to balance. After > > some more 30 hours, I lost patience and resetted the system. > > Mounting with -o skip_balance may help. No, same issue. > Two years old is not much, the format nor its use hasn't changed noticeably > since then. You run the very latest upstream stable kernel, with its almost > freshest version (4.10.9 was tagged Saturday). 400-600 snapshots is nothing > remarkable, it's the usual range. The only thing differing from the most > typical usage is your snapshot frequency, and even that is nothing > frightening. Doesn't SuSE's snapper do snapshots every ten minutes? I can reproduce the crash on 4.10.10 now. > Thus, a failure like yours in mainstream use is certainly interesting. > > However, I have a piece of advice for now: could you make a copy of the > filesystem? 80GB is _nothing_: it's way below the accuracy of du -h on a > modern HDD, and not a burden for a typical SSD. Being able to investigate > it from a bigger machine would be convenient, and having a copy would let > you use dangerous rescue methods without any risk. And debugging oopses on > a laptop with no working serial or netconsole sucks; if you have no other > machine at hand then running the victim kernel in qemu-kvm might offer a > poor-man's console. qemu-kvm is also a good idea, up to now I have logs from a physical box mounting the btrfs image loopback. > For advice for your specific case, we can't do much without seeing the > actual error messages. I do have a dd copy of the device now. $ sudo losetup --find --show ./dropbtr0.btrfs $ sudo mount -o skip_balance -t btrfs /dev/loop0 /mnt/tempdisk does immediately result in: Apr 12 22:37:48 fan kernel: [ 124.742104] loop: module loaded Apr 12 22:37:48 fan kernel: [ 124.784727] BTRFS: device label dropbtr0 devid 1 transid 1530529 /dev/loop0 Apr 12 22:38:07 fan kernel: [ 143.120268] BTRFS info (device loop0): disk space caching is enabled Apr 12 22:38:07 fan kernel: [ 143.207872] BUG: unable to handle kernel NULL pointer dereference at 00000000000001f0 Apr 12 22:38:07 fan kernel: [ 143.223536] IP: can_overcommit+0x20/0x100 [btrfs] Apr 12 22:38:07 fan kernel: [ 143.232936] PGD 0 Apr 12 22:38:07 fan kernel: [ 143.232936] Apr 12 22:38:07 fan kernel: [ 143.239939] Oops: 0000 [#1] SMP Apr 12 22:38:07 fan kernel: [ 143.246211] Modules linked in: loop ebtable_filter ebtables ip6table_filter ip6_tables cpufreq_conservative cpufreq_userspace cpufreq_powersave bridge stp llc iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack amd64_edac_mod edac_mce_amd edac_core snd_hda_codec_realtek snd_hda_codec_generic kvm_amd ipt_REJECT nf_reject_ipv4 snd_hda_codec_hdmi kvm snd_hda_intel xt_tcpudp snd_cmipci snd_hda_codec snd_mpu401_uart snd_hda_core snd_opl3_lib snd_rawmidi snd_hwdep irqbypass input_leds snd_seq_device pcspkr k10temp snd_pcm_oss snd_mixer_oss sg iptable_filter snd_pcm snd_timer snd soundcore asus_atk0110 shpchp acpi_cpufreq evdev tpm_tis tpm_tis_core tpm ip_tables x_tables autofs4 btrfs ext4 crc16 jbd2 fscrypto mbcache ecb crypto_simd glue_helper cryptd aes_x86_64 xts gf128mul algif_skcipher Apr 12 22:38:07 fan kernel: [ 143.388923] af_alg dm_crypt raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c crc32c_generic raid1 raid0 multipath linear md_mod hid_generic usbhid hid usb_storage dm_mod sr_mod cdrom sd_mod ohci_pci amdkfd radeon r8169 mii ahci libahci i2c_algo_bit ttm sym53c8xx xhci_pci drm_kms_helper ohci_hcd ehci_pci scsi_transport_spi libata xhci_hcd i2c_piix4 ehci_hcd drm usbcore scsi_mod usb_common i2c_core button Apr 12 22:38:07 fan kernel: [ 143.468706] CPU: 1 PID: 145 Comm: kworker/u16:3 Not tainted 4.10.10-zgws1 #2 Apr 12 22:38:07 fan kernel: [ 143.482779] Hardware name: System manufacturer System Product Name/M5A88-V EVO, BIOS 1603 10/12/2012 Apr 12 22:38:07 fan kernel: [ 143.501548] Workqueue: events_unbound btrfs_async_reclaim_metadata_space [btrfs] Apr 12 22:38:07 fan kernel: [ 143.516314] task: ffff88041a2bae40 task.stack: ffffc90001f9c000 Apr 12 22:38:07 fan kernel: [ 143.528147] RIP: 0010:can_overcommit+0x20/0x100 [btrfs] Apr 12 22:38:07 fan kernel: [ 143.538570] RSP: 0018:ffffc90001f9fde8 EFLAGS: 00010296 Apr 12 22:38:07 fan kernel: [ 143.549004] RAX: 0000000001000000 RBX: ffff8803f24dbe00 RCX: 0000000000000002 Apr 12 22:38:07 fan kernel: [ 143.563251] RDX: 0000000000600000 RSI: 0000000000000000 RDI: 0000000000000000 Apr 12 22:38:07 fan kernel: [ 143.577496] RBP: ffff8803f24dbe00 R08: 0000000000000000 R09: 0000000000000000 Apr 12 22:38:07 fan kernel: [ 143.591744] R10: ffff88042fc52780 R11: 0000002157da2b60 R12: 0000000000600000 Apr 12 22:38:07 fan kernel: [ 143.605990] R13: ffff88017fc0b800 R14: 0000000000000000 R15: ffff8803f24dbeb8 Apr 12 22:38:07 fan kernel: [ 143.620238] FS: 0000000000000000(0000) GS:ffff88042fc40000(0000) knlGS:0000000000000000 Apr 12 22:38:07 fan kernel: [ 143.636391] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Apr 12 22:38:07 fan kernel: [ 143.647866] CR2: 00000000000001f0 CR3: 00000003fc3e0000 CR4: 00000000000006e0 Apr 12 22:38:07 fan kernel: [ 143.662112] Call Trace: Apr 12 22:38:07 fan kernel: [ 143.667016] ? btrfs_async_reclaim_metadata_space+0x371/0x440 [btrfs] Apr 12 22:38:07 fan kernel: [ 143.679882] ? process_one_work+0x17d/0x460 Apr 12 22:38:07 fan kernel: [ 143.688232] ? worker_thread+0x48/0x490 Apr 12 22:38:07 fan kernel: [ 143.695895] ? kthread+0xef/0x120 Apr 12 22:38:07 fan kernel: [ 143.702514] ? process_one_work+0x460/0x460 Apr 12 22:38:07 fan kernel: [ 143.710870] ? kthread_create_on_node+0x40/0x40 Apr 12 22:38:07 fan kernel: [ 143.719919] ? ret_from_fork+0x26/0x40 Apr 12 22:38:07 fan kernel: [ 143.727403] Code: 90 66 2e 0f 1f 84 00 00 00 00 00 f6 46 58 01 0f 85 ef 00 00 00 41 57 41 56 41 55 41 54 49 89 d4 55 53 48 89 f3 31 f6 48 83 ec 08 <4c> 8b bf f0 01 00 00 89 4c 24 04 49 3b 7f 38 4d 8d af 48 01 00 Apr 12 22:38:07 fan kernel: [ 143.765077] RIP: can_overcommit+0x20/0x100 [btrfs] RSP: ffffc90001f9fde8 Apr 12 22:38:07 fan kernel: [ 143.778445] CR2: 00000000000001f0 Apr 12 22:38:07 fan kernel: [ 143.804936] ---[ end trace e2274712b9039680 ]--- and a few seconds later Apr 12 22:38:29 fan kernel: [ 164.826083] INFO: rcu_sched self-detected stall on CPU Apr 12 22:38:29 fan kernel: [ 164.830123] INFO: rcu_sched detected stalls on CPUs/tasks: Apr 12 22:38:29 fan kernel: [ 164.830137] 4-...: (5250 ticks this GP) idle=03b/140000000000001/0 softirq=8337/8337 fqs=2498 Apr 12 22:38:29 fan kernel: [ 164.830138] (detected by 2, t=5252 jiffies, g=4002, c=4001, q=2016) Apr 12 22:38:29 fan kernel: [ 164.830145] Task dump for CPU 4: Apr 12 22:38:29 fan kernel: [ 164.830147] mount R running task 0 4874 4870 0x00000008 Apr 12 22:38:29 fan kernel: [ 164.830153] Call Trace: Apr 12 22:38:29 fan kernel: [ 164.830168] ? __alloc_pages_nodemask+0xea/0x240 Apr 12 22:38:29 fan kernel: [ 164.830178] ? chksum_update+0xe/0x15 [crc32c_generic] Apr 12 22:38:29 fan kernel: [ 164.830184] ? crypto_shash_update+0x3a/0x110 Apr 12 22:38:29 fan kernel: [ 164.830189] ? cache_grow_end+0x119/0x140 Apr 12 22:38:29 fan kernel: [ 164.830233] ? __load_free_space_cache+0x1cb/0x6b0 [btrfs] Apr 12 22:38:29 fan kernel: [ 164.830266] ? setup_cluster_no_bitmap+0x167/0x2c0 [btrfs] Apr 12 22:38:29 fan kernel: [ 164.830299] ? tree_insert_offset+0x8c/0xd0 [btrfs] Apr 12 22:38:29 fan kernel: [ 164.830331] ? setup_cluster_no_bitmap+0x19a/0x2c0 [btrfs] Apr 12 22:38:29 fan kernel: [ 164.830338] ? native_queued_spin_lock_slowpath+0x16b/0x190 Apr 12 22:38:29 fan kernel: [ 164.830344] ? _raw_spin_lock+0x18/0x20 Apr 12 22:38:29 fan kernel: [ 164.830374] ? find_free_extent.isra.67+0xa21/0x1110 [btrfs] Apr 12 22:38:29 fan kernel: [ 164.830404] ? btrfs_reserve_extent+0xa6/0x210 [btrfs] Apr 12 22:38:29 fan kernel: [ 164.830432] ? btrfs_alloc_tree_block+0x109/0x4b0 [btrfs] Apr 12 22:38:29 fan kernel: [ 164.830458] ? __btrfs_cow_block+0x144/0x570 [btrfs] Apr 12 22:38:29 fan kernel: [ 164.830484] ? btrfs_cow_block+0xf9/0x1a0 [btrfs] Apr 12 22:38:29 fan kernel: [ 164.830510] ? btrfs_search_slot+0x1fa/0xa00 [btrfs] Apr 12 22:38:29 fan kernel: [ 164.830514] ? cache_grow_end+0x119/0x140 Apr 12 22:38:29 fan kernel: [ 164.830547] ? btrfs_truncate_inode_items+0x188/0xe30 [btrfs] Apr 12 22:38:29 fan kernel: [ 164.830581] ? btrfs_evict_inode+0x478/0x590 [btrfs] Apr 12 22:38:29 fan kernel: [ 164.830586] ? evict+0xb9/0x1c0 Apr 12 22:38:29 fan kernel: [ 164.830618] ? btrfs_orphan_cleanup+0x1d7/0x410 [btrfs] Apr 12 22:38:29 fan kernel: [ 164.830651] ? btrfs_recover_relocation+0x377/0x430 [btrfs] Apr 12 22:38:29 fan kernel: [ 164.830682] ? btrfs_cleanup_fs_roots+0x133/0x150 [btrfs] Apr 12 22:38:29 fan kernel: [ 164.830714] ? open_ctree+0x1fa1/0x2430 [btrfs] Apr 12 22:38:29 fan kernel: [ 164.830740] ? btrfs_mount+0xd13/0xe50 [btrfs] Apr 12 22:38:29 fan kernel: [ 164.830744] ? pcpu_alloc_area+0x20b/0x3e0 Apr 12 22:38:29 fan kernel: [ 164.830747] ? pcpu_next_unpop+0x36/0x50 Apr 12 22:38:29 fan kernel: [ 164.830750] ? pcpu_alloc+0x3ce/0x660 Apr 12 22:38:29 fan kernel: [ 164.830756] ? mount_fs+0x31/0x150 Apr 12 22:38:29 fan kernel: [ 164.830759] ? vfs_kern_mount+0x5d/0x120 Apr 12 22:38:29 fan kernel: [ 164.830785] ? btrfs_mount+0x17e/0xe50 [btrfs] Apr 12 22:38:29 fan kernel: [ 164.830788] ? pcpu_alloc_area+0x20b/0x3e0 Apr 12 22:38:29 fan kernel: [ 164.830791] ? pcpu_alloc+0x3ce/0x660 Apr 12 22:38:29 fan kernel: [ 164.830796] ? mount_fs+0x31/0x150 Apr 12 22:38:29 fan kernel: [ 164.830799] ? vfs_kern_mount+0x5d/0x120 Apr 12 22:38:29 fan kernel: [ 164.830803] ? do_mount+0x1a2/0xc30 Apr 12 22:38:29 fan kernel: [ 164.830808] ? _copy_from_user+0x44/0x70 Apr 12 22:38:29 fan kernel: [ 164.830812] ? SyS_mount+0x79/0xd0 Apr 12 22:38:29 fan kernel: [ 164.830817] ? entry_SYSCALL_64_fastpath+0x1a/0xa9 Apr 12 22:38:29 fan kernel: [ 165.255984] 4-...: (5250 ticks this GP) idle=03b/140000000000001/0 softirq=8337/8337 fqs=2548 Apr 12 22:38:29 fan kernel: [ 165.255985] (t=5358 jiffies g=4002 c=4001 q=2490) Apr 12 22:38:29 fan kernel: [ 165.255998] Task dump for CPU 4: Apr 12 22:38:29 fan kernel: [ 165.256001] mount R running task 0 4874 4870 0x00000008 Apr 12 22:38:29 fan kernel: [ 165.256007] Call Trace: Apr 12 22:38:29 fan kernel: [ 165.256011] <IRQ> Apr 12 22:38:29 fan kernel: [ 165.256021] ? sched_show_task+0xc6/0x130 Apr 12 22:38:29 fan kernel: [ 165.256026] ? rcu_dump_cpu_stacks+0x8d/0xad Apr 12 22:38:29 fan kernel: [ 165.256032] ? rcu_check_callbacks+0x7b8/0x910 Apr 12 22:38:29 fan kernel: [ 165.256039] ? tick_sched_handle.isra.15+0x50/0x50 Apr 12 22:38:29 fan kernel: [ 165.256043] ? update_process_times+0x23/0x50 Apr 12 22:38:29 fan kernel: [ 165.256047] ? tick_sched_handle.isra.15+0x1b/0x50 Apr 12 22:38:29 fan kernel: [ 165.256051] ? tick_sched_timer+0x33/0x60 Apr 12 22:38:29 fan kernel: [ 165.256055] ? __hrtimer_run_queues+0xe7/0x260 Apr 12 22:38:29 fan kernel: [ 165.256059] ? hrtimer_interrupt+0xa1/0x1f0 Apr 12 22:38:29 fan kernel: [ 165.256063] ? smp_apic_timer_interrupt+0x2f/0x40 Apr 12 22:38:29 fan kernel: [ 165.256070] ? apic_timer_interrupt+0x82/0x90 Apr 12 22:38:29 fan kernel: [ 165.256071] </IRQ> Apr 12 22:38:29 fan kernel: [ 165.256077] ? native_queued_spin_lock_slowpath+0x16b/0x190 Apr 12 22:38:29 fan kernel: [ 165.256081] ? _raw_spin_lock+0x18/0x20 Apr 12 22:38:29 fan kernel: [ 165.256124] ? find_free_extent.isra.67+0xa21/0x1110 [btrfs] Apr 12 22:38:29 fan kernel: [ 165.256154] ? btrfs_reserve_extent+0xa6/0x210 [btrfs] Apr 12 22:38:29 fan kernel: [ 165.256183] ? btrfs_alloc_tree_block+0x109/0x4b0 [btrfs] Apr 12 22:38:29 fan kernel: [ 165.256209] ? __btrfs_cow_block+0x144/0x570 [btrfs] Apr 12 22:38:29 fan kernel: [ 165.256235] ? btrfs_cow_block+0xf9/0x1a0 [btrfs] Apr 12 22:38:29 fan kernel: [ 165.256261] ? btrfs_search_slot+0x1fa/0xa00 [btrfs] Apr 12 22:38:29 fan kernel: [ 165.256266] ? cache_grow_end+0x119/0x140 Apr 12 22:38:29 fan kernel: [ 165.256299] ? btrfs_truncate_inode_items+0x188/0xe30 [btrfs] Apr 12 22:38:29 fan kernel: [ 165.256333] ? btrfs_evict_inode+0x478/0x590 [btrfs] Apr 12 22:38:29 fan kernel: [ 165.256338] ? evict+0xb9/0x1c0 Apr 12 22:38:29 fan kernel: [ 165.256370] ? btrfs_orphan_cleanup+0x1d7/0x410 [btrfs] Apr 12 22:38:29 fan kernel: [ 165.256403] ? btrfs_recover_relocation+0x377/0x430 [btrfs] Apr 12 22:38:29 fan kernel: [ 165.256434] ? btrfs_cleanup_fs_roots+0x133/0x150 [btrfs] Apr 12 22:38:29 fan kernel: [ 165.256466] ? open_ctree+0x1fa1/0x2430 [btrfs] Apr 12 22:38:29 fan kernel: [ 165.256491] ? btrfs_mount+0xd13/0xe50 [btrfs] Apr 12 22:38:29 fan kernel: [ 165.256495] ? pcpu_alloc_area+0x20b/0x3e0 Apr 12 22:38:29 fan kernel: [ 165.256499] ? pcpu_next_unpop+0x36/0x50 Apr 12 22:38:29 fan kernel: [ 165.256502] ? pcpu_alloc+0x3ce/0x660 Apr 12 22:38:29 fan kernel: [ 165.256507] ? mount_fs+0x31/0x150 Apr 12 22:38:29 fan kernel: [ 165.256511] ? vfs_kern_mount+0x5d/0x120 Apr 12 22:38:29 fan kernel: [ 165.256537] ? btrfs_mount+0x17e/0xe50 [btrfs] Apr 12 22:38:29 fan kernel: [ 165.256540] ? pcpu_alloc_area+0x20b/0x3e0 Apr 12 22:38:29 fan kernel: [ 165.256543] ? pcpu_alloc+0x3ce/0x660 Apr 12 22:38:29 fan kernel: [ 165.256548] ? mount_fs+0x31/0x150 Apr 12 22:38:29 fan kernel: [ 165.256551] ? vfs_kern_mount+0x5d/0x120 Apr 12 22:38:29 fan kernel: [ 165.256555] ? do_mount+0x1a2/0xc30 Apr 12 22:38:29 fan kernel: [ 165.256560] ? _copy_from_user+0x44/0x70 Apr 12 22:38:29 fan kernel: [ 165.256564] ? SyS_mount+0x79/0xd0 Apr 12 22:38:29 fan kernel: [ 165.256569] ? entry_SYSCALL_64_fastpath+0x1a/0xa9 followed by a row of Apr 12 22:38:56 fan kernel: [ 192.656441] NMI watchdog: BUG: soft lockup - CPU#4 stuck for 22s! [mount:4874] Apr 12 22:38:56 fan kernel: [ 192.670868] Modules linked in: loop ebtable_filter ebtables ip6table_filter ip6_tables cpufreq_conservative cpufreq_userspace cpufreq_powersave bridge stp llc iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack amd64_edac_mod edac_mce_amd edac_core snd_hda_codec_realtek snd_hda_codec_generic kvm_amd ipt_REJECT nf_reject_ipv4 snd_hda_codec_hdmi kvm snd_hda_intel xt_tcpudp snd_cmipci snd_hda_codec snd_mpu401_uart snd_hda_core snd_opl3_lib snd_rawmidi snd_hwdep irqbypass input_leds snd_seq_device pcspkr k10temp snd_pcm_oss snd_mixer_oss sg iptable_filter snd_pcm snd_timer snd soundcore asus_atk0110 shpchp acpi_cpufreq evdev tpm_tis tpm_tis_core tpm ip_tables x_tables autofs4 btrfs ext4 crc16 jbd2 fscrypto mbcache ecb crypto_simd glue_helper cryptd aes_x86_64 xts gf128mul algif_skcipher Apr 12 22:38:56 fan kernel: [ 192.813641] af_alg dm_crypt raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c crc32c_generic raid1 raid0 multipath linear md_mod hid_generic usbhid hid usb_storage dm_mod sr_mod cdrom sd_mod ohci_pci amdkfd radeon r8169 mii ahci libahci i2c_algo_bit ttm sym53c8xx xhci_pci drm_kms_helper ohci_hcd ehci_pci scsi_transport_spi libata xhci_hcd i2c_piix4 ehci_hcd drm usbcore scsi_mod usb_common i2c_core button Apr 12 22:38:56 fan kernel: [ 192.893475] CPU: 4 PID: 4874 Comm: mount Tainted: G D 4.10.10-zgws1 #2 Apr 12 22:38:56 fan kernel: [ 192.893477] Hardware name: System manufacturer System Product Name/M5A88-V EVO, BIOS 1603 10/12/2012 Apr 12 22:38:56 fan kernel: [ 192.893480] task: ffff8803fbbdd200 task.stack: ffffc900047d4000 Apr 12 22:38:56 fan kernel: [ 192.893487] RIP: 0010:native_queued_spin_lock_slowpath+0x169/0x190 Apr 12 22:38:56 fan kernel: [ 192.893498] RSP: 0018:ffffc900047d7550 EFLAGS: 00000202 ORIG_RAX: ffffffffffffff10 Apr 12 22:38:56 fan kernel: [ 192.893502] RAX: 0000000000000101 RBX: ffff8803fbae9400 RCX: 0000000000000001 Apr 12 22:38:56 fan kernel: [ 192.893504] RDX: 0000000000000101 RSI: 0000000000000001 RDI: ffff8803f24dbe00 Apr 12 22:38:56 fan kernel: [ 192.893506] RBP: ffff8803f24dbe00 R08: 0000000000000101 R09: 0000000000000000 Apr 12 22:38:56 fan kernel: [ 192.893509] R10: 000000196463d000 R11: ffffffff81649b40 R12: 000000196463d000 Apr 12 22:38:56 fan kernel: [ 192.893511] R13: ffff8803db120000 R14: ffff8803f24dbe00 R15: ffff8803db120b98 Apr 12 22:38:56 fan kernel: [ 192.893514] FS: 00007f41b7aeb480(0000) GS:ffff88042fd00000(0000) knlGS:0000000000000000 Apr 12 22:38:56 fan kernel: [ 192.893517] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Apr 12 22:38:56 fan kernel: [ 192.893519] CR2: 000055c2409df550 CR3: 000000041b16f000 CR4: 00000000000006e0 Apr 12 22:38:56 fan kernel: [ 192.893521] Call Trace: Apr 12 22:38:56 fan kernel: [ 192.893527] ? _raw_spin_lock+0x18/0x20 Apr 12 22:38:56 fan kernel: [ 192.893559] ? find_free_extent.isra.67+0xa21/0x1110 [btrfs] Apr 12 22:38:56 fan kernel: [ 192.893589] ? btrfs_reserve_extent+0xa6/0x210 [btrfs] Apr 12 22:38:56 fan kernel: [ 192.893618] ? btrfs_alloc_tree_block+0x109/0x4b0 [btrfs] Apr 12 22:38:56 fan kernel: [ 192.893645] ? __btrfs_cow_block+0x144/0x570 [btrfs] Apr 12 22:38:56 fan kernel: [ 192.893671] ? btrfs_cow_block+0xf9/0x1a0 [btrfs] Apr 12 22:38:56 fan kernel: [ 192.893697] ? btrfs_search_slot+0x1fa/0xa00 [btrfs] Apr 12 22:38:56 fan kernel: [ 192.893701] ? cache_grow_end+0x119/0x140 Apr 12 22:38:56 fan kernel: [ 192.893734] ? btrfs_truncate_inode_items+0x188/0xe30 [btrfs] Apr 12 22:38:56 fan kernel: [ 192.893767] ? btrfs_evict_inode+0x478/0x590 [btrfs] Apr 12 22:38:56 fan kernel: [ 192.893772] ? evict+0xb9/0x1c0 Apr 12 22:38:56 fan kernel: [ 192.893805] ? btrfs_orphan_cleanup+0x1d7/0x410 [btrfs] Apr 12 22:38:56 fan kernel: [ 192.893837] ? btrfs_recover_relocation+0x377/0x430 [btrfs] Apr 12 22:38:56 fan kernel: [ 192.893869] ? btrfs_cleanup_fs_roots+0x133/0x150 [btrfs] Apr 12 22:38:56 fan kernel: [ 192.893900] ? open_ctree+0x1fa1/0x2430 [btrfs] Apr 12 22:38:56 fan kernel: [ 192.893926] ? btrfs_mount+0xd13/0xe50 [btrfs] Apr 12 22:38:56 fan kernel: [ 192.893930] ? pcpu_alloc_area+0x20b/0x3e0 Apr 12 22:38:56 fan kernel: [ 192.893933] ? pcpu_next_unpop+0x36/0x50 Apr 12 22:38:56 fan kernel: [ 192.893936] ? pcpu_alloc+0x3ce/0x660 Apr 12 22:38:56 fan kernel: [ 192.893941] ? mount_fs+0x31/0x150 Apr 12 22:38:56 fan kernel: [ 192.893945] ? vfs_kern_mount+0x5d/0x120 Apr 12 22:38:56 fan kernel: [ 192.893970] ? btrfs_mount+0x17e/0xe50 [btrfs] Apr 12 22:38:56 fan kernel: [ 192.893973] ? pcpu_alloc_area+0x20b/0x3e0 Apr 12 22:38:56 fan kernel: [ 192.893977] ? pcpu_alloc+0x3ce/0x660 Apr 12 22:38:56 fan kernel: [ 192.893982] ? mount_fs+0x31/0x150 Apr 12 22:38:56 fan kernel: [ 192.893985] ? vfs_kern_mount+0x5d/0x120 Apr 12 22:38:56 fan kernel: [ 192.893988] ? do_mount+0x1a2/0xc30 Apr 12 22:38:56 fan kernel: [ 192.893993] ? _copy_from_user+0x44/0x70 Apr 12 22:38:56 fan kernel: [ 192.893997] ? SyS_mount+0x79/0xd0 Apr 12 22:38:56 fan kernel: [ 192.894002] ? entry_SYSCALL_64_fastpath+0x1a/0xa9 Apr 12 22:38:56 fan kernel: [ 192.894003] Code: c2 89 d0 66 31 c0 41 39 c0 74 e6 4d 85 c9 c6 07 01 74 2d 41 c7 41 08 01 00 00 00 e9 53 ff ff ff 83 fa 01 74 17 8b 07 84 c0 74 08 <f3> 90 8b 07 84 c0 75 f8 b8 01 00 00 00 66 89 07 c3 f3 c3 f3 90 This repeats a number of times and then the system becomes unresponsive and is ripe for reboot. This behavior is reproducible. Does this help? Greetings Marc -- ----------------------------------------------------------------------------- Marc Haber | "I don't trust Computers. They | Mailadresse im Header Leimen, Germany | lose things." Winona Ryder | Fon: *49 6224 1600402 Nordisch by Nature | How to make an American Quilt | Fax: *49 6224 1600421 -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html