ignoring bad blocks
Hi All, Can BTRFS ignore bad blocks as they are discovered? I want to try BTRFS on some older drives, but they all have a few bad blocks. Thanks, Dyweni -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html
BTRFS: Transaction aborted (error -5)
Hi All, Just wondering of a few things: 1. Has anyone seen a problem like this before (see below)? This occurs when mounting the file system. It mounts, but goes straight to read-only mode. 2. I've scanned the device (/dev/sdd) using 'badblocks -s v', which reports no bad blocks found. 3. What can be done to recover from this? (I'm planning to upgrade to 3.18 before trying recovery/repairs) Thanks, Dyweni [32079.815291] BTRFS info (device sdd1): disk space caching is enabled [32082.419524] BTRFS: sdd1 checksum verify failed on 588447744 wanted F90C810B found 6E0D3115 level 0 [32114.418433] BTRFS: sdd1 checksum verify failed on 588447744 wanted F90C810B found 6E0D3115 level 0 [32125.951446] BTRFS: sdd1 checksum verify failed on 588447744 wanted F90C810B found 6E0D3115 level 0 [32125.959497] BTRFS: sdd1 checksum verify failed on 588447744 wanted F90C810B found 24492BB3 level 0 [32125.959505] [ cut here ] [32125.959517] WARNING: CPU: 0 PID: 2601 at fs/btrfs/super.c:259 __btrfs_abort_transaction+0x43/0x110() [32125.959518] BTRFS: Transaction aborted (error -5) [32125.959519] Modules linked in: iscsi_trgt(O) [32125.959527] CPU: 0 PID: 2601 Comm: btrfs-cleaner Tainted: G O 3.16.5-gentoo-20150103-0758 #1 [32125.959528] Hardware name:/MS-6570, BIOS 6.00 PG 11/07/2003 [32125.959530] ec009e68 ec009e68 ec009e28 c14d581f ec009e58 c10333d0 c15bcea0 ec009e84 [32125.959533] 0a29 c15c9417 0103 c11c8723 c11c8723 fffb f1c5d400 c14fd856 [32125.959537] ec009e70 c103341e 0009 ec009e68 c15bcea0 ec009e84 ec009e9c c11c8723 [32125.959541] Call Trace: [32125.959548] [] dump_stack+0x16/0x18 [32125.959553] [] warn_slowpath_common+0x70/0x90 [32125.959556] [] ? __btrfs_abort_transaction+0x43/0x110 [32125.959559] [] ? __btrfs_abort_transaction+0x43/0x110 [32125.959562] [] warn_slowpath_fmt+0x2e/0x30 [32125.959565] [] __btrfs_abort_transaction+0x43/0x110 [32125.959571] [] btrfs_run_delayed_refs.part.74+0xd4/0x1d0 [32125.959574] [] btrfs_run_delayed_refs+0xf/0x20 [32125.959578] [] btrfs_should_end_transaction+0x34/0x50 [32125.959581] [] btrfs_drop_snapshot+0x1d1/0x6a0 [32125.959585] [] ? default_wake_function+0xb/0x10 [32125.959590] [] ? __wake_up_common+0x3f/0x70 [32125.959593] [] btrfs_clean_one_deleted_snapshot+0x62/0x90 [32125.959595] [] cleaner_kthread+0xce/0x100 [32125.959597] [] ? btrfs_destroy_pinned_extent+0x120/0x120 [32125.959603] [] kthread+0x95/0xb0 [32125.959606] [] ret_from_kernel_thread+0x20/0x30 [32125.959609] [] ? kthread_worker_fn+0xb0/0xb0 [32125.959611] ---[ end trace 1e2cdbbae61fcdc1 ]--- [32125.959614] BTRFS: error (device sdd1) in btrfs_run_delayed_refs:2806: errno=-5 IO failure [32125.959616] BTRFS info (device sdd1): forced readonly -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html
Re: BTRFS: Transaction aborted (error -5)
Hi, [32079.815291] BTRFS info (device sdd1): disk space caching is enabled [32082.419524] BTRFS: sdd1 checksum verify failed on 588447744 wanted F90C810B found 6E0D3115 level 0 [32114.418433] BTRFS: sdd1 checksum verify failed on 588447744 wanted F90C810B found 6E0D3115 level 0 [32125.951446] BTRFS: sdd1 checksum verify failed on 588447744 wanted F90C810B found 6E0D3115 level 0 [32125.959497] BTRFS: sdd1 checksum verify failed on 588447744 wanted F90C810B found 24492BB3 level 0 Well I'm no expert, but it seems suspicious to me it doesn't find what it wants on a particular block twice, but then on the 3rd attempt it finds something different on the same block which also isn't what it wants. So that sounds like a device problem to me. Is this an SSD? What are your mount options (are you using discard)? And what's the metadata profile, is it single or DUP? I'm gonna guess it's an SSD with single copy of metadata which is why this isn't self-correcting. So I finished testing the drive using 'badblocks -n -s -v' (the non-destructive read-write mode). It came back clean, no bad blocks found. This I did with the entire drive unmounted. Yet, still, the file system reports the errors shortly after mounting. (See below) This drive is an older spinning type drive. This is the drive as reported by 'lsscsi': [3:0:0:0]diskATA WDC WD1001FALS-0 1D05 /dev/sdd Newegg lists it as a 'Western Digital WD Black WD1001FALS 1TB 7200 RPM 32MB Cache SATA 3.0Gb/s 3.5" Internal Hard Drive Bare Drive' The disk is attached to the system via this, as reported by 'lspci': 01:09.0 RAID bus controller: Silicon Image, Inc. SiI 3124 PCI-X Serial ATA Controller (rev 02) (Not sure why it lists it as a raid controller or a pci-x controller, as I used it a simple sata controller and it plugs into a regular 32bit pci slot). The motherboard is a Micro-Star MS-6570, with an AMD Athlon XP 3000+ (2171 MHz) processor and 2GB of RAM. Mount options are only: noatime BTRFS Profile is: # btrfs fi df /var/lib/ceph/osd/ceph-1/ Data, single: total=185.01GiB, used=183.39GiB System, DUP: total=8.00MiB, used=48.00KiB System, single: total=4.00MiB, used=0.00B Metadata, DUP: total=1.00GiB, used=367.19MiB Metadata, single: total=8.00MiB, used=0.00B GlobalReserve, single: total=128.00MiB, used=0.00B [162288.768747] BTRFS info (device sdc1): disk space caching is enabled [162290.463003] BTRFS info (device sdd1): disk space caching is enabled [162335.594094] BTRFS: sdd1 checksum verify failed on 588447744 wanted F90C810B found 6E0D3115 level 0 [162335.595476] BTRFS: sdd1 checksum verify failed on 588447744 wanted F90C810B found 6E0D3115 level 0 [162335.602066] BTRFS: sdd1 checksum verify failed on 588447744 wanted F90C810B found 24492BB3 level 0 [162335.602075] [ cut here ] [162335.602085] WARNING: CPU: 0 PID: 31841 at fs/btrfs/super.c:260 __btrfs_abort_transaction+0x43/0x110() [162335.602086] BTRFS: Transaction aborted (error -5) [162335.602087] Modules linked in: iscsi_trgt(O) [162335.602094] CPU: 0 PID: 31841 Comm: btrfs-cleaner Tainted: G O 3.18.1-gentoo-20150104-0921 #1 [162335.602096] Hardware name:/MS-6570, BIOS 6.00 PG 11/07/2003 [162335.602097] e68a5e68 e68a5e68 e68a5e28 c14e48a4 e68a5e58 c10345a0 c15cbefc e68a5e84 [162335.602101] 7c61 c15d895b 0104 c11cff13 c11cff13 fffb f4d23800 c150d330 [162335.602104] e68a5e70 c10345ee 0009 e68a5e68 c15cbefc e68a5e84 e68a5e9c c11cff13 [162335.602108] Call Trace: [162335.602117] [] dump_stack+0x16/0x18 [162335.602122] [] warn_slowpath_common+0x70/0x90 [162335.602125] [] ? __btrfs_abort_transaction+0x43/0x110 [162335.602127] [] ? __btrfs_abort_transaction+0x43/0x110 [162335.602130] [] warn_slowpath_fmt+0x2e/0x30 [162335.602133] [] __btrfs_abort_transaction+0x43/0x110 [162335.602138] [] btrfs_run_delayed_refs.part.73+0xd4/0x1d0 [162335.602140] [] btrfs_run_delayed_refs+0xf/0x20 [162335.602143] [] btrfs_should_end_transaction+0x34/0x50 [162335.602146] [] btrfs_drop_snapshot+0x1c9/0x740 [162335.602149] [] btrfs_clean_one_deleted_snapshot+0x62/0x90 [162335.602152] [] cleaner_kthread+0xd9/0x110 [162335.602155] [] ? btrfs_destroy_pinned_extent+0x120/0x120 [162335.602160] [] kthread+0x95/0xb0 [162335.602164] [] ret_from_kernel_thread+0x20/0x30 [162335.602166] [] ? kthread_worker_fn+0xb0/0xb0 [162335.602168] ---[ end trace ba640116f371d2ff ]--- [162335.602171] BTRFS: error (device sdd1) in btrfs_run_delayed_refs:2792: errno=-5 IO failure [162335.602173] BTRFS info (device sdd1): forced readonly -- To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html
Re: BTRFS: Transaction aborted (error -5)
Hi, Try to mount with -o recovery with either kernel (newer is pretty much always better). If that doesn't work then you should try upgrading btrfs-progs to 3.18 (released dozens of hours ago) and run 'btrfs check' on the volume and report the results. I don't recommend using --repair option just yet. mounting with -o recovery yields the same errors in dmesg output as without the -o recovery. This is even after upgrading the kernel to 3.18.1 and btrfs-progs to 3.18. BTRFS check yields this: # btrfs check /dev/sdd1 Checking filesystem on /dev/sdd1 UUID: adad9bea-fc42-4411-bfda-345111934fda checking extents checksum verify failed on 588447744 found 6E0D3115 wanted F90C810B checksum verify failed on 588447744 found 6E0D3115 wanted F90C810B checksum verify failed on 588447744 found 24492BB3 wanted F90C810B checksum verify failed on 588447744 found 6E0D3115 wanted F90C810B Csum didn't match owner ref check failed [588447744 16384] ref mismatch on [151193784320 32768] extent item 0, found 1 Backref 151193784320 root 277 owner 36161 offset 3833856 num_refs 0 not found in extent tree Incorrect local backref count on 151193784320 root 277 owner 36161 offset 3833856 found 1 wanted 0 back 0xad8be18 backpointer mismatch on [151193784320 32768] ref mismatch on [151193817088 32768] extent item 0, found 1 Backref 151193817088 root 277 owner 36161 offset 3915776 num_refs 0 not found in extent tree Incorrect local backref count on 151193817088 root 277 owner 36161 offset 3915776 found 1 wanted 0 back 0xad8bf00 backpointer mismatch on [151193817088 32768] ref mismatch on [151193849856 180224] extent item 0, found 1 Backref 151193849856 root 277 owner 36355 offset 3112960 num_refs 0 not found in extent tree Incorrect local backref count on 151193849856 root 277 owner 36355 offset 3112960 found 1 wanted 0 back 0xab333f0 backpointer mismatch on [151193849856 180224] ref mismatch on [151194030080 3145728] extent item 0, found 7 Backref 151194030080 root 277 owner 36187 offset 1048576 num_refs 0 not found in extent tree Incorrect local backref count on 151194030080 root 277 owner 36187 offset 1048576 found 7 wanted 0 back 0x9b82580 backpointer mismatch on [151194030080 3145728] ref mismatch on [151197175808 32768] extent item 0, found 1 Backref 151197175808 root 277 owner 36361 offset 2523136 num_refs 0 not found in extent tree Incorrect local backref count on 151197175808 root 277 owner 36361 offset 2523136 found 1 wanted 0 back 0xa0f5568 backpointer mismatch on [151197175808 32768] ref mismatch on [151197208576 32768] extent item 0, found 1 Backref 151197208576 root 277 owner 36361 offset 2572288 num_refs 0 not found in extent tree Incorrect local backref count on 151197208576 root 277 owner 36361 offset 2572288 found 1 wanted 0 back 0xa783490 backpointer mismatch on [151197208576 32768] ref mismatch on [151197241344 32768] extent item 0, found 1 Backref 151197241344 root 277 owner 36361 offset 2621440 num_refs 0 not found in extent tree Incorrect local backref count on 151197241344 root 277 owner 36361 offset 2621440 found 1 wanted 0 back 0xa4d67e8 backpointer mismatch on [151197241344 32768] ref mismatch on [151197274112 32768] extent item 0, found 1 Backref 151197274112 root 277 owner 36361 offset 2703360 num_refs 0 not found in extent tree Incorrect local backref count on 151197274112 root 277 owner 36361 offset 2703360 found 1 wanted 0 back 0x925de30 backpointer mismatch on [151197274112 32768] ref mismatch on [151197306880 16384] extent item 0, found 1 Backref 151197306880 root 277 owner 36361 offset 3637248 num_refs 0 not found in extent tree Incorrect local backref count on 151197306880 root 277 owner 36361 offset 3637248 found 1 wanted 0 back 0x916a658 backpointer mismatch on [151197306880 16384] ref mismatch on [151197323264 983040] extent item 0, found 3 Backref 151197323264 root 277 owner 36208 offset 0 num_refs 0 not found in extent tree Incorrect local backref count on 151197323264 root 277 owner 36208 offset 0 found 3 wanted 0 back 0xb18a1e0 backpointer mismatch on [151197323264 983040] ref mismatch on [151198306304 32768] extent item 0, found 1 Backref 151198306304 root 277 owner 36086 offset 3780608 num_refs 0 not found in extent tree Incorrect local backref count on 151198306304 root 277 owner 36086 offset 3780608 found 1 wanted 0 back 0xb30f878 backpointer mismatch on [151198306304 32768] ref mismatch on [151198339072 98304] extent item 0, found 1 Backref 151198339072 root 277 owner 36396 offset 901120 num_refs 0 not found in extent tree Incorrect local backref count on 151198339072 root 277 owner 36396 offset 901120 found 1 wanted 0 back 0x99bfc58 backpointer mismatch on [151198339072 98304] ref mismatch on [151198437376 16384] extent item 0, found 1 Backref 151198437376 root 277 owner 36396 offset 1015808 num_refs 0 not found in extent tree Incorrect local backref count on 151198437376 root 277 owner 36396 offset 1015808 found 1 wanted 0 back 0x99bfd40
Re: BTRFS: Transaction aborted (error -5)
Hi, BTRFS check on /dev/sdc1 reveals everything looks ok: # btrfs check /dev/sdc1 Checking filesystem on /dev/sdc1 UUID: 26ed1033-429a-444f-97cc-ce8103db4c39 checking extents checking free space cache checking fs roots checking csums checking root refs found 195515710524 bytes used err is 0 total csum bytes: 205915200 total tree bytes: 407355392 total fs tree bytes: 94830592 total extent tree bytes: 31588352 btree space waste bytes: 100867438 file data blocks allocated: 537492316160 referenced 195656101888 Btrfs v3.18 (/dev/sdd1 and /dev/sdc1 are the only two btrfs file systems in this machine). Oddly, when the problem with /dev/sdd1 started, problems with /dev/sdc1 were also reported, but /dev/sdc1 managed to fix itself. Below is the complete dmesg output from when problems first started until /dev/sdd1 went readonly with errors. The strangest part of all of this, is that the dmesg output shows no errors about the drive being physically bad. (I ran badblocks -nsv on both /dev/sdd and /dev/sdc, and it confirmed 0 bad blocks for both drives). [25581.099684] BTRFS: sdd1 checksum verify failed on 521797632 wanted 8F2F5FEC found 3E879EFE level 0 [25581.105441] BTRFS: read error corrected: ino 1 off 521797632 (dev /dev/sdd1 sector 1035520) [25581.105612] BTRFS: read error corrected: ino 1 off 521801728 (dev /dev/sdd1 sector 1035528) [25581.105784] BTRFS: read error corrected: ino 1 off 521805824 (dev /dev/sdd1 sector 1035536) [25581.105956] BTRFS: read error corrected: ino 1 off 521809920 (dev /dev/sdd1 sector 1035544) [2.799514] BTRFS: sdd1 checksum verify failed on 680296448 wanted AB0E191F found 192D4134 level 0 [2.856199] BTRFS: read error corrected: ino 1 off 680296448 (dev /dev/sdd1 sector 1345088) [2.860571] BTRFS: read error corrected: ino 1 off 680300544 (dev /dev/sdd1 sector 1345096) [2.909634] BTRFS: read error corrected: ino 1 off 680304640 (dev /dev/sdd1 sector 1345104) [2.909876] BTRFS: read error corrected: ino 1 off 680308736 (dev /dev/sdd1 sector 1345112) [29292.777237] BTRFS: sdc1 checksum verify failed on 937738240 wanted F4196CDA found AF30B394 level 0 [29292.778022] BTRFS: sdc1 checksum verify failed on 937738240 wanted F4196CDA found AF30B394 level 0 [29292.781889] BTRFS: read error corrected: ino 1 off 937738240 (dev /dev/sdc1 sector 1847904) [29292.782054] BTRFS: read error corrected: ino 1 off 937742336 (dev /dev/sdc1 sector 1847912) [29292.782224] BTRFS: read error corrected: ino 1 off 937746432 (dev /dev/sdc1 sector 1847920) [29292.782399] BTRFS: read error corrected: ino 1 off 937750528 (dev /dev/sdc1 sector 1847928) [29691.731107] BTRFS: sdd1 checksum verify failed on 610877440 wanted 5A8006E7 found 1CFE4A20 level 0 [29691.791550] BTRFS: read error corrected: ino 1 off 610877440 (dev /dev/sdd1 sector 1209504) [29691.793252] BTRFS: read error corrected: ino 1 off 610881536 (dev /dev/sdd1 sector 1209512) [29691.793608] BTRFS: read error corrected: ino 1 off 610885632 (dev /dev/sdd1 sector 1209520) [29691.793797] BTRFS: read error corrected: ino 1 off 610889728 (dev /dev/sdd1 sector 1209528) [34626.017914] BTRFS: sdd1 checksum verify failed on 737181696 wanted 15D7099D found B6A2A7A9 level 0 [34626.022656] BTRFS: read error corrected: ino 1 off 737181696 (dev /dev/sdd1 sector 1456192) [34626.022867] BTRFS: read error corrected: ino 1 off 737185792 (dev /dev/sdd1 sector 1456200) [34626.023107] BTRFS: read error corrected: ino 1 off 737189888 (dev /dev/sdd1 sector 1456208) [34626.023314] BTRFS: read error corrected: ino 1 off 737193984 (dev /dev/sdd1 sector 1456216) [37057.349996] BTRFS: sdc1 checksum verify failed on 701792256 wanted A7BD5067 found 87EF0602 level 0 [37057.424920] BTRFS: read error corrected: ino 1 off 701792256 (dev /dev/sdc1 sector 1387072) [37057.425178] BTRFS: read error corrected: ino 1 off 701796352 (dev /dev/sdc1 sector 1387080) [37057.450174] BTRFS: read error corrected: ino 1 off 701800448 (dev /dev/sdc1 sector 1387088) [37057.453476] BTRFS: read error corrected: ino 1 off 701804544 (dev /dev/sdc1 sector 1387096) [38283.714855] BTRFS: sdd1 checksum verify failed on 190169088 wanted 27D1E032 found 585B1651 level 0 [38283.715349] BTRFS: sdd1 checksum verify failed on 190169088 wanted 27D1E032 found 585B1651 level 0 [38283.724140] BTRFS: read error corrected: ino 1 off 190169088 (dev /dev/sdd1 sector 387808) [38283.724313] BTRFS: read error corrected: ino 1 off 190173184 (dev /dev/sdd1 sector 387816) [38283.724485] BTRFS: read error corrected: ino 1 off 190177280 (dev /dev/sdd1 sector 387824) [38283.724648] BTRFS: read error corrected: ino 1 off 190181376 (dev /dev/sdd1 sector 387832) [38385.874438] BTRFS: sdd1 checksum verify failed on 472825856 wanted 937078F5 found 7FCB4F87 level 0 [38385.897113] BTRFS: read error corrected: ino 1 off 472825856 (dev /dev/sdd1 sector 939872) [38385.897336] BTRFS: read error corrected: ino 1 off 472829952 (dev /dev/sdd1 sector 939880) [38385.8975
Re: BTRFS: Transaction aborted (error -5)
Hi All, Just wondering if someone could help me figure out what happened to this file system? As you see below, the kernel reports btrfs errors on both drives, but was able to correct the errors on the first drive. The second drive not so lucky. However, running 'badblocks -nsv' (the non-destructive read-write test) on both drives shows both drive free of bad blocks. Both drives are 1TB 7200RPM spinners. And, as Chris indicated earlier, its strange that the file system gets different check sums for the same block... Thanks, Dyweni On 2015-01-06 09:15, Dyweni - BTRFS wrote: Hi, BTRFS check on /dev/sdc1 reveals everything looks ok: # btrfs check /dev/sdc1 Checking filesystem on /dev/sdc1 UUID: 26ed1033-429a-444f-97cc-ce8103db4c39 checking extents checking free space cache checking fs roots checking csums checking root refs found 195515710524 bytes used err is 0 total csum bytes: 205915200 total tree bytes: 407355392 total fs tree bytes: 94830592 total extent tree bytes: 31588352 btree space waste bytes: 100867438 file data blocks allocated: 537492316160 referenced 195656101888 Btrfs v3.18 (/dev/sdd1 and /dev/sdc1 are the only two btrfs file systems in this machine). Oddly, when the problem with /dev/sdd1 started, problems with /dev/sdc1 were also reported, but /dev/sdc1 managed to fix itself. Below is the complete dmesg output from when problems first started until /dev/sdd1 went readonly with errors. The strangest part of all of this, is that the dmesg output shows no errors about the drive being physically bad. (I ran badblocks -nsv on both /dev/sdd and /dev/sdc, and it confirmed 0 bad blocks for both drives). [25581.099684] BTRFS: sdd1 checksum verify failed on 521797632 wanted 8F2F5FEC found 3E879EFE level 0 [25581.105441] BTRFS: read error corrected: ino 1 off 521797632 (dev /dev/sdd1 sector 1035520) [25581.105612] BTRFS: read error corrected: ino 1 off 521801728 (dev /dev/sdd1 sector 1035528) [25581.105784] BTRFS: read error corrected: ino 1 off 521805824 (dev /dev/sdd1 sector 1035536) [25581.105956] BTRFS: read error corrected: ino 1 off 521809920 (dev /dev/sdd1 sector 1035544) [2.799514] BTRFS: sdd1 checksum verify failed on 680296448 wanted AB0E191F found 192D4134 level 0 [2.856199] BTRFS: read error corrected: ino 1 off 680296448 (dev /dev/sdd1 sector 1345088) [2.860571] BTRFS: read error corrected: ino 1 off 680300544 (dev /dev/sdd1 sector 1345096) [2.909634] BTRFS: read error corrected: ino 1 off 680304640 (dev /dev/sdd1 sector 1345104) [2.909876] BTRFS: read error corrected: ino 1 off 680308736 (dev /dev/sdd1 sector 1345112) [29292.777237] BTRFS: sdc1 checksum verify failed on 937738240 wanted F4196CDA found AF30B394 level 0 [29292.778022] BTRFS: sdc1 checksum verify failed on 937738240 wanted F4196CDA found AF30B394 level 0 [29292.781889] BTRFS: read error corrected: ino 1 off 937738240 (dev /dev/sdc1 sector 1847904) [29292.782054] BTRFS: read error corrected: ino 1 off 937742336 (dev /dev/sdc1 sector 1847912) [29292.782224] BTRFS: read error corrected: ino 1 off 937746432 (dev /dev/sdc1 sector 1847920) [29292.782399] BTRFS: read error corrected: ino 1 off 937750528 (dev /dev/sdc1 sector 1847928) [29691.731107] BTRFS: sdd1 checksum verify failed on 610877440 wanted 5A8006E7 found 1CFE4A20 level 0 [29691.791550] BTRFS: read error corrected: ino 1 off 610877440 (dev /dev/sdd1 sector 1209504) [29691.793252] BTRFS: read error corrected: ino 1 off 610881536 (dev /dev/sdd1 sector 1209512) [29691.793608] BTRFS: read error corrected: ino 1 off 610885632 (dev /dev/sdd1 sector 1209520) [29691.793797] BTRFS: read error corrected: ino 1 off 610889728 (dev /dev/sdd1 sector 1209528) [34626.017914] BTRFS: sdd1 checksum verify failed on 737181696 wanted 15D7099D found B6A2A7A9 level 0 [34626.022656] BTRFS: read error corrected: ino 1 off 737181696 (dev /dev/sdd1 sector 1456192) [34626.022867] BTRFS: read error corrected: ino 1 off 737185792 (dev /dev/sdd1 sector 1456200) [34626.023107] BTRFS: read error corrected: ino 1 off 737189888 (dev /dev/sdd1 sector 1456208) [34626.023314] BTRFS: read error corrected: ino 1 off 737193984 (dev /dev/sdd1 sector 1456216) [37057.349996] BTRFS: sdc1 checksum verify failed on 701792256 wanted A7BD5067 found 87EF0602 level 0 [37057.424920] BTRFS: read error corrected: ino 1 off 701792256 (dev /dev/sdc1 sector 1387072) [37057.425178] BTRFS: read error corrected: ino 1 off 701796352 (dev /dev/sdc1 sector 1387080) [37057.450174] BTRFS: read error corrected: ino 1 off 701800448 (dev /dev/sdc1 sector 1387088) [37057.453476] BTRFS: read error corrected: ino 1 off 701804544 (dev /dev/sdc1 sector 1387096) [38283.714855] BTRFS: sdd1 checksum verify failed on 190169088 wanted 27D1E032 found 585B1651 level 0 [38283.715349] BTRFS: sdd1 checksum verify failed on 190169088 wanted 27D1E032 found 585B1651 level 0 [38283.724140] BTRFS: read error corrected: ino 1 off 190169088 (dev /dev/sdd1 sector 387808) [38283.724313] B
