Hi. As mentioned before on the list, I'm just playing with send/receive.
The first huge disappointment (after copying already hundreds of
gigabytes for hours) was, that when I Ctrl-Z the sending/receiving pipe
(to give the disks a little bit of rest to cool down) can resuming it
(fg) it immediately exited with an crc32 error in the command itself
(i.e. not a data block error, at least I guess, since this would be in
the syslog, wouldn't it?).
As if stopping that wasn't allowed to be stopped... nothing of which
would be anywhere documented :-(
I don't recall the exact wording since shortly afterwards the following
happened:
I deleted the (obviously broken) subvolume at the target fs, did some
proper cursing and started over from scratch with the copying.
A minute or so later, the system froze.
SysRq-RESIUB still worked though.
The following found itself in the syslog:
Apr 18 17:03:04 heisenberg kernel: [425939.974472] ------------[ cut here
]------------
Apr 18 17:03:04 heisenberg kernel: [425939.974495] kernel BUG at
/build/linux-gzeV2n/linux-3.19.3/fs/btrfs/inode.c:3142!
Apr 18 17:03:04 heisenberg kernel: [425939.974517] invalid opcode: 0000 [#1] SMP
Apr 18 17:03:04 heisenberg kernel: [425939.974531] Modules linked in: nls_utf8
isofs sr_mod cdrom udp_diag tcp_diag inet_diag vhost_net vhost macvtap macvlan
xt_CHECKSUM iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat
nf_nat_ipv4 nf_nat xt_tcpudp bridge stp llc tun ccm binfmt_misc seqiv
algif_skcipher md4 algif_hash af_alg cpufreq_conservative cpufreq_userspace
cpufreq_powersave cpufreq_stats xfrm_user xfrm4_tunnel tunnel4 ipcomp
xfrm_ipcomp esp4 ah4 deflate ctr twofish_generic twofish_avx_x86_64
twofish_x86_64_3way twofish_x86_64 twofish_common camellia_generic
camellia_aesni_avx_x86_64 camellia_x86_64 serpent_avx_x86_64
serpent_sse2_x86_64 xts serpent_generic blowfish_generic blowfish_x86_64
blowfish_common cast5_avx_x86_64 cast5_generic cast_common des_generic cbc cmac
xcbc rmd160 sha512_ssse3 sha512_generic ip6t_REJECT nf_reject_ipv6
nf_conntrack_ipv6 nf_defrag_ipv6 ip6table_filter ip6_tables sha256_ssse3
sha256_generic hmac crypto_null xt_policy ipt_REJECT nf_reject_ipv4 af_key
xt_comment xfrm_algo nf_conntrack_ipv4 nf_defrag_ipv4 xt_multiport xt_conntrack
nf_conntrack iptable_filter ip_tables x_tables joydev rtsx_pci_ms
rtsx_pci_sdmmc mmc_core memstick iTCO_wdt iTCO_vendor_support
x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm crct10dif_pclmul
crc32_pclmul evdev ghash_clmulni_intel psmouse serio_raw pcspkr ecb sg uvcvideo
videobuf2_vmalloc videobuf2_memops videobuf2_core v4l2_common videodev media
btusb bluetooth arc4 iwldvm mac80211 iwlwifi rtsx_pci cfg80211 rfkill tpm_tis
tpm 8250_fintek snd_hda_codec_hdmi snd_hda_codec_realtek snd_hda_codec_generic
battery processor fujitsu_laptop snd_hda_intel snd_hda_controller snd_hda_codec
ac i2c_i801 snd_hwdep snd_pcm lpc_ich mfd_core snd_timer snd soundcore shpchp
i915 button video drm_kms_helper drm e1000e thermal_sys i2c_algo_bit i2c_core
ptp mei_me pps_core mei loop fuse parport_pc ppdev lp parport autofs4 dm_crypt
dm_mod md_mod btrfs xor raid6_pq ext4 crc16 mbcache jbd2 uhci_hcd usb_storage
sd_mod crc32c_intel aesni_intel ahci libahci aes_x86_64 glue_helper lrw
gf128mul ablk_helper cryptd xhci_pci libata ehci_pci xhci_hcd ehci_hcd scsi_mod
usbcore usb_common
Apr 18 17:03:04 heisenberg kernel: [425939.975271] CPU: 0 PID: 8008 Comm:
btrfs-cleaner Tainted: G W 3.19.0-trunk-amd64 #1 Debian
3.19.3-1~exp1
Apr 18 17:03:04 heisenberg kernel: [425939.975299] Hardware name: FUJITSU
LIFEBOOK E782/FJNB23E, BIOS Version 1.11 05/24/2012
Apr 18 17:03:04 heisenberg kernel: [425939.975323] task: ffff880409bc8ca0 ti:
ffff88024b540000 task.ti: ffff88024b540000
Apr 18 17:03:04 heisenberg kernel: [425939.975344] RIP:
0010:[<ffffffffa03138b3>] [<ffffffffa03138b3>] btrfs_orphan_add+0x103/0x1d0
[btrfs]
Apr 18 17:03:04 heisenberg kernel: [425939.975385] RSP: 0018:ffff88024b543c88
EFLAGS: 00010286
Apr 18 17:03:04 heisenberg kernel: [425939.975400] RAX: 00000000ffffffe4 RBX:
ffff88040ab96000 RCX: 000000000000618b
Apr 18 17:03:04 heisenberg kernel: [425939.975419] RDX: 000000000000618b RSI:
0000000000040000 RDI: ffff880028fbb138
Apr 18 17:03:04 heisenberg kernel: [425939.975439] RBP: ffff880101d331e8 R08:
ffff8800889a73a0 R09: ffff880130738ec0
Apr 18 17:03:04 heisenberg kernel: [425939.975458] R10: 0000000000000000 R11:
0000000000000000 R12: ffff88040ab96458
Apr 18 17:03:04 heisenberg kernel: [425939.975478] R13: ffff88011cd9fe88 R14:
0000000000000001 R15: 0000000000000001
Apr 18 17:03:04 heisenberg kernel: [425939.975498] FS: 0000000000000000(0000)
GS:ffff88041e200000(0000) knlGS:0000000000000000
Apr 18 17:03:04 heisenberg kernel: [425939.975520] CS: 0010 DS: 0000 ES: 0000
CR0: 0000000080050033
Apr 18 17:03:04 heisenberg kernel: [425939.975536] CR2: 00007ffbb4092000 CR3:
0000000001813000 CR4: 00000000001407f0
Apr 18 17:03:04 heisenberg kernel: [425939.975556] Stack:
Apr 18 17:03:04 heisenberg kernel: [425939.975563] 0000000000000000
ffffffff811d9205 ffff880130738ec0 ffff880100f50800
Apr 18 17:03:04 heisenberg kernel: [425939.975588] ffff880130738ec0
0000000000000001 ffff88040b78a400 ffff8803e8aa3020
Apr 18 17:03:04 heisenberg kernel: [425939.975613] ffff880101d331e8
ffffffffa02fd832 ffff88011cd9fe88 ffff88040ab96000
Apr 18 17:03:04 heisenberg kernel: [425939.975638] Call Trace:
Apr 18 17:03:04 heisenberg kernel: [425939.975650] [<ffffffff811d9205>] ?
igrab+0x15/0x50
Apr 18 17:03:04 heisenberg kernel: [425939.975675] [<ffffffffa02fd832>] ?
btrfs_remove_block_group+0x132/0x740 [btrfs]
Apr 18 17:03:04 heisenberg kernel: [425939.975707] [<ffffffffa0335f59>] ?
btrfs_remove_chunk+0x619/0x720 [btrfs]
Apr 18 17:03:04 heisenberg kernel: [425939.975736] [<ffffffffa02fe08b>] ?
btrfs_delete_unused_bgs+0x24b/0x270 [btrfs]
Apr 18 17:03:04 heisenberg kernel: [425939.975765] [<ffffffffa0305964>] ?
cleaner_kthread+0x154/0x1b0 [btrfs]
Apr 18 17:03:04 heisenberg kernel: [425939.975792] [<ffffffffa0305810>] ?
check_leaf+0x360/0x360 [btrfs]
Apr 18 17:03:04 heisenberg kernel: [425939.975813] [<ffffffff8108a1a3>] ?
kthread+0xd3/0xf0
Apr 18 17:03:04 heisenberg kernel: [425939.975833] [<ffffffff8108a0d0>] ?
kthread_create_on_node+0x180/0x180
Apr 18 17:03:04 heisenberg kernel: [425939.975853] [<ffffffff815509d8>] ?
ret_from_fork+0x58/0x90
Apr 18 17:03:04 heisenberg kernel: [425939.975870] [<ffffffff8108a0d0>] ?
kthread_create_on_node+0x180/0x180
Apr 18 17:03:04 heisenberg kernel: [425939.975889] Code: 45 31 f6 eb 91 0f 1f
00 48 8b 55 40 eb ae 66 2e 0f 1f 84 00 00 00 00 00 48 89 ee 4c 89 ef e8 a5 28
fe ff 85 c0 0f 84 76 ff ff ff <0f> 0b 0f 1f 00 f0 80 65 80 df b9 56 0c 00 00 41
89 c0 48 89 de
Apr 18 17:03:04 heisenberg kernel: [425939.976035] RIP [<ffffffffa03138b3>]
btrfs_orphan_add+0x103/0x1d0 [btrfs]
Apr 18 17:03:04 heisenberg kernel: [425939.976066] RSP <ffff88024b543c88>
Apr 18 17:03:04 heisenberg kernel: [425939.982979] ---[ end trace
de47fb63a11a4748 ]---
Interestingly, the system itself seemed to have lived on... i.e. I saw
all further things in the syslog like disconnecting the external disks
that I was sending/recieving between:
Apr 18 17:06:24 heisenberg kernel: [426139.963788] usb 1-1.2: USB disconnect,
device number 62
Apr 18 17:06:24 heisenberg kernel: [426139.965404] sd 21:0:0:0: [sdc]
Synchronizing SCSI cache
Apr 18 17:06:24 heisenberg kernel: [426139.965466] sd 21:0:0:0: [sdc]
Synchronize Cache(10) failed: Result: hostbyte=DID_NO_CONNECT
driverbyte=DRIVER_OK
Apr 18 17:06:31 heisenberg kernel: [426146.824094] usb 1-1.2: new high-speed
USB device number 64 using ehci-pci
Apr 18 17:06:31 heisenberg kernel: [426146.919068] usb 1-1.2: New USB device
found, idVendor=058f, idProduct=6387
Apr 18 17:06:31 heisenberg kernel: [426146.919077] usb 1-1.2: New USB device
strings: Mfr=1, Product=2, SerialNumber=3
Apr 18 17:06:31 heisenberg kernel: [426146.919080] usb 1-1.2: Product: Mass
Storage Device
Apr 18 17:06:31 heisenberg kernel: [426146.919083] usb 1-1.2: Manufacturer:
JetFlash
Apr 18 17:06:31 heisenberg kernel: [426146.919086] usb 1-1.2: SerialNumber:
PR5OPGX5
Apr 18 17:06:31 heisenberg kernel: [426146.919566] usb-storage 1-1.2:1.0: USB
Mass Storage device detected
Apr 18 17:06:31 heisenberg kernel: [426146.920018] scsi host30: usb-storage
1-1.2:1.0
Apr 18 17:06:31 heisenberg mtp-probe: checking bus 1, device 64:
"/sys/devices/pci0000:00/0000:00:1a.0/usb1/1-1/1-1.2"
Apr 18 17:06:31 heisenberg mtp-probe: bus: 1, device: 64 was not an MTP device
Apr 18 17:06:32 heisenberg kernel: [426147.921692] scsi 30:0:0:0: Direct-Access
JetFlash Transcend 8GB 8.07 PQ: 0 ANSI: 2
Apr 18 17:06:32 heisenberg kernel: [426147.922474] sd 30:0:0:0: Attached scsi
generic sg3 type 0
Apr 18 17:06:32 heisenberg kernel: [426147.923781] sd 30:0:0:0: [sdd] 15687678
512-byte logical blocks: (8.03 GB/7.47 GiB)
Apr 18 17:06:32 heisenberg kernel: [426147.924414] sd 30:0:0:0: [sdd] Write
Protect is off
Apr 18 17:06:32 heisenberg kernel: [426147.924423] sd 30:0:0:0: [sdd] Mode
Sense: 03 00 00 00
Apr 18 17:06:32 heisenberg kernel: [426147.925019] sd 30:0:0:0: [sdd] No
Caching mode page found
Apr 18 17:06:32 heisenberg kernel: [426147.925025] sd 30:0:0:0: [sdd] Assuming
drive cache: write through
Apr 18 17:06:33 heisenberg kernel: [426148.493797] sdd: sdd1 sdd2 sdd3
Apr 18 17:06:33 heisenberg kernel: [426148.497018] sd 30:0:0:0: [sdd] Attached
SCSI removable disk
Apr 18 17:06:38 heisenberg kernel: [426153.842516] SysRq : Keyboard mode set to
system default
Apr 18 17:06:38 heisenberg kernel: [426154.139075] SysRq : This sysrq operation
is disabled.
Apr 18 17:06:39 heisenberg kernel: [426154.491005] SysRq : Emergency Sync
Apr 18 17:06:39 heisenberg kernel: [426154.988836] SysRq : This sysrq operation
is disabled.
Apr 18 17:06:39 heisenberg kernel: [426155.310565] SysRq : Emergency Remount R/O
The kernel is:
Linux heisenberg 3.19.0-trunk-amd64 #1 SMP Debian 3.19.3-1~exp1 (2015-03-29)
x86_64 GNU/Linux
Evertyhing except the kernel (which is from experimental) is from Debian
sid.
After rebooting a check on the source fs (I was sending from) gave:
# btrfs check /dev/mapper/data-a
Checking filesystem on /dev/mapper/data-a
UUID: 3ebe98fd-91d7-47e8-b631-33bbc9514a65
checking extents
checking free space cache
checking fs roots
checking csums
checking root refs
found 2150915376081 bytes used err is 0
total csum bytes: 4096624552
total tree bytes: 6352224256
total fs tree bytes: 1544847360
total extent tree bytes: 237551616
btree space waste bytes: 650901113
file data blocks allocated: 5041330393088
referenced 5050128224256
Btrfs v3.17
This was mounted,ro during the send... can anyone tell me whether
there's a slight chance in any corruption at the source side? I.e. does
btrfs itself or something from btrfs send modify anything on the disk
when it's mounted read-only?
Do I have to look for corruptions or run a scrub?
Thanks,
Chris.
smime.p7s
Description: S/MIME cryptographic signature
