Package: mdadm Version: 3.3.4-1.1+b1 Severity: normal hello,
mdadm eats all CPU time of all cores. This ShouldNotHappen(tm) I had a lvm volume on a disk which failed while I was trying to upgrade the volume to raid1 so my raid configureation is very broken. killing mdadm only helps temporarily. it restarts itself. Is there any debug information I can provide before I trash the disks? Thanks Michal -- Package-specific info: --- mdadm.conf CREATE owner=root group=disk mode=0660 auto=yes HOMEHOST <system> MAILADDR root ARRAY metadata=ddf UUID=587baab3:c41402e5:c334b912:99c2ce3f ARRAY container=587baab3:c41402e5:c334b912:99c2ce3f member=0 UUID=363fa001:b5660ad0:24715b0d:afaecdb2 --- /etc/default/mdadm INITRDSTART='none' AUTOCHECK=true START_DAEMON=true DAEMON_OPTIONS="--syslog" VERBOSE=false --- /proc/mdstat: Personalities : [linear] [raid1] md126 : inactive sdg[0] 975585280 blocks super external:/md127/0 md127 : inactive sdg[0](S) 1177304 blocks super external:ddf unused devices: <none> --- /proc/partitions: major minor #blocks name 8 80 31266648 sdf 8 81 4193280 sdf1 8 82 27070464 sdf2 8 96 976762584 sdg 8 112 244198584 sdh 8 113 244197376 sdh1 8 128 244198584 sdi 8 129 20481024 sdi1 8 130 3148740 sdi2 8 132 220564417 sdi4 7 0 55562240 loop0 8 0 30310400 sda 8 1 30310384 sda1 --- LVM physical volumes: PV VG Fmt Attr PSize PFree /dev/sdg scratchg lvm2 a-- 931.51g 8.00m --- mount output sysfs on /sys type sysfs (rw,nosuid,nodev,noexec,relatime) proc on /proc type proc (rw,relatime) udev on /dev type devtmpfs (rw,relatime,size=10240k,nr_inodes=1005252,mode=755) devpts on /dev/pts type devpts (rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000) tmpfs on /run type tmpfs (rw,nosuid,relatime,size=1612848k,mode=755) /dev/sdf2 on / type ext3 (rw,relatime,errors=remount-ro,data=ordered) securityfs on /sys/kernel/security type securityfs (rw,nosuid,nodev,noexec,relatime) tmpfs on /dev/shm type tmpfs (rw,nosuid,nodev) tmpfs on /run/lock type tmpfs (rw,nosuid,nodev,noexec,relatime,size=5120k) tmpfs on /sys/fs/cgroup type tmpfs (ro,nosuid,nodev,noexec,mode=755) cgroup on /sys/fs/cgroup/systemd type cgroup (rw,nosuid,nodev,noexec,relatime,xattr,release_agent=/lib/systemd/systemd-cgroups-agent,name=systemd) pstore on /sys/fs/pstore type pstore (rw,nosuid,nodev,noexec,relatime) cgroup on /sys/fs/cgroup/cpuset type cgroup (rw,nosuid,nodev,noexec,relatime,cpuset) cgroup on /sys/fs/cgroup/blkio type cgroup (rw,nosuid,nodev,noexec,relatime,blkio) cgroup on /sys/fs/cgroup/cpu,cpuacct type cgroup (rw,nosuid,nodev,noexec,relatime,cpu,cpuacct) cgroup on /sys/fs/cgroup/freezer type cgroup (rw,nosuid,nodev,noexec,relatime,freezer) cgroup on /sys/fs/cgroup/perf_event type cgroup (rw,nosuid,nodev,noexec,relatime,perf_event) cgroup on /sys/fs/cgroup/devices type cgroup (rw,nosuid,nodev,noexec,relatime,devices) cgroup on /sys/fs/cgroup/net_cls,net_prio type cgroup (rw,nosuid,nodev,noexec,relatime,net_cls,net_prio) systemd-1 on /proc/sys/fs/binfmt_misc type autofs (rw,relatime,fd=35,pgrp=1,timeout=0,minproto=5,maxproto=5,direct) debugfs on /sys/kernel/debug type debugfs (rw,relatime) hugetlbfs on /dev/hugepages type hugetlbfs (rw,relatime) mqueue on /dev/mqueue type mqueue (rw,relatime) /dev/sdh1 on /srv/rhev type ext4 (rw,relatime,data=ordered) /dev/sdi1 on /home type ext3 (rw,relatime,errors=remount-ro,data=ordered) /dev/sdi4 on /scratch type ext3 (rw,relatime,data=ordered) rpc_pipefs on /run/rpc_pipefs type rpc_pipefs (rw,relatime) nfsd on /proc/fs/nfsd type nfsd (rw,relatime) binfmt_misc on /proc/sys/fs/binfmt_misc type binfmt_misc (rw,relatime) tmpfs on /run/user/1000 type tmpfs (rw,nosuid,nodev,relatime,size=806424k,mode=700,uid=1000,gid=1000) gvfsd-fuse on /run/user/1000/gvfs type fuse.gvfsd-fuse (rw,nosuid,nodev,relatime,user_id=1000,group_id=1000) fusectl on /sys/fs/fuse/connections type fusectl (rw,relatime) usmb on /home/hramrach/mnt type fuse.usmb (rw,nosuid,nodev,relatime,user_id=1000,group_id=1000,max_read=32768) servo:/srv/samba/au on /home/hramrach/au type fuse.sshfs (rw,nosuid,nodev,relatime,user_id=1000,group_id=1000) servo:/srv/scratch/Incoming on /home/hramrach/inc type fuse.sshfs (rw,nosuid,nodev,relatime,user_id=1000,group_id=1000) usmb on /home/hramrach/win type fuse.usmb (rw,nosuid,nodev,relatime,user_id=1000,group_id=1000,max_read=32768) /dev/sda1 on /srv/flash type ext4 (rw,relatime,data=ordered) usmb on /home/hramrach/data type fuse.usmb (rw,nosuid,nodev,relatime,user_id=1000,group_id=1000,max_read=32768) usmb on /home/hramrach/inst type fuse.usmb (rw,nosuid,nodev,relatime,user_id=1000,group_id=1000,max_read=32768) heretic:/media/sdg1 on /home/hramrach/test type fuse.sshfs (rw,nosuid,nodev,relatime,user_id=1000,group_id=1000) --- initrd.img-3.16.0-4-amd64: gzip: /boot/initrd.img-3.16.0-4-amd64: not in gzip format cpio: premature end of archive --- initrd's /conf/conf.d/md: no conf/md file. --- /proc/modules: raid1 34596 0 - Live 0xffffffffa052f000 linear 12735 0 - Live 0xffffffffa050f000 md_mod 107672 2 raid1,linear, Live 0xffffffffa0546000 raid6_pq 95238 1 btrfs, Live 0xffffffffa01df000 dm_mod 89405 0 - Live 0xffffffffa0164000 --- /var/log/syslog: --- volume detail: /dev/sda: MBR Magic : aa55 Partition[0] : 60620768 sectors at 32 (type 0c) -- /dev/sda1 is not recognised by mdadm. /dev/sdb is not recognised by mdadm. /dev/sdc is not recognised by mdadm. /dev/sdd is not recognised by mdadm. /dev/sde is not recognised by mdadm. /dev/sdf: MBR Magic : aa55 Partition[0] : 8386560 sectors at 2048 (type 82) Partition[1] : 54140928 sectors at 8388608 (type 83) -- /dev/sdf1 is not recognised by mdadm. /dev/sdf2: MBR Magic : aa55 Partition[0] : 432871117 sectors at 3224498923 (type 07) Partition[1] : 1953460034 sectors at 3272020941 (type 16) Partition[3] : 924335794 sectors at 50200576 (type 00) -- /dev/sdg: Magic : de11de11 Version : 01.00.00 Controller GUID : 496E7465:6C202020:00000000:00000000:00000000:00000000 (Intel ) Container GUID : 496E7465:6C202020:10000060:80863505:38F47967:4E4B718F (Intel 04/12/10 15:25:59) Seq : 00000b64 Redundant hdr : yes Virtual Disks : 1 VD GUID[0] : 496E7465:6C202020:10000060:80863505:38F47967:34558A8F (Intel 04/12/10 15:25:59) unit[0] : 0 state[0] : Optimal, Consistent init state[0] : Not Initialised access[0] : Read/Write Name[0] : Raid Devices[0] : 5 (0@0K 2@0K 4@0K 3@0K 1@0K) Chunk Size[0] : 512 sectors Raid Level[0] : RAID5 Device Size[0] : 975585280 Array Size[0] : 3902341120 Physical Disks : 255 Number RefNo Size Device Type/State 0 2e49dd7b 975585280K active/Online 1 d017a3c4 975585280K /dev/sdg active/Online 2 37904b5d 975585280K active/Online 3 88d64490 975585280K active/Online 4 a8d7fadc 975585280K active/Online -- /dev/sdh: MBR Magic : aa55 Partition[0] : 488397167 sectors at 1 (type ee) -- /dev/sdh1 is not recognised by mdadm. /dev/sdi: MBR Magic : aa55 Partition[0] : 40962048 sectors at 2048 (type 83) Partition[1] : 6297480 sectors at 40965750 (type 82) Partition[3] : 441128835 sectors at 47263230 (type 83) -- /dev/sdi1 is not recognised by mdadm. /dev/sdi2 is not recognised by mdadm. /dev/sdi4 is not recognised by mdadm. --- /proc/cmdline BOOT_IMAGE=/boot/vmlinuz-3.16.0-4-amd64 root=UUID=3b8f6a64-5899-462a-aec0-6ddefd878ecf ro fbcon=rotate:3 elevator=deadline console=tty0 console=ttyS0,115200n8 quiet --- grub2: set root='hd0,msdos2' set root='hd0,msdos2' set root='hd0,msdos2' linux /boot/vmlinuz-4.3.0-1-amd64 root=UUID=3b8f6a64-5899-462a-aec0-6ddefd878ecf ro fbcon=rotate:3 elevator=deadline console=tty0 console=ttyS0,115200n8 quiet set root='hd0,msdos2' linux /boot/vmlinuz-4.3.0-1-amd64 root=UUID=3b8f6a64-5899-462a-aec0-6ddefd878ecf ro fbcon=rotate:3 elevator=deadline console=tty0 console=ttyS0,115200n8 quiet set root='hd0,msdos2' linux /boot/vmlinuz-4.3.0-1-amd64 root=UUID=3b8f6a64-5899-462a-aec0-6ddefd878ecf ro fbcon=rotate:3 elevator=deadline console=tty0 console=ttyS0,115200n8 quiet init=/lib/sysvinit/init set root='hd0,msdos2' linux /boot/vmlinuz-4.3.0-1-amd64 root=UUID=3b8f6a64-5899-462a-aec0-6ddefd878ecf ro single fbcon=rotate:3 elevator=deadline console=tty0 console=ttyS0,115200n8 set root='hd0,msdos2' linux /boot/vmlinuz-4.2.0-1-amd64 root=UUID=3b8f6a64-5899-462a-aec0-6ddefd878ecf ro fbcon=rotate:3 elevator=deadline console=tty0 console=ttyS0,115200n8 quiet set root='hd0,msdos2' linux /boot/vmlinuz-4.2.0-1-amd64 root=UUID=3b8f6a64-5899-462a-aec0-6ddefd878ecf ro fbcon=rotate:3 elevator=deadline console=tty0 console=ttyS0,115200n8 quiet init=/lib/sysvinit/init set root='hd0,msdos2' linux /boot/vmlinuz-4.2.0-1-amd64 root=UUID=3b8f6a64-5899-462a-aec0-6ddefd878ecf ro single fbcon=rotate:3 elevator=deadline console=tty0 console=ttyS0,115200n8 set root='hd0,msdos2' linux /boot/vmlinuz-4.1.0-2-amd64 root=UUID=3b8f6a64-5899-462a-aec0-6ddefd878ecf ro fbcon=rotate:3 elevator=deadline console=tty0 console=ttyS0,115200n8 quiet set root='hd0,msdos2' linux /boot/vmlinuz-4.1.0-2-amd64 root=UUID=3b8f6a64-5899-462a-aec0-6ddefd878ecf ro fbcon=rotate:3 elevator=deadline console=tty0 console=ttyS0,115200n8 quiet init=/lib/sysvinit/init set root='hd0,msdos2' linux /boot/vmlinuz-4.1.0-2-amd64 root=UUID=3b8f6a64-5899-462a-aec0-6ddefd878ecf ro single fbcon=rotate:3 elevator=deadline console=tty0 console=ttyS0,115200n8 set root='hd0,msdos2' linux /boot/vmlinuz-4.1.0-rc7+ root=UUID=3b8f6a64-5899-462a-aec0-6ddefd878ecf ro fbcon=rotate:3 elevator=deadline console=tty0 console=ttyS0,115200n8 quiet set root='hd0,msdos2' linux /boot/vmlinuz-4.1.0-rc7+ root=UUID=3b8f6a64-5899-462a-aec0-6ddefd878ecf ro fbcon=rotate:3 elevator=deadline console=tty0 console=ttyS0,115200n8 quiet init=/lib/sysvinit/init set root='hd0,msdos2' linux /boot/vmlinuz-4.1.0-rc7+ root=UUID=3b8f6a64-5899-462a-aec0-6ddefd878ecf ro single fbcon=rotate:3 elevator=deadline console=tty0 console=ttyS0,115200n8 set root='hd0,msdos2' linux /boot/vmlinuz-3.16.0-4-amd64 root=UUID=3b8f6a64-5899-462a-aec0-6ddefd878ecf ro fbcon=rotate:3 elevator=deadline console=tty0 console=ttyS0,115200n8 quiet set root='hd0,msdos2' linux /boot/vmlinuz-3.16.0-4-amd64 root=UUID=3b8f6a64-5899-462a-aec0-6ddefd878ecf ro fbcon=rotate:3 elevator=deadline console=tty0 console=ttyS0,115200n8 quiet init=/lib/sysvinit/init set root='hd0,msdos2' linux /boot/vmlinuz-3.16.0-4-amd64 root=UUID=3b8f6a64-5899-462a-aec0-6ddefd878ecf ro single fbcon=rotate:3 elevator=deadline console=tty0 console=ttyS0,115200n8 set root='hd0,msdos2' set root='hd0,msdos2' set root='hd0,msdos2' set root='hd0,msdos2' set root='hd0,msdos2' --- udev: ii udev 228-2+b1 amd64 /dev/ and hotplug management daem e95faba71945b1dcc9749adc5dcd80f6 /lib/udev/rules.d/63-md-raid-arrays.rules f0b45148fbd3ce678e682925483f17dc /lib/udev/rules.d/64-md-raid-assembly.rules d3f53eb83e89c327ad6aa0ca66f6124e /lib/udev/rules.d/99-systemd.rules --- /dev: brw-rw---- 1 root disk 9, 126 Oct 12 12:51 /dev/md126 brw-rw---- 1 root disk 9, 127 Oct 12 12:51 /dev/md127 /dev/disk/by-id: total 0 lrwxrwxrwx 1 root root 9 Dec 16 10:34 ata-OCZ-VERTEX_MVAGA96489K2H3ITG14W -> ../../sdf lrwxrwxrwx 1 root root 10 Dec 16 10:34 ata-OCZ-VERTEX_MVAGA96489K2H3ITG14W-part1 -> ../../sdf1 lrwxrwxrwx 1 root root 10 Dec 16 10:34 ata-OCZ-VERTEX_MVAGA96489K2H3ITG14W-part2 -> ../../sdf2 lrwxrwxrwx 1 root root 9 Dec 28 14:59 ata-SAMSUNG_HD252HJ_S17HJ9CS700120 -> ../../sdi lrwxrwxrwx 1 root root 10 Dec 28 14:59 ata-SAMSUNG_HD252HJ_S17HJ9CS700120-part1 -> ../../sdi1 lrwxrwxrwx 1 root root 10 Dec 28 14:59 ata-SAMSUNG_HD252HJ_S17HJ9CS700120-part2 -> ../../sdi2 lrwxrwxrwx 1 root root 10 Dec 28 14:59 ata-SAMSUNG_HD252HJ_S17HJ9CS700120-part4 -> ../../sdi4 lrwxrwxrwx 1 root root 9 Dec 16 10:34 ata-ST31000340NS_9QJ5VCB0 -> ../../sdg lrwxrwxrwx 1 root root 9 Dec 16 10:34 ata-WDC_WD2500AAKX-00ERMA0_WD-WCC2H1473772 -> ../../sdh lrwxrwxrwx 1 root root 10 Dec 16 10:34 ata-WDC_WD2500AAKX-00ERMA0_WD-WCC2H1473772-part1 -> ../../sdh1 lrwxrwxrwx 1 root root 11 Oct 12 12:51 md-uuid-587baab3:c41402e5:c334b912:99c2ce3f -> ../../md127 lrwxrwxrwx 1 root root 9 Dec 16 10:34 usb-ADATA_USB_Flash_Drive_1530909332060018-0:0 -> ../../sda lrwxrwxrwx 1 root root 10 Dec 16 10:34 usb-ADATA_USB_Flash_Drive_1530909332060018-0:0-part1 -> ../../sda1 lrwxrwxrwx 1 root root 9 Oct 12 12:51 usb-TEAC_USB_HS-CF_Card_000004114507-0:0 -> ../../sdb lrwxrwxrwx 1 root root 9 Oct 12 12:51 usb-TEAC_USB_HS-MS_Card_000004114507-0:2 -> ../../sdd lrwxrwxrwx 1 root root 9 Oct 12 12:51 usb-TEAC_USB_HS-SD_Card_000004114507-0:3 -> ../../sde lrwxrwxrwx 1 root root 9 Oct 12 12:51 usb-TEAC_USB_HS-xD_SM_000004114507-0:1 -> ../../sdc lrwxrwxrwx 1 root root 9 Dec 16 10:34 wwn-0x5000c50019d48bc3 -> ../../sdg lrwxrwxrwx 1 root root 9 Dec 16 10:34 wwn-0x50014ee25de82098 -> ../../sdh lrwxrwxrwx 1 root root 10 Dec 16 10:34 wwn-0x50014ee25de82098-part1 -> ../../sdh1 lrwxrwxrwx 1 root root 9 Dec 28 14:59 wwn-0x50024e9200b9dfe5 -> ../../sdi lrwxrwxrwx 1 root root 10 Dec 28 14:59 wwn-0x50024e9200b9dfe5-part1 -> ../../sdi1 lrwxrwxrwx 1 root root 10 Dec 28 14:59 wwn-0x50024e9200b9dfe5-part2 -> ../../sdi2 lrwxrwxrwx 1 root root 10 Dec 28 14:59 wwn-0x50024e9200b9dfe5-part4 -> ../../sdi4 /dev/disk/by-label: total 0 lrwxrwxrwx 1 root root 10 Dec 16 10:34 ADATA\x20UFD -> ../../sda1 lrwxrwxrwx 1 root root 10 Dec 16 10:34 TOP -> ../../sdh1 lrwxrwxrwx 1 root root 10 Dec 28 14:59 scratch -> ../../sdi4 /dev/disk/by-partuuid: total 0 lrwxrwxrwx 1 root root 10 Dec 16 10:34 0abbefd1-f3ef-4cc7-8df7-c210dd0ed248 -> ../../sdh1 /dev/disk/by-path: total 0 lrwxrwxrwx 1 root root 9 Oct 12 12:51 pci-0000:00:1d.7-usb-0:2:1.0-scsi-0:0:0:0 -> ../../sdb lrwxrwxrwx 1 root root 9 Oct 12 12:51 pci-0000:00:1d.7-usb-0:2:1.0-scsi-0:0:0:1 -> ../../sdc lrwxrwxrwx 1 root root 9 Oct 12 12:51 pci-0000:00:1d.7-usb-0:2:1.0-scsi-0:0:0:2 -> ../../sdd lrwxrwxrwx 1 root root 9 Oct 12 12:51 pci-0000:00:1d.7-usb-0:2:1.0-scsi-0:0:0:3 -> ../../sde lrwxrwxrwx 1 root root 9 Dec 16 10:34 pci-0000:00:1d.7-usb-0:4:1.0-scsi-0:0:0:0 -> ../../sda lrwxrwxrwx 1 root root 10 Dec 16 10:34 pci-0000:00:1d.7-usb-0:4:1.0-scsi-0:0:0:0-part1 -> ../../sda1 lrwxrwxrwx 1 root root 9 Dec 16 10:34 pci-0000:00:1f.2-ata-1 -> ../../sdf lrwxrwxrwx 1 root root 10 Dec 16 10:34 pci-0000:00:1f.2-ata-1-part1 -> ../../sdf1 lrwxrwxrwx 1 root root 10 Dec 16 10:34 pci-0000:00:1f.2-ata-1-part2 -> ../../sdf2 lrwxrwxrwx 1 root root 9 Dec 16 10:34 pci-0000:00:1f.2-ata-2 -> ../../sdg lrwxrwxrwx 1 root root 9 Dec 16 10:34 pci-0000:00:1f.2-ata-3 -> ../../sdh lrwxrwxrwx 1 root root 10 Dec 16 10:34 pci-0000:00:1f.2-ata-3-part1 -> ../../sdh1 lrwxrwxrwx 1 root root 9 Dec 28 14:59 pci-0000:00:1f.2-ata-4 -> ../../sdi lrwxrwxrwx 1 root root 10 Dec 28 14:59 pci-0000:00:1f.2-ata-4-part1 -> ../../sdi1 lrwxrwxrwx 1 root root 10 Dec 28 14:59 pci-0000:00:1f.2-ata-4-part2 -> ../../sdi2 lrwxrwxrwx 1 root root 10 Dec 28 14:59 pci-0000:00:1f.2-ata-4-part4 -> ../../sdi4 /dev/disk/by-uuid: total 0 lrwxrwxrwx 1 root root 10 Dec 16 10:34 11810da4-05ad-4a1b-b8e0-79863647cb21 -> ../../sdf1 lrwxrwxrwx 1 root root 10 Dec 16 10:34 3b8f6a64-5899-462a-aec0-6ddefd878ecf -> ../../sdf2 lrwxrwxrwx 1 root root 10 Dec 28 14:59 41e011b8-b2f8-4b34-8569-f2bc2fee857c -> ../../sdi1 lrwxrwxrwx 1 root root 10 Dec 16 10:34 57132f3a-eaad-41eb-9d87-a785233250d9 -> ../../sdh1 lrwxrwxrwx 1 root root 10 Dec 16 10:34 88d552cd-4334-4198-b4ba-52d0aeb595da -> ../../sda1 lrwxrwxrwx 1 root root 10 Dec 28 14:59 929f5342-f2f0-4cf6-8afc-bdcd24025c17 -> ../../sdi4 lrwxrwxrwx 1 root root 10 Dec 28 14:59 a453c46e-217d-44a4-8cd9-68bd1289a889 -> ../../sdi2 /dev/md: total 0 lrwxrwxrwx 1 root root 8 Oct 12 12:51 ddf0 -> ../md127 Auto-generated on Fri, 08 Jan 2016 13:34:23 +0100 by mdadm bugscript -- System Information: Debian Release: stretch/sid APT prefers testing APT policy: (910, 'testing'), (900, 'stable'), (610, 'oldstable'), (410, 'unstable'), (400, 'experimental') Architecture: amd64 (x86_64) Foreign Architectures: i386, armhf Kernel: Linux 3.16.0-4-amd64 (SMP w/4 CPU cores) Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8) (ignored: LC_ALL set to en_US.UTF-8) Shell: /bin/sh linked to /bin/bash Init: systemd (via /run/systemd/system) Versions of packages mdadm depends on: ii debconf [debconf-2.0] 1.5.58 ii initscripts 2.88dsf-59.2 ii libc6 2.21-4 ii lsb-base 9.20150917 ii udev 228-2+b1 Versions of packages mdadm recommends: ii kmod 21-1 ii lsb-invalid-mta [mail-transport-agent] 4.1+Debian13+nmu1 ii module-init-tools 21-1 mdadm suggests no packages. -- debconf information: mdadm/autocheck: true mdadm/initrdstart_msg_intro: mdadm/initrdstart_msg_errexist: mdadm/start_daemon: true mdadm/mail_to: root mdadm/initrdstart_msg_errconf: mdadm/initrdstart_msg_errblock: * mdadm/initrdstart: none mdadm/initrdstart_msg_errmd: mdadm/initrdstart_notinconf: false