Summary: raid5_error needs to handle the first scsi error from a device and
do the necessary action, but silently return on subsequent failures.
- 3 h/w raid0's in a s/w raid5
- initial resync isn't finished (not important)
- scsi error passed up takes out one of the devices
bug triggered is when raid5_error is called passing in a device (sde1)
that doesn't match against "disk->dev == dev && disk->operational"
(mainly because the disk->operational was already set to 0 13 seconds
previously when the first scsi error was passed back and sde1 matched)
Since multiple scsi errors getting passed back from the same failure
seems valid (multiple commands had been sent, and each will fail in turn),
we should simply handle the first one and have raid5_error exit quietly
on the later ones (re-doing the spare code execution could possibly even
cause big problems for multiple available spares). Patch attached.
Personalities : [raid5]
read_ahead 1024 sectors
md0 : active raid5 sde1[2](F) sdd1[1] sdc1[0] 177718016 blocks level 5, 4k chunk,
algorithm 0 [3/2] [UU_]
unused devices: <none>
log attached.
James
--- linux/drivers/block/raid5.c.orig Thu Apr 20 11:27:37 2000
+++ linux/drivers/block/raid5.c Thu Apr 20 11:32:16 2000
@@ -611,23 +611,29 @@
PRINTK(("raid5_error called\n"));
conf->resync_parity = 0;
for (i = 0, disk = conf->disks; i < conf->raid_disks; i++, disk++) {
- if (disk->dev == dev && disk->operational) {
- disk->operational = 0;
- mark_disk_faulty(sb->disks+disk->number);
- mark_disk_nonsync(sb->disks+disk->number);
- mark_disk_inactive(sb->disks+disk->number);
- sb->active_disks--;
- sb->working_disks--;
- sb->failed_disks++;
- mddev->sb_dirty = 1;
- conf->working_disks--;
- conf->failed_disks++;
- md_wakeup_thread(conf->thread);
- printk (KERN_ALERT
- "raid5: Disk failure on %s, disabling device."
- " Operation continuing on %d devices\n",
- partition_name (dev), conf->working_disks);
- return -EIO;
+ /* Did we find the device with the error? */
+ if (disk->dev == dev) {
+ /* Did we handle its failure already? */
+ if (disk->operational) {
+ disk->operational = 0;
+ mark_disk_faulty(sb->disks+disk->number);
+ mark_disk_nonsync(sb->disks+disk->number);
+ mark_disk_inactive(sb->disks+disk->number);
+ sb->active_disks--;
+ sb->working_disks--;
+ sb->failed_disks++;
+ mddev->sb_dirty = 1;
+ conf->working_disks--;
+ conf->failed_disks++;
+ md_wakeup_thread(conf->thread);
+ printk (KERN_ALERT
+ "raid5: Disk failure on %s, disabling device."
+ " Operation continuing on %d devices\n",
+ partition_name (dev), conf->working_disks);
+ return -EIO;
+ }
+ /* Don't do anything for failures past the first */
+ return 0;
}
}
/*
Apr 19 16:02:41 rts-test2 kernel: SCSI disk error : host 3 channel 0 id 2 lun 0 return
code = 8000000
Apr 19 16:02:41 rts-test2 kernel: [valid=0] Info fld=0x0, Current sd08:41: sense key
None
Apr 19 16:02:41 rts-test2 kernel: scsidisk I/O error: dev 08:41, sector 9296408
Apr 19 16:02:41 rts-test2 kernel: interrupting MD-thread pid 2807
Apr 19 16:02:41 rts-test2 kernel: raid5: parity resync was not fully finished,
restarting next time.
Apr 19 16:02:41 rts-test2 kernel: raid5: Disk failure on sde1, disabling device.
Operation continuing on 2 devices
Apr 19 16:02:41 rts-test2 kernel: md: recovery thread got woken up ...
Apr 19 16:02:41 rts-test2 kernel: md0: no spare disk to reconstruct array! --
continuing in degraded mode
Apr 19 16:02:41 rts-test2 kernel: md: recovery thread finished ...
Apr 19 16:02:41 rts-test2 kernel: md: updating md0 RAID superblock on device
Apr 19 16:02:41 rts-test2 kernel: (skipping faulty sde1 )
Apr 19 16:02:41 rts-test2 kernel: sdd1 [events: 00000002](write) sdd1's sb offset:
88859008
Apr 19 16:02:41 rts-test2 kernel: sdc1 [events: 00000002](write) sdc1's sb offset:
88859008
Apr 19 16:02:41 rts-test2 kernel: .
Apr 19 16:02:41 rts-test2 kernel: raid5: restarting stripe 9296408
Apr 19 16:02:54 rts-test2 kernel: SCSI disk error : host 3 channel 0 id 2 lun 0 return
code = 8000000
Apr 19 16:02:54 rts-test2 kernel: [valid=0] Info fld=0x0, Current sd08:41: sense key
None
Apr 19 16:02:54 rts-test2 kernel: scsidisk I/O error: dev 08:41, sector 9296416
Apr 19 16:02:54 rts-test2 kernel: md: bug in file raid5.c, line 659
Apr 19 16:02:54 rts-test2 kernel:
Apr 19 16:02:54 rts-test2 kernel: **********************************
Apr 19 16:02:54 rts-test2 kernel: * <COMPLETE RAID STATE PRINTOUT> *
Apr 19 16:02:54 rts-test2 kernel: **********************************
Apr 19 16:02:54 rts-test2 kernel: md0: <sde1><sdd1><sdc1> array superblock:
Apr 19 16:02:54 rts-test2 kernel: SB: (V:0.90.0)
ID:<6559d3fa.5eea22f2.10760e7d.ff860db0> CT:38fe0780
Apr 19 16:02:54 rts-test2 kernel: L5 S88859008 ND:3 RD:3 md0 LO:0 CS:4096
Apr 19 16:02:54 rts-test2 kernel: UT:38fe10e1 ST:0 AD:2 WD:2 FD:1 SD:0
CSUM:bbb55c98 E:00000002
Apr 19 16:02:54 rts-test2 kernel: D 0: DISK<N:0,sdc1(8,33),R:0,S:6>
Apr 19 16:02:54 rts-test2 kernel: D 1: DISK<N:1,sdd1(8,49),R:1,S:6>
Apr 19 16:02:54 rts-test2 kernel: D 2: DISK<N:2,sde1(8,65),R:2,S:1>
Apr 19 16:02:54 rts-test2 kernel: D 3: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 16:02:54 rts-test2 kernel: D 4: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 16:02:54 rts-test2 kernel: D 5: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 16:02:54 rts-test2 kernel: D 6: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 16:02:54 rts-test2 kernel: D 7: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 16:02:54 rts-test2 kernel: D 8: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 16:02:54 rts-test2 kernel: D 9: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 16:02:54 rts-test2 kernel: D 10: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 16:02:54 rts-test2 kernel: D 11: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 16:02:54 rts-test2 kernel: THIS: DISK<N:2,sde1(8,65),R:2,S:6>
Apr 19 16:02:54 rts-test2 kernel: rdev sde1: O:sde1, SZ:00000000 F:1 DN:2 no rdev
superblock!
Apr 19 16:02:54 rts-test2 kernel: rdev sdd1: O:sdd1, SZ:88859008 F:0 DN:1 rdev
superblock:
Apr 19 16:02:54 rts-test2 kernel: SB: (V:0.90.0)
ID:<6559d3fa.5eea22f2.10760e7d.ff860db0> CT:38fe0780
Apr 19 16:02:54 rts-test2 kernel: L5 S88859008 ND:3 RD:3 md0 LO:0 CS:4096
Apr 19 16:02:54 rts-test2 kernel: UT:38fe10e1 ST:0 AD:2 WD:2 FD:1 SD:0
CSUM:f4b36d87 E:00000002
Apr 19 16:02:54 rts-test2 kernel: D 0: DISK<N:0,sdc1(8,33),R:0,S:6>
Apr 19 16:02:54 rts-test2 kernel: D 1: DISK<N:1,sdd1(8,49),R:1,S:6>
Apr 19 16:02:54 rts-test2 kernel: D 2: DISK<N:2,sde1(8,65),R:2,S:1>
Apr 19 16:02:54 rts-test2 kernel: D 3: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 16:02:54 rts-test2 kernel: D 4: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 16:02:54 rts-test2 kernel: D 5: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 16:02:54 rts-test2 kernel: D 6: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 16:02:54 rts-test2 kernel: D 7: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 16:02:54 rts-test2 kernel: D 8: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 16:02:54 rts-test2 kernel: D 9: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 16:02:54 rts-test2 kernel: D 10: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 16:02:54 rts-test2 kernel: D 11: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 16:02:54 rts-test2 kernel: THIS: DISK<N:1,sdd1(8,49),R:1,S:6>
Apr 19 16:02:54 rts-test2 kernel: rdev sdc1: O:sdc1, SZ:88859008 F:0 DN:0 rdev
superblock:
Apr 19 16:02:54 rts-test2 kernel: SB: (V:0.90.0)
ID:<6559d3fa.5eea22f2.10760e7d.ff860db0> CT:38fe0780
Apr 19 16:02:54 rts-test2 kernel: L5 S88859008 ND:3 RD:3 md0 LO:0 CS:4096
Apr 19 16:02:54 rts-test2 kernel: UT:38fe10e1 ST:0 AD:2 WD:2 FD:1 SD:0
CSUM:f4b36d75 E:00000002
Apr 19 16:02:54 rts-test2 kernel: D 0: DISK<N:0,sdc1(8,33),R:0,S:6>
Apr 19 16:02:54 rts-test2 kernel: D 1: DISK<N:1,sdd1(8,49),R:1,S:6>
Apr 19 16:02:54 rts-test2 kernel: D 2: DISK<N:2,sde1(8,65),R:2,S:1>
Apr 19 16:02:54 rts-test2 kernel: D 3: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 16:02:54 rts-test2 kernel: D 4: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 16:02:54 rts-test2 kernel: D 5: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 16:02:54 rts-test2 kernel: D 6: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 16:02:54 rts-test2 kernel: D 7: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 16:02:54 rts-test2 kernel: D 8: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 16:02:54 rts-test2 kernel: D 9: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 16:02:54 rts-test2 kernel: D 10: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 16:02:54 rts-test2 kernel: D 11: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 16:02:54 rts-test2 kernel: THIS: DISK<N:0,sdc1(8,33),R:0,S:6>
Apr 19 16:02:54 rts-test2 kernel: **********************************
Apr 19 16:02:54 rts-test2 kernel:
Apr 19 16:02:54 rts-test2 kernel: raid5: restarting stripe 9296416
Apr 19 16:02:54 rts-test2 kernel: md: recovery thread got woken up ...
Apr 19 16:02:54 rts-test2 kernel: md0: no spare disk to reconstruct array! --
continuing in degraded mode
Apr 19 16:02:54 rts-test2 kernel: md: recovery thread finished ...
Apr 19 16:02:54 rts-test2 kernel: md_do_sync() got signal ... exiting
Apr 19 16:02:54 rts-test2 kernel: raid5: resync aborted!
[... later booting ...]
Apr 19 17:44:59 rts-test2 kernel: scsi2 : IBM PCI ServeRAID 3.60.02 <ServeRAID 3H>
Apr 19 17:44:59 rts-test2 kernel: scsi3 : IBM PCI ServeRAID 3.60.02 <ServeRAID 3H>
Apr 19 17:44:59 rts-test2 kernel: scsi : 4 hosts.
Apr 19 17:44:59 rts-test2 kernel: Vendor: IBM Model: SERVERAID Rev:
1.0
Apr 19 17:44:59 rts-test2 kernel: Type: Processor ANSI
SCSI revision: 01
Apr 19 17:45:13 rts-test2 kernel: Vendor: IBM Model: SERVERAID Rev:
1.0
Apr 19 17:45:13 rts-test2 kernel: Type: Direct-Access ANSI
SCSI revision: 01
Apr 19 17:45:13 rts-test2 kernel: Detected scsi disk sdc at scsi3, channel 0, id 0,
lun 0
Apr 19 17:45:13 rts-test2 kernel: Vendor: IBM Model: SERVERAID Rev:
1.0
Apr 19 17:45:13 rts-test2 kernel: Type: Direct-Access ANSI
SCSI revision: 01
Apr 19 17:45:13 rts-test2 kernel: Detected scsi disk sdd at scsi3, channel 0, id 1,
lun 0
Apr 19 17:45:13 rts-test2 kernel: Vendor: IBM Model: SERVERAID Rev:
1.0
Apr 19 17:45:13 rts-test2 kernel: Type: Direct-Access ANSI
SCSI revision: 01
Apr 19 17:45:13 rts-test2 kernel: Detected scsi disk sde at scsi3, channel 0, id 2,
lun 0
Apr 19 17:45:13 rts-test2 kernel: Vendor: IBM Model: SERVERAID Rev:
1.0
Apr 19 17:45:13 rts-test2 kernel: Type: Processor ANSI
SCSI revision: 01
Apr 19 17:45:14 rts-test2 kernel: Vendor: IBM Model: 3520EX10 Rev: 2
Apr 19 17:45:14 rts-test2 kernel: Type: Processor ANSI
SCSI revision: 02
Apr 19 17:45:14 rts-test2 kernel: Vendor: IBM Model: 3520EX10 Rev: 2
Apr 19 17:45:14 rts-test2 kernel: Type: Processor ANSI
SCSI revision: 02
Apr 19 17:45:16 rts-test2 kernel: Vendor: IBM Model: 3520EX10 Rev: 2
Apr 19 17:45:16 rts-test2 kernel: Type: Processor ANSI
SCSI revision: 02
Apr 19 17:45:16 rts-test2 kernel: Vendor: IBM Model: 3520EX10 Rev: 2
Apr 19 17:45:16 rts-test2 kernel: Type: Processor ANSI
SCSI revision: 02
Apr 19 17:45:17 rts-test2 kernel: Vendor: IBM Model: 3520EX10 Rev: 2
Apr 19 17:45:17 rts-test2 kernel: Type: Processor ANSI
SCSI revision: 02
Apr 19 17:45:17 rts-test2 kernel: Vendor: IBM Model: 3520EX10 Rev: 2
Apr 19 17:45:17 rts-test2 kernel: Type: Processor ANSI
SCSI revision: 02
Apr 19 17:45:17 rts-test2 kernel: SCSI device sdc: hdwr sector= 512 bytes. Sectors=
177725440 [86780 MB] [86.8 GB]
Apr 19 17:45:17 rts-test2 kernel: sdc: sdc1
Apr 19 17:45:17 rts-test2 kernel: SCSI device sdd: hdwr sector= 512 bytes. Sectors=
177725440 [86780 MB] [86.8 GB]
Apr 19 17:45:17 rts-test2 kernel: sdd: sdd1
Apr 19 17:45:17 rts-test2 kernel: SCSI device sde: hdwr sector= 512 bytes. Sectors=
177725440 [86780 MB] [86.8 GB]
Apr 19 17:45:17 rts-test2 kernel: sde: sde1
Apr 19 17:45:26 rts-test2 kernel: (read) sdc1's sb offset: 88859008 [events: 00000002]
Apr 19 17:45:26 rts-test2 kernel: (read) sdd1's sb offset: 88859008 [events: 00000002]
Apr 19 17:45:26 rts-test2 kernel: (read) sde1's sb offset: 88859008 [events: 00000002]
Apr 19 17:45:26 rts-test2 kernel: autorun ...
Apr 19 17:45:26 rts-test2 kernel: considering sde1 ...
Apr 19 17:45:26 rts-test2 kernel: adding sde1 ...
Apr 19 17:45:26 rts-test2 kernel: adding sdd1 ...
Apr 19 17:45:26 rts-test2 kernel: adding sdc1 ...
Apr 19 17:45:26 rts-test2 kernel: created md0
Apr 19 17:45:26 rts-test2 kernel: bind<sdc1,1>
Apr 19 17:45:26 rts-test2 kernel: bind<sdd1,2>
Apr 19 17:45:26 rts-test2 kernel: bind<sde1,3>
Apr 19 17:45:26 rts-test2 kernel: running: <sde1><sdd1><sdc1>
Apr 19 17:45:26 rts-test2 kernel: now!
Apr 19 17:45:26 rts-test2 kernel: sde1's event counter: 00000002
Apr 19 17:45:26 rts-test2 kernel: sdd1's event counter: 00000002
Apr 19 17:45:26 rts-test2 kernel: sdc1's event counter: 00000002
Apr 19 17:45:26 rts-test2 kernel: md: md0: raid array is not clean -- starting
background reconstruction
Apr 19 17:45:26 rts-test2 kernel: raid5 personality registered
Apr 19 17:45:26 rts-test2 kernel: md0: max total readahead window set to 256k
Apr 19 17:45:26 rts-test2 kernel: md0: 2 data-disks, max readahead per data-disk: 128k
Apr 19 17:45:26 rts-test2 kernel: raid5: device sde1 operational as raid disk 2
Apr 19 17:45:26 rts-test2 kernel: raid5: device sdd1 operational as raid disk 1
Apr 19 17:45:26 rts-test2 kernel: raid5: device sdc1 operational as raid disk 0
Apr 19 17:45:26 rts-test2 kernel: raid5: allocated 3197kB for md0
Apr 19 17:45:26 rts-test2 kernel: raid5: raid level 5 set md0 active with 3 out of 3
devices, algorithm 0
Apr 19 17:45:26 rts-test2 kernel: raid5: raid set md0 not clean; reconstructing parity
Apr 19 17:45:26 rts-test2 kernel: RAID5 conf printout:
Apr 19 17:45:26 rts-test2 kernel: --- rd:3 wd:3 fd:0
Apr 19 17:45:26 rts-test2 kernel: disk 0, s:0, o:1, n:0 rd:0 us:1 dev:sdc1
Apr 19 17:45:26 rts-test2 kernel: disk 1, s:0, o:1, n:1 rd:1 us:1 dev:sdd1
Apr 19 17:45:26 rts-test2 kernel: disk 2, s:0, o:1, n:2 rd:2 us:1 dev:sde1
Apr 19 17:45:26 rts-test2 kernel: disk 3, s:0, o:0, n:0 rd:0 us:0 dev:[dev 00:00]
Apr 19 17:45:26 rts-test2 kernel: disk 4, s:0, o:0, n:0 rd:0 us:0 dev:[dev 00:00]
Apr 19 17:45:26 rts-test2 kernel: disk 5, s:0, o:0, n:0 rd:0 us:0 dev:[dev 00:00]
Apr 19 17:45:26 rts-test2 kernel: disk 6, s:0, o:0, n:0 rd:0 us:0 dev:[dev 00:00]
Apr 19 17:45:26 rts-test2 kernel: disk 7, s:0, o:0, n:0 rd:0 us:0 dev:[dev 00:00]
Apr 19 17:45:26 rts-test2 kernel: disk 8, s:0, o:0, n:0 rd:0 us:0 dev:[dev 00:00]
Apr 19 17:45:26 rts-test2 kernel: disk 9, s:0, o:0, n:0 rd:0 us:0 dev:[dev 00:00]
Apr 19 17:45:26 rts-test2 kernel: disk 10, s:0, o:0, n:0 rd:0 us:0 dev:[dev 00:00]
Apr 19 17:45:26 rts-test2 kernel: disk 11, s:0, o:0, n:0 rd:0 us:0 dev:[dev 00:00]
Apr 19 17:45:26 rts-test2 kernel: RAID5 conf printout:
Apr 19 17:45:26 rts-test2 kernel: --- rd:3 wd:3 fd:0
Apr 19 17:45:26 rts-test2 kernel: disk 0, s:0, o:1, n:0 rd:0 us:1 dev:sdc1
Apr 19 17:45:26 rts-test2 kernel: disk 1, s:0, o:1, n:1 rd:1 us:1 dev:sdd1
Apr 19 17:45:26 rts-test2 kernel: disk 2, s:0, o:1, n:2 rd:2 us:1 dev:sde1
Apr 19 17:45:26 rts-test2 kernel: disk 3, s:0, o:0, n:0 rd:0 us:0 dev:[dev 00:00]
Apr 19 17:45:26 rts-test2 kernel: disk 4, s:0, o:0, n:0 rd:0 us:0 dev:[dev 00:00]
Apr 19 17:45:26 rts-test2 kernel: disk 5, s:0, o:0, n:0 rd:0 us:0 dev:[dev 00:00]
Apr 19 17:45:26 rts-test2 kernel: disk 6, s:0, o:0, n:0 rd:0 us:0 dev:[dev 00:00]
Apr 19 17:45:26 rts-test2 kernel: disk 7, s:0, o:0, n:0 rd:0 us:0 dev:[dev 00:00]
Apr 19 17:45:26 rts-test2 kernel: disk 8, s:0, o:0, n:0 rd:0 us:0 dev:[dev 00:00]
Apr 19 17:45:26 rts-test2 kernel: disk 9, s:0, o:0, n:0 rd:0 us:0 dev:[dev 00:00]
Apr 19 17:45:26 rts-test2 kernel: disk 10, s:0, o:0, n:0 rd:0 us:0 dev:[dev 00:00]
Apr 19 17:45:26 rts-test2 kernel: disk 11, s:0, o:0, n:0 rd:0 us:0 dev:[dev 00:00]
Apr 19 17:45:26 rts-test2 kernel: md: updating md0 RAID superblock on device
Apr 19 17:45:26 rts-test2 kernel: sde1 [events: 00000003](write) sde1's sb offset:
88859008
Apr 19 17:45:26 rts-test2 kernel: md: syncing RAID array md0
Apr 19 17:45:26 rts-test2 kernel: md: minimum _guaranteed_ reconstruction speed: 100
KB/sec.
Apr 19 17:45:26 rts-test2 kernel: md: using maximum available idle IO bandwith for
reconstruction.
Apr 19 17:45:26 rts-test2 kernel: md: using 256k window.
Apr 19 17:45:26 rts-test2 kernel: sdd1 [events: 00000003](write) sdd1's sb offset:
88859008
Apr 19 17:45:26 rts-test2 kernel: sdc1 [events: 00000003](write) sdc1's sb offset:
88859008
Apr 19 17:45:26 rts-test2 kernel: .
Apr 19 17:45:26 rts-test2 kernel: ... autorun DONE.
Apr 19 18:21:50 rts-test2 kernel: SCSI disk error : host 3 channel 0 id 2 lun 0 return
code = 8000000
Apr 19 18:21:50 rts-test2 kernel: [valid=0] Info fld=0x0, Current sd08:41: sense key
None
Apr 19 18:21:50 rts-test2 kernel: scsidisk I/O error: dev 08:41, sector 9296408
Apr 19 18:21:50 rts-test2 kernel: interrupting MD-thread pid 754
Apr 19 18:21:50 rts-test2 kernel: raid5: parity resync was not fully finished,
restarting next time.
Apr 19 18:21:50 rts-test2 kernel: raid5: Disk failure on sde1, disabling device.
Operation continuing on 2 devices
Apr 19 18:21:50 rts-test2 kernel: md: recovery thread got woken up ...
Apr 19 18:21:50 rts-test2 kernel: md0: no spare disk to reconstruct array! --
continuing in degraded mode
Apr 19 18:21:50 rts-test2 kernel: md: recovery thread finished ...
Apr 19 18:21:50 rts-test2 kernel: md: updating md0 RAID superblock on device
Apr 19 18:21:50 rts-test2 kernel: (skipping faulty sde1 )
Apr 19 18:21:50 rts-test2 kernel: sdd1 [events: 00000004](write) sdd1's sb offset:
88859008
Apr 19 18:21:50 rts-test2 kernel: sdc1 [events: 00000004](write) sdc1's sb offset:
88859008
Apr 19 18:21:50 rts-test2 kernel: .
Apr 19 18:21:50 rts-test2 kernel: raid5: restarting stripe 9296408
Apr 19 18:22:03 rts-test2 kernel: SCSI disk error : host 3 channel 0 id 2 lun 0 return
code = 8000000
Apr 19 18:22:03 rts-test2 kernel: [valid=0] Info fld=0x0, Current sd08:41: sense key
None
Apr 19 18:22:03 rts-test2 kernel: scsidisk I/O error: dev 08:41, sector 9296410
Apr 19 18:22:03 rts-test2 kernel: md: bug in file raid5.c, line 659
Apr 19 18:22:03 rts-test2 kernel:
Apr 19 18:22:03 rts-test2 kernel: **********************************
Apr 19 18:22:03 rts-test2 kernel: * <COMPLETE RAID STATE PRINTOUT> *
Apr 19 18:22:03 rts-test2 kernel: **********************************
Apr 19 18:22:03 rts-test2 kernel: md0: <sde1><sdd1><sdc1> array superblock:
Apr 19 18:22:03 rts-test2 kernel: SB: (V:0.90.0)
ID:<6bd70963.68ffc73f.f6512f1b.4308e219> CT:38fe1618
Apr 19 18:22:03 rts-test2 kernel: L5 S88859008 ND:3 RD:3 md0 LO:0 CS:4096
Apr 19 18:22:03 rts-test2 kernel: UT:38fe317e ST:0 AD:2 WD:2 FD:1 SD:0
CSUM:2ea453c5 E:00000004
Apr 19 18:22:03 rts-test2 kernel: D 0: DISK<N:0,sdc1(8,33),R:0,S:6>
Apr 19 18:22:03 rts-test2 kernel: D 1: DISK<N:1,sdd1(8,49),R:1,S:6>
Apr 19 18:22:03 rts-test2 kernel: D 2: DISK<N:2,sde1(8,65),R:2,S:1>
Apr 19 18:22:03 rts-test2 kernel: D 3: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:03 rts-test2 kernel: D 4: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:03 rts-test2 kernel: D 5: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:03 rts-test2 kernel: D 6: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:03 rts-test2 kernel: D 7: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:03 rts-test2 kernel: D 8: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:03 rts-test2 kernel: D 9: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:03 rts-test2 kernel: D 10: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:03 rts-test2 kernel: D 11: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:03 rts-test2 kernel: THIS: DISK<N:2,sde1(8,65),R:2,S:6>
Apr 19 18:22:03 rts-test2 kernel: rdev sde1: O:sde1, SZ:00000000 F:1 DN:2 no rdev
superblock!
Apr 19 18:22:03 rts-test2 kernel: rdev sdd1: O:sdd1, SZ:88859008 F:0 DN:1 rdev
superblock:
Apr 19 18:22:03 rts-test2 kernel: SB: (V:0.90.0)
ID:<6bd70963.68ffc73f.f6512f1b.4308e219> CT:38fe1618
Apr 19 18:22:03 rts-test2 kernel: L5 S88859008 ND:3 RD:3 md0 LO:0 CS:4096
Apr 19 18:22:03 rts-test2 kernel: UT:38fe317e ST:0 AD:2 WD:2 FD:1 SD:0
CSUM:2ea46b7c E:00000004
Apr 19 18:22:03 rts-test2 kernel: D 0: DISK<N:0,sdc1(8,33),R:0,S:6>
Apr 19 18:22:03 rts-test2 kernel: D 1: DISK<N:1,sdd1(8,49),R:1,S:6>
Apr 19 18:22:03 rts-test2 kernel: D 2: DISK<N:2,sde1(8,65),R:2,S:1>
Apr 19 18:22:03 rts-test2 kernel: D 3: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:03 rts-test2 kernel: D 4: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:03 rts-test2 kernel: D 5: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:03 rts-test2 kernel: D 6: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:03 rts-test2 kernel: D 7: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:03 rts-test2 kernel: D 8: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:03 rts-test2 kernel: D 9: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:03 rts-test2 kernel: D 10: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:03 rts-test2 kernel: D 11: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:03 rts-test2 kernel: THIS: DISK<N:1,sdd1(8,49),R:1,S:6>
Apr 19 18:22:03 rts-test2 kernel: rdev sdc1: O:sdc1, SZ:88859008 F:0 DN:0 rdev
superblock:
Apr 19 18:22:03 rts-test2 kernel: SB: (V:0.90.0)
ID:<6bd70963.68ffc73f.f6512f1b.4308e219> CT:38fe1618
Apr 19 18:22:03 rts-test2 kernel: L5 S88859008 ND:3 RD:3 md0 LO:0 CS:4096
Apr 19 18:22:03 rts-test2 kernel: UT:38fe317e ST:0 AD:2 WD:2 FD:1 SD:0
CSUM:2ea46b6a E:00000004
Apr 19 18:22:03 rts-test2 kernel: D 0: DISK<N:0,sdc1(8,33),R:0,S:6>
Apr 19 18:22:03 rts-test2 kernel: D 1: DISK<N:1,sdd1(8,49),R:1,S:6>
Apr 19 18:22:03 rts-test2 kernel: D 2: DISK<N:2,sde1(8,65),R:2,S:1>
Apr 19 18:22:03 rts-test2 kernel: D 3: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:03 rts-test2 kernel: D 4: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:03 rts-test2 kernel: D 5: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:03 rts-test2 kernel: D 6: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:03 rts-test2 kernel: D 7: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:03 rts-test2 kernel: D 8: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:03 rts-test2 kernel: D 9: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:03 rts-test2 kernel: D 10: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:03 rts-test2 kernel: D 11: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:03 rts-test2 kernel: THIS: DISK<N:0,sdc1(8,33),R:0,S:6>
Apr 19 18:22:03 rts-test2 kernel: **********************************
Apr 19 18:22:03 rts-test2 kernel:
Apr 19 18:22:03 rts-test2 kernel: raid5: restarting stripe 9296410
Apr 19 18:22:03 rts-test2 kernel: md: recovery thread got woken up ...
Apr 19 18:22:03 rts-test2 kernel: md0: no spare disk to reconstruct array! --
continuing in degraded mode
Apr 19 18:22:03 rts-test2 kernel: md: recovery thread finished ...
Apr 19 18:22:16 rts-test2 kernel: SCSI disk error : host 3 channel 0 id 2 lun 0 return
code = 8000000
Apr 19 18:22:16 rts-test2 kernel: [valid=0] Info fld=0x0, Current sd08:41: sense key
None
Apr 19 18:22:16 rts-test2 kernel: scsidisk I/O error: dev 08:41, sector 9296412
Apr 19 18:22:16 rts-test2 kernel: md: bug in file raid5.c, line 659
Apr 19 18:22:16 rts-test2 kernel:
Apr 19 18:22:16 rts-test2 kernel: **********************************
Apr 19 18:22:16 rts-test2 kernel: * <COMPLETE RAID STATE PRINTOUT> *
Apr 19 18:22:16 rts-test2 kernel: **********************************
Apr 19 18:22:16 rts-test2 kernel: md0: <sde1><sdd1><sdc1> array superblock:
Apr 19 18:22:16 rts-test2 kernel: SB: (V:0.90.0)
ID:<6bd70963.68ffc73f.f6512f1b.4308e219> CT:38fe1618
Apr 19 18:22:16 rts-test2 kernel: L5 S88859008 ND:3 RD:3 md0 LO:0 CS:4096
Apr 19 18:22:16 rts-test2 kernel: UT:38fe317e ST:0 AD:2 WD:2 FD:1 SD:0
CSUM:2ea453c5 E:00000004
Apr 19 18:22:16 rts-test2 kernel: D 0: DISK<N:0,sdc1(8,33),R:0,S:6>
Apr 19 18:22:16 rts-test2 kernel: D 1: DISK<N:1,sdd1(8,49),R:1,S:6>
Apr 19 18:22:16 rts-test2 kernel: D 2: DISK<N:2,sde1(8,65),R:2,S:1>
Apr 19 18:22:16 rts-test2 kernel: D 3: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:16 rts-test2 kernel: D 4: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:16 rts-test2 kernel: D 5: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:16 rts-test2 kernel: D 6: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:16 rts-test2 kernel: D 7: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:16 rts-test2 kernel: D 8: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:16 rts-test2 kernel: D 9: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:16 rts-test2 kernel: D 10: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:16 rts-test2 kernel: D 11: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:16 rts-test2 kernel: THIS: DISK<N:2,sde1(8,65),R:2,S:6>
Apr 19 18:22:16 rts-test2 kernel: rdev sde1: O:sde1, SZ:00000000 F:1 DN:2 no rdev
superblock!
Apr 19 18:22:16 rts-test2 kernel: rdev sdd1: O:sdd1, SZ:88859008 F:0 DN:1 rdev
superblock:
Apr 19 18:22:16 rts-test2 kernel: SB: (V:0.90.0)
ID:<6bd70963.68ffc73f.f6512f1b.4308e219> CT:38fe1618
Apr 19 18:22:16 rts-test2 kernel: L5 S88859008 ND:3 RD:3 md0 LO:0 CS:4096
Apr 19 18:22:16 rts-test2 kernel: UT:38fe317e ST:0 AD:2 WD:2 FD:1 SD:0
CSUM:2ea46b7c E:00000004
Apr 19 18:22:16 rts-test2 kernel: D 0: DISK<N:0,sdc1(8,33),R:0,S:6>
Apr 19 18:22:16 rts-test2 kernel: D 1: DISK<N:1,sdd1(8,49),R:1,S:6>
Apr 19 18:22:16 rts-test2 kernel: D 2: DISK<N:2,sde1(8,65),R:2,S:1>
Apr 19 18:22:16 rts-test2 kernel: D 3: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:16 rts-test2 kernel: D 4: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:16 rts-test2 kernel: D 5: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:16 rts-test2 kernel: D 6: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:16 rts-test2 kernel: D 7: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:16 rts-test2 kernel: D 8: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:16 rts-test2 kernel: D 9: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:16 rts-test2 kernel: D 10: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:16 rts-test2 kernel: D 11: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:16 rts-test2 kernel: THIS: DISK<N:1,sdd1(8,49),R:1,S:6>
Apr 19 18:22:16 rts-test2 kernel: rdev sdc1: O:sdc1, SZ:88859008 F:0 DN:0 rdev
superblock:
Apr 19 18:22:16 rts-test2 kernel: SB: (V:0.90.0)
ID:<6bd70963.68ffc73f.f6512f1b.4308e219> CT:38fe1618
Apr 19 18:22:16 rts-test2 kernel: L5 S88859008 ND:3 RD:3 md0 LO:0 CS:4096
Apr 19 18:22:16 rts-test2 kernel: UT:38fe317e ST:0 AD:2 WD:2 FD:1 SD:0
CSUM:2ea46b6a E:00000004
Apr 19 18:22:16 rts-test2 kernel: D 0: DISK<N:0,sdc1(8,33),R:0,S:6>
Apr 19 18:22:16 rts-test2 kernel: D 1: DISK<N:1,sdd1(8,49),R:1,S:6>
Apr 19 18:22:16 rts-test2 kernel: D 2: DISK<N:2,sde1(8,65),R:2,S:1>
Apr 19 18:22:16 rts-test2 kernel: D 3: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:16 rts-test2 kernel: D 4: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:16 rts-test2 kernel: D 5: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:16 rts-test2 kernel: D 6: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:16 rts-test2 kernel: D 7: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:16 rts-test2 kernel: D 8: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:16 rts-test2 kernel: D 9: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:16 rts-test2 kernel: D 10: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:16 rts-test2 kernel: D 11: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:16 rts-test2 kernel: THIS: DISK<N:0,sdc1(8,33),R:0,S:6>
Apr 19 18:22:16 rts-test2 kernel: **********************************
Apr 19 18:22:16 rts-test2 kernel:
Apr 19 18:22:16 rts-test2 kernel: raid5: restarting stripe 9296412
Apr 19 18:22:16 rts-test2 kernel: md: recovery thread got woken up ...
Apr 19 18:22:16 rts-test2 kernel: md0: no spare disk to reconstruct array! --
continuing in degraded mode
Apr 19 18:22:16 rts-test2 kernel: md: recovery thread finished ...
Apr 19 18:22:29 rts-test2 kernel: SCSI disk error : host 3 channel 0 id 2 lun 0 return
code = 8000000
Apr 19 18:22:29 rts-test2 kernel: [valid=0] Info fld=0x0, Current sd08:41: sense key
None
Apr 19 18:22:29 rts-test2 kernel: scsidisk I/O error: dev 08:41, sector 9296414
Apr 19 18:22:29 rts-test2 kernel: md: bug in file raid5.c, line 659
Apr 19 18:22:29 rts-test2 kernel:
Apr 19 18:22:29 rts-test2 kernel: **********************************
Apr 19 18:22:29 rts-test2 kernel: * <COMPLETE RAID STATE PRINTOUT> *
Apr 19 18:22:29 rts-test2 kernel: **********************************
Apr 19 18:22:29 rts-test2 kernel: md0: <sde1><sdd1><sdc1> array superblock:
Apr 19 18:22:29 rts-test2 kernel: SB: (V:0.90.0)
ID:<6bd70963.68ffc73f.f6512f1b.4308e219> CT:38fe1618
Apr 19 18:22:29 rts-test2 kernel: L5 S88859008 ND:3 RD:3 md0 LO:0 CS:4096
Apr 19 18:22:29 rts-test2 kernel: UT:38fe317e ST:0 AD:2 WD:2 FD:1 SD:0
CSUM:2ea453c5 E:00000004
Apr 19 18:22:29 rts-test2 kernel: D 0: DISK<N:0,sdc1(8,33),R:0,S:6>
Apr 19 18:22:29 rts-test2 kernel: D 1: DISK<N:1,sdd1(8,49),R:1,S:6>
Apr 19 18:22:29 rts-test2 kernel: D 2: DISK<N:2,sde1(8,65),R:2,S:1>
Apr 19 18:22:29 rts-test2 kernel: D 3: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:29 rts-test2 kernel: D 4: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:29 rts-test2 kernel: D 5: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:29 rts-test2 kernel: D 6: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:29 rts-test2 kernel: D 7: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:29 rts-test2 kernel: D 8: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:29 rts-test2 kernel: D 9: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:29 rts-test2 kernel: D 10: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:29 rts-test2 kernel: D 11: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:29 rts-test2 kernel: THIS: DISK<N:2,sde1(8,65),R:2,S:6>
Apr 19 18:22:29 rts-test2 kernel: rdev sde1: O:sde1, SZ:00000000 F:1 DN:2 no rdev
superblock!
Apr 19 18:22:29 rts-test2 kernel: rdev sdd1: O:sdd1, SZ:88859008 F:0 DN:1 rdev
superblock:
Apr 19 18:22:29 rts-test2 kernel: SB: (V:0.90.0)
ID:<6bd70963.68ffc73f.f6512f1b.4308e219> CT:38fe1618
Apr 19 18:22:29 rts-test2 kernel: L5 S88859008 ND:3 RD:3 md0 LO:0 CS:4096
Apr 19 18:22:29 rts-test2 kernel: UT:38fe317e ST:0 AD:2 WD:2 FD:1 SD:0
CSUM:2ea46b7c E:00000004
Apr 19 18:22:29 rts-test2 kernel: D 0: DISK<N:0,sdc1(8,33),R:0,S:6>
Apr 19 18:22:29 rts-test2 kernel: D 1: DISK<N:1,sdd1(8,49),R:1,S:6>
Apr 19 18:22:29 rts-test2 kernel: D 2: DISK<N:2,sde1(8,65),R:2,S:1>
Apr 19 18:22:29 rts-test2 kernel: D 3: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:29 rts-test2 kernel: D 4: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:29 rts-test2 kernel: D 5: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:29 rts-test2 kernel: D 6: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:29 rts-test2 kernel: D 7: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:29 rts-test2 kernel: D 8: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:29 rts-test2 kernel: D 9: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:29 rts-test2 kernel: D 10: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:29 rts-test2 kernel: D 11: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:29 rts-test2 kernel: THIS: DISK<N:1,sdd1(8,49),R:1,S:6>
Apr 19 18:22:29 rts-test2 kernel: rdev sdc1: O:sdc1, SZ:88859008 F:0 DN:0 rdev
superblock:
Apr 19 18:22:29 rts-test2 kernel: SB: (V:0.90.0)
ID:<6bd70963.68ffc73f.f6512f1b.4308e219> CT:38fe1618
Apr 19 18:22:29 rts-test2 kernel: L5 S88859008 ND:3 RD:3 md0 LO:0 CS:4096
Apr 19 18:22:29 rts-test2 kernel: UT:38fe317e ST:0 AD:2 WD:2 FD:1 SD:0
CSUM:2ea46b6a E:00000004
Apr 19 18:22:29 rts-test2 kernel: D 0: DISK<N:0,sdc1(8,33),R:0,S:6>
Apr 19 18:22:29 rts-test2 kernel: D 1: DISK<N:1,sdd1(8,49),R:1,S:6>
Apr 19 18:22:29 rts-test2 kernel: D 2: DISK<N:2,sde1(8,65),R:2,S:1>
Apr 19 18:22:29 rts-test2 kernel: D 3: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:29 rts-test2 kernel: D 4: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:29 rts-test2 kernel: D 5: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:29 rts-test2 kernel: D 6: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:29 rts-test2 kernel: D 7: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:29 rts-test2 kernel: D 8: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:29 rts-test2 kernel: D 9: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:29 rts-test2 kernel: D 10: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:29 rts-test2 kernel: D 11: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:29 rts-test2 kernel: THIS: DISK<N:0,sdc1(8,33),R:0,S:6>
Apr 19 18:22:29 rts-test2 kernel: **********************************
Apr 19 18:22:29 rts-test2 kernel:
Apr 19 18:22:29 rts-test2 kernel: raid5: restarting stripe 9296414
Apr 19 18:22:29 rts-test2 kernel: md: recovery thread got woken up ...
Apr 19 18:22:29 rts-test2 kernel: md0: no spare disk to reconstruct array! --
continuing in degraded mode
Apr 19 18:22:29 rts-test2 kernel: md: recovery thread finished ...
Apr 19 18:22:42 rts-test2 kernel: SCSI disk error : host 3 channel 0 id 2 lun 0 return
code = 8000000
Apr 19 18:22:42 rts-test2 kernel: [valid=0] Info fld=0x0, Current sd08:41: sense key
None
Apr 19 18:22:42 rts-test2 kernel: scsidisk I/O error: dev 08:41, sector 9296416
Apr 19 18:22:42 rts-test2 kernel: md: bug in file raid5.c, line 659
Apr 19 18:22:42 rts-test2 kernel:
Apr 19 18:22:42 rts-test2 kernel: **********************************
Apr 19 18:22:42 rts-test2 kernel: * <COMPLETE RAID STATE PRINTOUT> *
Apr 19 18:22:42 rts-test2 kernel: **********************************
Apr 19 18:22:42 rts-test2 kernel: md0: <sde1><sdd1><sdc1> array superblock:
Apr 19 18:22:42 rts-test2 kernel: SB: (V:0.90.0)
ID:<6bd70963.68ffc73f.f6512f1b.4308e219> CT:38fe1618
Apr 19 18:22:42 rts-test2 kernel: L5 S88859008 ND:3 RD:3 md0 LO:0 CS:4096
Apr 19 18:22:42 rts-test2 kernel: UT:38fe317e ST:0 AD:2 WD:2 FD:1 SD:0
CSUM:2ea453c5 E:00000004
Apr 19 18:22:42 rts-test2 kernel: D 0: DISK<N:0,sdc1(8,33),R:0,S:6>
Apr 19 18:22:42 rts-test2 kernel: D 1: DISK<N:1,sdd1(8,49),R:1,S:6>
Apr 19 18:22:42 rts-test2 kernel: D 2: DISK<N:2,sde1(8,65),R:2,S:1>
Apr 19 18:22:42 rts-test2 kernel: D 3: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:42 rts-test2 kernel: D 4: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:42 rts-test2 kernel: D 5: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:42 rts-test2 kernel: D 6: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:42 rts-test2 kernel: D 7: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:42 rts-test2 kernel: D 8: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:42 rts-test2 kernel: D 9: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:42 rts-test2 kernel: D 10: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:42 rts-test2 kernel: D 11: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:42 rts-test2 kernel: THIS: DISK<N:2,sde1(8,65),R:2,S:6>
Apr 19 18:22:42 rts-test2 kernel: rdev sde1: O:sde1, SZ:00000000 F:1 DN:2 no rdev
superblock!
Apr 19 18:22:42 rts-test2 kernel: rdev sdd1: O:sdd1, SZ:88859008 F:0 DN:1 rdev
superblock:
Apr 19 18:22:42 rts-test2 kernel: SB: (V:0.90.0)
ID:<6bd70963.68ffc73f.f6512f1b.4308e219> CT:38fe1618
Apr 19 18:22:42 rts-test2 kernel: L5 S88859008 ND:3 RD:3 md0 LO:0 CS:4096
Apr 19 18:22:42 rts-test2 kernel: UT:38fe317e ST:0 AD:2 WD:2 FD:1 SD:0
CSUM:2ea46b7c E:00000004
Apr 19 18:22:42 rts-test2 kernel: D 0: DISK<N:0,sdc1(8,33),R:0,S:6>
Apr 19 18:22:42 rts-test2 kernel: D 1: DISK<N:1,sdd1(8,49),R:1,S:6>
Apr 19 18:22:42 rts-test2 kernel: D 2: DISK<N:2,sde1(8,65),R:2,S:1>
Apr 19 18:22:42 rts-test2 kernel: D 3: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:42 rts-test2 kernel: D 4: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:42 rts-test2 kernel: D 5: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:42 rts-test2 kernel: D 6: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:42 rts-test2 kernel: D 7: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:42 rts-test2 kernel: D 8: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:42 rts-test2 kernel: D 9: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:42 rts-test2 kernel: D 10: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:42 rts-test2 kernel: D 11: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:42 rts-test2 kernel: THIS: DISK<N:1,sdd1(8,49),R:1,S:6>
Apr 19 18:22:42 rts-test2 kernel: rdev sdc1: O:sdc1, SZ:88859008 F:0 DN:0 rdev
superblock:
Apr 19 18:22:42 rts-test2 kernel: SB: (V:0.90.0)
ID:<6bd70963.68ffc73f.f6512f1b.4308e219> CT:38fe1618
Apr 19 18:22:42 rts-test2 kernel: L5 S88859008 ND:3 RD:3 md0 LO:0 CS:4096
Apr 19 18:22:42 rts-test2 kernel: UT:38fe317e ST:0 AD:2 WD:2 FD:1 SD:0
CSUM:2ea46b6a E:00000004
Apr 19 18:22:42 rts-test2 kernel: D 0: DISK<N:0,sdc1(8,33),R:0,S:6>
Apr 19 18:22:42 rts-test2 kernel: D 1: DISK<N:1,sdd1(8,49),R:1,S:6>
Apr 19 18:22:42 rts-test2 kernel: D 2: DISK<N:2,sde1(8,65),R:2,S:1>
Apr 19 18:22:42 rts-test2 kernel: D 3: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:42 rts-test2 kernel: D 4: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:42 rts-test2 kernel: D 5: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:42 rts-test2 kernel: D 6: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:42 rts-test2 kernel: D 7: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:42 rts-test2 kernel: D 8: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:42 rts-test2 kernel: D 9: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:42 rts-test2 kernel: D 10: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:42 rts-test2 kernel: D 11: DISK<N:0,[dev 00:00](0,0),R:0,S:4>
Apr 19 18:22:42 rts-test2 kernel: THIS: DISK<N:0,sdc1(8,33),R:0,S:6>
Apr 19 18:22:42 rts-test2 kernel: **********************************
Apr 19 18:22:42 rts-test2 kernel:
Apr 19 18:22:42 rts-test2 kernel: md: recovery thread got woken up ...
Apr 19 18:22:42 rts-test2 kernel: md0: no spare disk to reconstruct array! --
continuing in degraded mode
Apr 19 18:22:42 rts-test2 kernel: md: recovery thread finished ...
Apr 19 18:22:42 rts-test2 kernel: raid5: restarting stripe 9296418
Apr 19 18:22:42 rts-test2 kernel: raid5: restarting stripe 9296420
Apr 19 18:22:42 rts-test2 kernel: raid5: restarting stripe 9296422
Apr 19 18:22:42 rts-test2 kernel: raid5: restarting stripe 9296416
Apr 19 18:22:42 rts-test2 kernel: md_do_sync() got signal ... exiting
Apr 19 18:22:42 rts-test2 kernel: raid5: resync aborted!
