On Fri, 26 Jul 2013 11:48:28 +1000
Craig Sanders <[email protected]> wrote:
> On Thu, Jul 25, 2013 at 06:31:54PM +1000, Russell Coker wrote:
> > I'm getting some errors on a zpool scrub operation. It's obvious
> > that sdd has the problem both from the below output of zpool status
> > and from the fact that the kernel message log has read errors about
> > sdd.
>
> what sort of controller is it on, and do you have standby/spin-down
> enabled? that can cause drives to be booted from a raid array or zpool
> if they don't respond fast enough.
>
> that's the reason for using IT mode firmware rather than RAID mode
> firmware in LSI and similar cards - it's far more forgiving of
> consumer drives and their slow responses when waking up from
> standby. RAID mode firmware pretty much expects enterprise drives
> with standby disabled.
It's the onboard controller on a Dell PowerEdge T110, a fairly basic
SATA controller. I don't think that spin-down is the issue, if it was
then it would affect all disks in the set, it wouldn't give kernel read
error messages, and it would only affect the start of the scrub process
not happen throughout the scrub.
> zpool status will tell you how much data was corrected when it has
> finished.
>
> e.g. on my backup pool, zpool status says this:
>
> scan: scrub repaired 160K in 4h21m with 0 errors on Sat Jul 20
> 06:03:58 2013
>
> also the numbers in the READ WRITE and CKSUM columns will show you the
> number of errors detected for each drive.
However those numbers are all 0 for me.
I'm now replacing the defective disk. I've attached a sample of iostat
output, it seems to be reading from all disks and then reconstructing
the parity for the new disk which is surprising, I had expected it to
just read the old disk and write to the new disk but instead I get a
scrub as well as the "resilver". So the rate of rebuild is
considerably less than half what I had hoped for, I had expected
something like 130MB/s for contiguous reads and writes and instead each
of the 5 disks is doing about 45MB/s.
--
My Main Blog http://etbe.coker.com.au/
My Documents Blog http://doc.coker.com.au/
avg-cpu: %user %nice %system %iowait %steal %idle
1.69 0.00 20.23 3.79 0.00 74.29
Device: rrqm/s wrqm/s r/s w/s rsec/s wsec/s avgrq-sz
avgqu-sz await svctm %util
sda 373.90 0.40 298.30 5.80 92344.00 75.20 303.91
1.36 4.48 2.23 67.96
sdb 195.90 0.40 502.70 5.80 89902.40 75.20 176.95
1.66 3.27 1.25 63.72
sdc 374.20 0.60 300.30 6.00 92286.40 76.80 301.54
1.41 4.59 2.38 72.84
sdd 175.10 0.60 539.30 6.00 89230.40 76.80 163.78
1.78 3.27 1.24 67.76
sdl 0.00 174.30 0.00 681.10 0.00 88107.10 129.36
6.40 9.39 1.32 89.72
_______________________________________________
luv-main mailing list
[email protected]
http://lists.luv.asn.au/listinfo/luv-main
