Finally came to the reboot maintenance to reboot the x4540 to make it
see the newly replaced HDD.
I tried, reboot, then power-cycle, and reboot -- -r,
but I can not make the x4540 accept any HDD in that bay. I'm starting to
think that perhaps we did not lose the original HDD, but rather the
slot, and there is a hardware problem.
This is what I see after a reboot, the disk is c1t5d0, sd37, s...@5,0 or
slot 13.
c1::dsk/c1t4d0 disk connected configured
unknown
c1::dsk/c1t5d0 disk connected configured
unknown
c1::dsk/c1t6d0 disk connected configured
unknown
# devfsadm -v
devfsadm[893]: verbose: no devfs node or mismatched dev_t for
/devices/p...@0,0/pci10de,3...@b/pci1000,1...@0/s...@5,0:a
devfsadm[893]: verbose: symlink /dev/dsk/c1t5d0s0 ->
../../devices/p...@0,0/pci10de,3...@b/pci1000,1...@0/s...@5,0:a
devfsadm[893]: verbose: no devfs node or mismatched dev_t for
/devices/p...@0,0/pci10de,3...@b/pci1000,1...@0/s...@5,0:b
devfsadm[893]: verbose: symlink /dev/dsk/c1t5d0s1 ->
../../devices/p...@0,0/pci10de,3...@b/pci1000,1...@0/s...@5,0:b
[snip]
Only messages in dmesg are:
Aug 20 02:23:05 x4500-10.unix rootnex: [ID 349649 kern.info] xsvc1 at
root: space 0 offset 0
Aug 20 02:23:05 x4500-10.unix genunix: [ID 936769 kern.info] xsvc1 is
/x...@0,0
Aug 20 02:23:09 x4500-10.unix scsi: [ID 583861 kern.info] sd37 at mpt1:
target 5 lun 0
Aug 20 02:23:09 x4500-10.unix genunix: [ID 936769 kern.info] sd37 is
/p...@0,0/pci10de,3...@b/pci1000,1...@0/s...@5,0
Aug 20 02:23:09 x4500-10.unix pseudo: [ID 129642 kern.info]
pseudo-device: devinfo0
Aug 20 02:23:09 x4500-10.unix genunix: [ID 936769 kern.info] devinfo0 is
/pseudo/devi...@0
r...@x4500-10.unix # Aug 20 02:23:12 x400-10.unix genunix: WARNING:
constraints forbid retire: /p...@3c,0/pci10de,3...@f/pci1000,1...@0/s...@7,0
# cd ../../devices/p...@0,0/pci10de,3...@b/pci1000,1...@0/
r...@x4500-10.unix # ls -l
./s...@5,0:a: No such device or address
./s...@5,0:a,raw: No such device or address
./s...@5,0:b: No such device or address
./s...@5,0:b,raw: No such device or address
./s...@5,0:c: No such device or address
[snip lots, these errors only show up the first time you ls]
total 24
drwxr-xr-x 2 root sys 2 Apr 17 17:52 s...@0,0
brw-r----- 1 root sys 30, 2048 Jul 6 09:34 s...@0,0:a
crw-r----- 1 root sys 30, 2048 Jul 6 09:34 s...@0,0:a,raw
brw-r----- 1 root sys 30, 2049 Jul 6 09:34 s...@0,0:b
crw-r----- 1 root sys 30, 2049 Jul 6 09:34 s...@0,0:b,raw
[snip]
crw-r----- 1 root sys 30, 2067 Jul 6 09:44 s...@0,0:t,raw
brw-r----- 1 root sys 30, 2068 Jul 6 09:50 s...@0,0:u
crw-r----- 1 root sys 30, 2068 Jul 6 09:44 s...@0,0:u,raw
drwxr-xr-x 2 root sys 2 Apr 17 17:52 s...@1,0
brw-r----- 1 root sys 30, 2112 Jul 6 09:50 s...@1,0:a
crw-r----- 1 root sys 30, 2112 Jul 6 09:48 s...@1,0:a,raw
brw-r----- 1 root sys 30, 2113 Jul 6 09:50 s...@1,0:b
[snip]
brw-r----- 1 root sys 30, 2132 Jul 6 09:50 s...@1,0:u
crw-r----- 1 root sys 30, 2132 Jul 6 09:48 s...@1,0:u,raw
brw-r----- 1 root sys 30, 2119 Aug 20 02:23 s...@1,0:wd
crw-r----- 1 root sys 30, 2119 Aug 20 02:23 s...@1,0:wd,raw
drwxr-xr-x 2 root sys 2 Apr 17 17:52 s...@2,0
brw-r----- 1 root sys 30, 2176 Jul 6 09:50 s...@2,0:a
crw-r----- 1 root sys 30, 2176 Jul 6 09:48 s...@2,0:a,raw
brw-r----- 1 root sys 30, 2177 Jul 6 09:50 s...@2,0:b
[snip]
brw-r----- 1 root sys 30, 2196 Jul 6 09:50 s...@2,0:u
crw-r----- 1 root sys 30, 2196 Jul 6 09:48 s...@2,0:u,raw
brw-r----- 1 root sys 30, 2183 Aug 20 02:23 s...@2,0:wd
crw-r----- 1 root sys 30, 2183 Aug 20 02:23 s...@2,0:wd,raw
drwxr-xr-x 2 root sys 2 Apr 17 17:52 s...@3,0
brw-r----- 1 root sys 30, 2240 Jul 2 15:30 s...@3,0:a
crw-r----- 1 root sys 30, 2240 Jul 6 09:48 s...@3,0:a,raw
brw-r----- 1 root sys 30, 2241 Jul 6 09:50 s...@3,0:b
[snip]
brw-r----- 1 root sys 30, 2260 Jul 6 09:50 s...@3,0:u
crw-r----- 1 root sys 30, 2260 Jul 6 09:48 s...@3,0:u,raw
brw-r----- 1 root sys 30, 2247 Jul 6 09:50 s...@3,0:wd
crw-r----- 1 root sys 30, 2247 Jul 6 09:43 s...@3,0:wd,raw
drwxr-xr-x 2 root sys 2 Apr 17 17:52 s...@4,0
brw-r----- 1 root sys 30, 2304 Jul 6 09:50 s...@4,0:a
crw-r----- 1 root sys 30, 2304 Jul 6 09:48 s...@4,0:a,raw
brw-r----- 1 root sys 30, 2305 Jul 6 09:50 s...@4,0:b
[snip]
brw-r----- 1 root sys 30, 2324 Jul 6 09:50 s...@4,0:u
crw-r----- 1 root sys 30, 2324 Jul 6 09:48 s...@4,0:u,raw
brw-r----- 1 root sys 30, 2311 Aug 20 02:23 s...@4,0:wd
crw-r----- 1 root sys 30, 2311 Aug 20 02:23 s...@4,0:wd,raw
drwxr-xr-x 2 root sys 2 Aug 6 14:31 s...@5,0
drwxr-xr-x 2 root sys 2 Apr 17 17:52 s...@6,0
brw-r----- 1 root sys 30, 2432 Jul 6 09:50 s...@6,0:a
crw-r----- 1 root sys 30, 2432 Jul 6 09:48 s...@6,0:a,raw
brw-r----- 1 root sys 30, 2433 Jul 6 09:50 s...@6,0:b
crw-r----- 1 root sys 30, 2433 Jul 6 09:48 s...@6,0:b,raw
brw-r----- 1 root sys 30, 2434 Jul 6 09:50 s...@6,0:c
[snip]
brw-r----- 1 root sys 30, 2452 Jul 6 09:50 s...@6,0:u
crw-r----- 1 root sys 30, 2452 Jul 6 09:48 s...@6,0:u,raw
brw-r----- 1 root sys 30, 2439 Aug 20 02:24 s...@6,0:wd
crw-r----- 1 root sys 30, 2439 Aug 20 02:23 s...@6,0:wd,raw
drwxr-xr-x 2 root sys 2 Apr 17 17:52 s...@7,0
brw-r----- 1 root sys 30, 2496 Jul 2 15:30 s...@7,0:a
crw-r----- 1 root sys 30, 2496 Jul 6 09:48 s...@7,0:a,raw
brw-r----- 1 root sys 30, 2497 Jul 6 09:50 s...@7,0:b
crw-r----- 1 root sys 30, 2497 Jul 6 09:48 s...@7,0:b,raw
brw-r----- 1 root sys 30, 2498 Jul 6 09:50 s...@7,0:c
crw-r----- 1 root sys 30, 2498 Jul 6 09:43 s...@7,0:c,raw
brw-r----- 1 root sys 30, 2499 Jul 6 09:50 s...@7,0:d
crw-r----- 1 root sys 30, 2499 Jul 6 09:48 s...@7,0:d,raw
brw-r----- 1 root sys 30, 2500 Jul 6 09:50 s...@7,0:e
crw-r----- 1 root sys 30, 2500 Jul 6 09:48 s...@7,0:e,raw
So it seems s...@5,0 is empty, it is peculiar that all other HDDs on c1tX
works though.
Eventually I notice that cfgadm goes to:
c1::dsk/c1t4d0 disk connected configured
unknown
c1::dsk/c1t5d0 disk connected configured failed
c1::dsk/c1t6d0 disk connected configured
unknown
We promoted the Spare in use to replace c1t5d0, so now the pool looks like:
pool: zpool1
state: ONLINE
scrub: none requested
config:
NAME STATE READ WRITE CKSUM
zpool1 ONLINE 0 0 0
raidz1 ONLINE 0 0 0
c0t3d0 ONLINE 0 0 0
c1t3d0 ONLINE 0 0 0
c2t3d0 ONLINE 0 0 0
c3t3d0 ONLINE 0 0 0
c4t3d0 ONLINE 0 0 0
raidz1 ONLINE 0 0 0
c5t3d0 ONLINE 0 0 0
c0t7d0 ONLINE 0 0 0
c1t7d0 ONLINE 0 0 0
c2t7d0 ONLINE 0 0 0
c3t7d0 ONLINE 0 0 0
raidz1 ONLINE 0 0 0
c2t0d0 ONLINE 0 0 0
c3t0d0 ONLINE 0 0 0
c4t0d0 ONLINE 0 0 0
c5t0d0 ONLINE 0 0 0
c0t6d0 ONLINE 0 0 0
raidz1 ONLINE 0 0 0
c1t6d0 ONLINE 0 0 0
c2t6d0 ONLINE 0 0 0
c3t6d0 ONLINE 0 0 0
c4t6d0 ONLINE 0 0 0
c5t6d0 ONLINE 0 0 0
raidz1 ONLINE 0 0 0
c0t1d0 ONLINE 0 0 0
c1t1d0 ONLINE 0 0 0
c2t1d0 ONLINE 0 0 0
c3t1d0 ONLINE 0 0 0
c4t1d0 ONLINE 0 0 0
raidz1 ONLINE 0 0 0
c5t1d0 ONLINE 0 0 0
c0t5d0 ONLINE 0 0 0
c4t7d0 ONLINE 0 0 0 [was c1t5d0]
c2t5d0 ONLINE 0 0 0
c3t5d0 ONLINE 0 0 0
raidz1 ONLINE 0 0 0
c4t5d0 ONLINE 0 0 0
c5t5d0 ONLINE 0 0 0
c0t2d0 ONLINE 0 0 0
c1t2d0 ONLINE 0 0 0
c2t2d0 ONLINE 0 0 0
raidz1 ONLINE 0 0 0
c3t2d0 ONLINE 0 0 0
c4t2d0 ONLINE 0 0 0
c5t2d0 ONLINE 0 0 0
c0t4d0 ONLINE 0 0 0
c1t4d0 ONLINE 0 0 0
raidz1 ONLINE 0 0 0
c2t4d0 ONLINE 0 0 0
c3t4d0 ONLINE 0 0 0
c4t4d0 ONLINE 0 0 0
c5t4d0 ONLINE 0 0 0
c5t7d0 ONLINE 0 0 0
--
Jorgen Lundman | <lund...@lundman.net>
Unix Administrator | +81 (0)3 -5456-2687 ext 1017 (work)
Shibuya-ku, Tokyo | +81 (0)90-5578-8500 (cell)
Japan | +81 (0)3 -3375-1767 (home)
_______________________________________________
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
