I have a system with a 16-drive JBOD shelf (with integrated SAS expander)
attached to an internal LSI SAS controller via a single SAS cable. The 16 SATA
disks are configured in one large z2pool (one drive was a spare), and it all
worked just fine.
A drive failed a while back, and the spare got used, and everything was still
fine. I removed the failed drive (confirmed it was dead in another system), and
bought a replacement drive. However, when I inserted the drive the OS didn't
see it.
I rebooted, and still no disk:
/dev/rdsk/c11t10d0
/dev/rdsk/c11t11d0
/dev/rdsk/c11t12d0
/dev/rdsk/c11t13d0
/dev/rdsk/c11t15d0
/dev/rdsk/c11t16d0
/dev/rdsk/c11t1d0
/dev/rdsk/c11t2d0
/dev/rdsk/c11t3d0
/dev/rdsk/c11t4d0
/dev/rdsk/c11t5d0
/dev/rdsk/c11t6d0
/dev/rdsk/c11t7d0
/dev/rdsk/c11t8d0
/dev/rdsk/c11t9d0
The newly-replaced disk should be /dev/rdsk/c11t14d0. I rebooted again, and
checked the BIOS on the controller -- the card sees the new drive. I double
checked it by removing and re-inserting the new drive, and the controller's
BIOS correctly saw it when it was in and didn't when it was out.
I checked to see if the /dev/rdsk/c11t14d0 link had failed to be created or
something, but the underlying device should be:
/devices/pci@1,0/pci1022,7450@2/pci1000,30e0@1/sd@e,0:wd,raw
and that doesn't exist (everything else up to sd@f does exist, of course).
I downloaded the solaris-compatible management utility from LSI and that shows
the drive in it's list. What follows are two commands from lsiutil -- the first
enumerates attached devices, and the second shows 'operating system device
names'. Note that for the missing drive there's no os device name.
bj@daniel:~$ pfexec ./lsiutil -p2 16
LSI Logic MPT Configuration Utility, Version 1.61, September 18, 2008
2 MPT Ports found
Port Name Chip Vendor/Type/Rev MPT Rev Firmware Rev IOC
2. mpt1 LSI Logic SAS1068 B1 105 011e0000 0
SAS1068's links are down, down, down, down, 3.0 G, 3.0 G, 3.0 G, 3.0 G
B___T SASAddress PhyNum Handle Parent Type
500605b001aea280 0001 SAS Initiator
500605b001aea281 0002 SAS Initiator
500605b001aea282 0003 SAS Initiator
500605b001aea283 0004 SAS Initiator
500605b001aea284 0005 SAS Initiator
500605b001aea285 0006 SAS Initiator
500605b001aea286 0007 SAS Initiator
500605b001aea287 0008 SAS Initiator
50030480005ab8ff 4 0009 0005 Edge Expander
0 1 50030480005ab8c8 8 000a 0009 SATA Target
0 2 50030480005ab8c9 9 000b 0009 SATA Target
0 3 50030480005ab8ca 10 000c 0009 SATA Target
0 4 50030480005ab8cb 11 000d 0009 SATA Target
0 5 50030480005ab8cc 12 000e 0009 SATA Target
0 6 50030480005ab8cd 13 000f 0009 SATA Target
0 7 50030480005ab8ce 14 0010 0009 SATA Target
0 8 50030480005ab8cf 15 0011 0009 SATA Target
0 9 50030480005ab8d0 16 0012 0009 SATA Target
0 10 50030480005ab8d1 17 0013 0009 SATA Target
0 11 50030480005ab8d2 18 0014 0009 SATA Target
0 12 50030480005ab8d3 19 0015 0009 SATA Target
0 13 50030480005ab8d4 20 0016 0009 SATA Target
0 14 50030480005ab8d5 21 0017 0009 SATA Target
0 15 50030480005ab8d6 22 0018 0009 SATA Target
0 16 50030480005ab8d7 23 0019 0009 SATA Target
0 0 50030480005ab8fd 28 001a 0009 SAS Initiator and Target
Type NumPhys PhyNum Handle PhyNum Handle Port Speed
Adapter 8 4 0005 --> 0 0009 4 3.0
5 0005 --> 1 0009 4 3.0
6 0005 --> 2 0009 4 3.0
7 0005 --> 3 0009 4 3.0
Expander 30 0 0009 --> 4 0005 4 3.0
1 0009 --> 5 0005 4 3.0
2 0009 --> 6 0005 4 3.0
3 0009 --> 7 0005 4 3.0
8 0009 --> 0 000a 4 3.0
9 0009 --> 0 000b 4 3.0
10 0009 --> 0 000c 4 3.0
11 0009 --> 0 000d 4 3.0
12 0009 --> 0 000e 4 3.0
13 0009 --> 0 000f 4 3.0
14 0009 --> 0 0010 4 3.0
15 0009 --> 0 0011 4 3.0
16 0009 --> 0 0012 4 3.0
17 0009 --> 0 0013 4 3.0
18 0009 --> 0 0014 4 3.0
19 0009 --> 0 0015 4 3.0
20 0009 --> 0 0016 4 3.0
21 0009 --> 0 0017 4 3.0
22 0009 --> 0 0018 4 3.0
23 0009 --> 0 0019 4 3.0
28 0009 --> 0 001a 4 3.0
Enclosure Handle Slots SASAddress B___T (SEP)
0001 8 500605b001aea280
0002 22 50030480005ab8ff 0 0
bj@daniel:~$ pfexec ./lsiutil -p2 42
LSI Logic MPT Configuration Utility, Version 1.61, September 18, 2008
2 MPT Ports found
Port Name Chip Vendor/Type/Rev MPT Rev Firmware Rev IOC
2. mpt1 LSI Logic SAS1068 B1 105 011e0000 0
mpt1 is /dev/cfg/c11
B___T___L Type Operating System Device Name
0 0 0 EnclServ /dev/es/ses0
0 1 0 Disk /dev/rdsk/c11t1d0s2
0 2 0 Disk /dev/rdsk/c11t2d0s2
0 3 0 Disk /dev/rdsk/c11t3d0s2
0 4 0 Disk /dev/rdsk/c11t4d0s2
0 5 0 Disk /dev/rdsk/c11t5d0s2
0 6 0 Disk /dev/rdsk/c11t6d0s2
0 7 0 Disk /dev/rdsk/c11t7d0s2
0 8 0 Disk /dev/rdsk/c11t8d0s2
0 9 0 Disk /dev/rdsk/c11t9d0s2
0 10 0 Disk /dev/rdsk/c11t10d0s2
0 11 0 Disk /dev/rdsk/c11t11d0s2
0 12 0 Disk /dev/rdsk/c11t12d0s2
0 13 0 Disk /dev/rdsk/c11t13d0s2
0 14 0 Disk
0 15 0 Disk /dev/rdsk/c11t15d0s2
0 16 0 Disk /dev/rdsk/c11t16d0s2
[end of command output]
It seems to me that the LSI controller sees the drive just fine, but for some
reason opensolaris doesn't see it, or at least failed to create a device entry
for it.
So, does anybody out there know what might cause the device to not get created?
Any ideas how to force it to create the device? Can one just do it manually?
--
This message posted from opensolaris.org
_______________________________________________
opensolaris-discuss mailing list
opensolaris-discuss@opensolaris.org
