On Wed, 11 Mar 2009, Miles O'Neal wrote:
Jon Peatfield said...
[snip]
|Re-configuring your RAID controllers to export as <2TB slices isn't fun,
|but it should be possible without a re-install (if a bit fiddly).
Thanks for all of this.
I'll look again, but I didn't notice anything obvious in the Adaptec
screens at boot that would do this. Any key phrases to look for?
With luck it is somewhere in the 'container' documentation/descriptions.
I don't have a lot of experience with recent Adaptec raid controllers, on
one box with ~3TB of disk on an adaptec 216010SA it had to be configured
as 2 RAID-5 sets each over parts of the same disks which sounds horrid I
know...
ie in aaccli (yes this is old!) we see:
CLI > open aac0
Executing: open "aac0"
AAC0> disk list
Executing: disk list
C:ID:L Device Type Blocks Bytes/Block Usage Shared Rate
------ -------------- --------- ----------- ---------------- ------ ----
0:00:0 Disk 488397168 512 Initialized NO 264
0:01:0 Disk 488397168 512 Initialized NO 264
0:02:0 Disk 488397168 512 Initialized NO 264
0:03:0 Disk 488397168 512 Initialized NO 264
0:04:0 Disk 488397168 512 Initialized NO 264
0:05:0 Disk 488397168 512 Initialized NO 264
0:06:0 Disk 488397168 512 Initialized NO 264
0:07:0 Disk 488397168 512 Initialized NO 264
1:00:0 Disk 488397168 512 Initialized NO 264
1:01:0 Disk 488397168 512 Initialized NO 264
1:02:0 Disk 488397168 512 Initialized NO 264
1:03:0 Disk 488397168 512 Initialized NO 264
1:04:0 Disk 488397168 512 Initialized NO 264
1:05:0 Disk 488397168 512 Initialized NO 264
1:07:0 Disk 488397168 512 Initialized NO 264
AAC0> disk show part
Executing: disk show partition
Scsi Partition Container MultiLevel
C:ID:L Offset:Size Num Type Num Type R/W
------ ------------- --- ------ --- ------ ---
0:00:0 64.0KB: 116GB 0 RAID-5 0 None RW
0:00:0 116GB: 116GB 1 RAID-5 0 None RW
0:01:0 64.0KB: 116GB 0 RAID-5 0 None RW
0:01:0 116GB: 116GB 1 RAID-5 0 None RW
0:03:0 64.0KB: 116GB 0 RAID-5 0 None RW
0:03:0 116GB: 116GB 1 RAID-5 0 None RW
0:04:0 64.0KB: 116GB 0 RAID-5 0 None RW
0:04:0 116GB: 116GB 1 RAID-5 0 None RW
0:05:0 64.0KB: 116GB 0 RAID-5 0 None RW
0:05:0 116GB: 116GB 1 RAID-5 0 None RW
0:06:0 64.0KB: 116GB 0 RAID-5 0 None RW
0:06:0 116GB: 116GB 1 RAID-5 0 None RW
0:07:0 64.0KB: 116GB 0 RAID-5 0 None RW
0:07:0 116GB: 116GB 1 RAID-5 0 None RW
1:00:0 64.0KB: 116GB 0 RAID-5 0 None RW
1:00:0 116GB: 116GB 1 RAID-5 0 None RW
1:01:0 64.0KB: 116GB 0 RAID-5 0 None RW
1:01:0 116GB: 116GB 1 RAID-5 0 None RW
1:02:0 64.0KB: 116GB 0 RAID-5 0 None RW
1:02:0 116GB: 116GB 1 RAID-5 0 None RW
1:03:0 64.0KB: 116GB 0 RAID-5 0 None RW
1:03:0 116GB: 116GB 1 RAID-5 0 None RW
1:04:0 64.0KB: 116GB 0 RAID-5 0 None RW
1:04:0 116GB: 116GB 1 RAID-5 0 None RW
1:05:0 64.0KB: 116GB 0 RAID-5 0 None RW
1:05:0 116GB: 116GB 1 RAID-5 0 None RW
1:07:0 64.0KB: 116GB 1 RAID-5 0 None RW
1:07:0 116GB: 116GB 0 RAID-5 0 None RW
AAC0> contain list
Executing: container list
Num Total Oth Stripe Scsi Partition
Label Type Size Ctr Size Usage C:ID:L Offset:Size
----- ------ ------ --- ------ ------- ------ -------------
0 RAID-5 1.47TB 64KB Open 0:00:0 64.0KB: 116GB
/dev/sda SubData 0:01:0 64.0KB: 116GB
0:04:0 64.0KB: 116GB
0:03:0 64.0KB: 116GB
1:07:0 116GB: 116GB
0:05:0 64.0KB: 116GB
0:06:0 64.0KB: 116GB
0:07:0 64.0KB: 116GB
1:00:0 64.0KB: 116GB
1:01:0 64.0KB: 116GB
1:02:0 64.0KB: 116GB
1:03:0 64.0KB: 116GB
1:04:0 64.0KB: 116GB
1:05:0 64.0KB: 116GB
1 RAID-5 1.47TB 64KB Open 0:00:0 116GB: 116GB
/dev/sdb SubData2 0:01:0 116GB: 116GB
0:04:0 116GB: 116GB
0:03:0 116GB: 116GB
1:07:0 64.0KB: 116GB
0:05:0 116GB: 116GB
0:06:0 116GB: 116GB
0:07:0 116GB: 116GB
1:00:0 116GB: 116GB
1:01:0 116GB: 116GB
1:02:0 116GB: 116GB
1:03:0 116GB: 116GB
1:04:0 116GB: 116GB
1:05:0 116GB: 116GB
AAC0> contain show fail
Executing: container show failover
Container Scsi C:ID:L
--------- ----------------------------------
GLOBAL 0:02:0
MISSING
0 --- No Devices Assigned ---
1 --- No Devices Assigned ---
so it seems to be treating regions of each disk as a 'partition' and
making up 2 raid-5 sets. At some point when a drive got failed/replaced
it seems to have added the bits from a hot-spare in the other order.
The interface on some other devices (e.g. Infortrend and PERC/6) is a
little nicer in that you make a single large RAID set and then export some
portions of it to the host (or possibly to different hosts for devices
with multiple interfaces).
-- Jon