Steve Shockley wrote:
Perhaps, I'll see if I can find a similar machine and run some
benchmarks. Since most of what I have are ciss and cac, does anyone
have approximate disk benchmarks for U320 10k disks in RAID 1+0? I've
had good results with OpenBSD and ciss SAS controllers, but I think
they're different chips than the ciss SCSI controllers.
Here's a couple of dd results--4 15K "ModusLink" (supposed to refurbed
Fujitsu) disks in Raid 10 on an LSI MegaRAID controller:
jr...@varley:/var/postgresql $ sudo time dd if=/dev/zero of=big_file bs=8k
count=1024000
1024000+0 records in
1024000+0 records out
8388608000 bytes transferred in 276.573 secs (30330468 bytes/sec)
276.60 real 0.17 user 60.39 sys
jr...@varley:/var/postgresql $ sudo time dd if=big_file of=/dev/null bs=8k
Password:
1024000+0 records in
1024000+0 records out
8388608000 bytes transferred in 105.099 secs (79815997 bytes/sec)
105.14 real 0.21 user 19.22 sys
dmesg: (GENERIC.MP with BIGMEM=1)
OpenBSD 4.7-current (GENERIC.MP) #5: Thu Apr 15 15:41:48 MDT 2010
r...@varley.openvistas.net:/usr/src/sys/arch/amd64/compile/GENERIC.MP
real mem = 8588820480 (8190MB)
avail mem = 8362405888 (7975MB)
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.3 @ 0xfbf30 (60 entries)
bios0: vendor American Megatrends Inc. version "080010" date 04/25/2005
bios0: Supermicro H8DA8/H8DAR
acpi0 at bios0: rev 2
acpi0: tables DSDT FACP APIC OEMB SRAT
acpi0: wakeup devices PCI1(S4) USB0(S4) USB1(S4) PS2K(S4) PS2M(S4) UAR1(S4)
UAR2(S4) GOLA(S4) GOLB(S4) PWRB(S4)
acpitimer0 at acpi0: 3579545 Hz, 24 bits
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: AMD Opteron(tm) Processor 250, 2393.47 MHz
cpu0:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SSE3,NXE,MMXX,FFXSR,LONG,3DNOW2,3DNOW
cpu0: 64KB 64b/line 2-way I-cache, 64KB 64b/line 2-way D-cache, 1MB 64b/line
16-way L2 cache
cpu0: ITLB 32 4KB entries fully associative, 8 4MB entries fully associative
cpu0: DTLB 32 4KB entries fully associative, 8 4MB entries fully associative
cpu0: AMD erratum 89 present, BIOS upgrade may be required
cpu0: apic clock running at 199MHz
cpu1 at mainbus0: apid 1 (application processor)
cpu1: AMD Opteron(tm) Processor 250, 2393.18 MHz
cpu1:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,SSE3,NXE,MMXX,FFXSR,LONG,3DNOW2,3DNOW
cpu1: 64KB 64b/line 2-way I-cache, 64KB 64b/line 2-way D-cache, 1MB 64b/line
16-way L2 cache
cpu1: ITLB 32 4KB entries fully associative, 8 4MB entries fully associative
cpu1: DTLB 32 4KB entries fully associative, 8 4MB entries fully associative
cpu1: AMD erratum 89 present, BIOS upgrade may be required
ioapic0 at mainbus0: apid 2 pa 0xfec00000, version 11, 24 pins
ioapic1 at mainbus0: apid 3 pa 0xfebfe000, version 11, 4 pins
ioapic2 at mainbus0: apid 4 pa 0xfebff000, version 11, 4 pins
acpiprt0 at acpi0: bus 0 (PCI0)
acpiprt1 at acpi0: bus 3 (PCI1)
acpiprt2 at acpi0: bus 2 (GOLA)
acpiprt3 at acpi0: bus 1 (GOLB)
acpicpu0 at acpi0
acpicpu1 at acpi0
acpibtn0 at acpi0: PWRB
ipmi at mainbus0 not configured
pci0 at mainbus0 bus 0
iommu0 at cpu0: base 0x80000000 length 512MB pte 0x10cb00000
iommu1 at cpu1: base 0x80000000 length 512MB pte 0x10cb00000
ppb0 at pci0 dev 6 function 0 "AMD 8111 PCI-PCI" rev 0x07
pci1 at ppb0 bus 3
ohci0 at pci1 dev 0 function 0 "AMD 8111 USB" rev 0x0b: apic 2 int 19 (irq 9),
version 1.0, legacy support
ohci1 at pci1 dev 0 function 1 "AMD 8111 USB" rev 0x0b: apic 2 int 19 (irq 9),
version 1.0, legacy support
vga1 at pci1 dev 4 function 0 "ATI Rage XL" rev 0x27
wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
usb0 at ohci0: USB revision 1.0
uhub0 at usb0 "AMD OHCI root hub" rev 1.00/1.00 addr 1
usb1 at ohci1: USB revision 1.0
uhub1 at usb1 "AMD OHCI root hub" rev 1.00/1.00 addr 1
amdpcib0 at pci0 dev 7 function 0 "AMD 8111 LPC" rev 0x05: 32-bit 14318179Hz
timer rev 3
pciide0 at pci0 dev 7 function 1 "AMD 8111 IDE" rev 0x03: DMA, channel 0
configured to compatibility, channel 1 configured to compatibility
atapiscsi0 at pciide0 channel 0 drive 1
scsibus0 at atapiscsi0: 2 targets
cd0 at scsibus0 targ 0 lun 0: <MATSHITA, DVD-ROM SR-8178, PZ16> ATAPI 5/cdrom
removable
cd0(pciide0:0:1): using PIO mode 4, Ultra-DMA mode 4
pciide0: channel 1 disabled (no drives)
amdiic0 at pci0 dev 7 function 2 "AMD 8111 SMBus" rev 0x02: SCI
iic0 at amdiic0
lm1 at iic0 addr 0x2d: W83627HF
lm2 at iic0 addr 0x2f: W83792D rev D
amdpm0 at pci0 dev 7 function 3 "AMD 8111 Power" rev 0x05
ppb1 at pci0 dev 10 function 0 "AMD 8131 PCIX" rev 0x12
pci2 at ppb1 bus 2
aapic0 at pci0 dev 10 function 1 "AMD 8131 PCIX IOAPIC" rev 0x01
ppb2 at pci0 dev 11 function 0 "AMD 8131 PCIX" rev 0x12
pci3 at ppb2 bus 1
ami0 at pci3 dev 1 function 0 "Symbios Logic MegaRAID" rev 0x01: apic 4 int 0
(irq 10)
ami0: LSI 520, 64b/lhc, FW 1L47, BIOS vG121, 64MB RAM
ami0: 1 channels, 0 FC loops, 4 logical drives
scsibus1 at ami0: 40 targets
sd0 at scsibus1 targ 0 lun 0: <AMI, Host drive #00, > SCSI2 0/direct fixed
sd0: 35045MB, 512 bytes/sec, 71772160 sec total
sd1 at scsibus1 targ 1 lun 0: <AMI, Host drive #01, > SCSI2 0/direct fixed
sd1: 35045MB, 512 bytes/sec, 71772160 sec total
sd2 at scsibus1 targ 2 lun 0: <AMI, Host drive #02, > SCSI2 0/direct fixed
sd2: 140270MB, 512 bytes/sec, 287272960 sec total
sd3 at scsibus1 targ 3 lun 0: <AMI, Host drive #03, > SCSI2 0/direct fixed
sd3: 70135MB, 512 bytes/sec, 143636480 sec total
scsibus2 at ami0: 16 targets
ses0 at scsibus2 targ 15 lun 0: <ADAPTEC, AltEvo U320, 0028> SCSI3 3/processor
removable
bge0 at pci3 dev 5 function 0 "Broadcom BCM5704C" rev 0x10, BCM5704 B0
(0x2100): apic 4 int 1 (irq 11), address 00:30:48:75:47:6a
brgphy0 at bge0 phy 1: BCM5704 10/100/1000baseT PHY, rev. 0
bge1 at pci3 dev 5 function 1 "Broadcom BCM5704C" rev 0x10, BCM5704 B0
(0x2100): apic 4 int 2 (irq 5), address 00:30:48:75:47:6b
brgphy1 at bge1 phy 1: BCM5704 10/100/1000baseT PHY, rev. 0
aapic1 at pci0 dev 11 function 1 "AMD 8131 PCIX IOAPIC" rev 0x01
pchb0 at pci0 dev 24 function 0 "AMD AMD64 0Fh HyperTransport" rev 0x00
pchb1 at pci0 dev 24 function 1 "AMD AMD64 0Fh Address Map" rev 0x00
pchb2 at pci0 dev 24 function 2 "AMD AMD64 0Fh DRAM Cfg" rev 0x00
kate0 at pci0 dev 24 function 3 "AMD AMD64 0Fh Misc Cfg" rev 0x00
pchb3 at pci0 dev 25 function 0 "AMD AMD64 0Fh HyperTransport" rev 0x00
pchb4 at pci0 dev 25 function 1 "AMD AMD64 0Fh Address Map" rev 0x00
pchb5 at pci0 dev 25 function 2 "AMD AMD64 0Fh DRAM Cfg" rev 0x00
kate1 at pci0 dev 25 function 3 "AMD AMD64 0Fh Misc Cfg" rev 0x00
isa0 at amdpcib0
isadma0 at isa0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
com0: console
com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
pckbc0 at isa0 port 0x60/5
pcppi0 at isa0 port 0x61
midi0 at pcppi0: <PC speaker>
spkr0 at pcppi0
lpt0 at isa0 port 0x378/4 irq 7
wbsio0 at isa0 port 0x2e/2: W83627HF rev 0x41
lm3 at wbsio0 port 0x290/8: W83627HF
lm1 detached
fdc0 at isa0 port 0x3f0/6 irq 6 drq 2
fd0 at fdc0 drive 0: 1.44MB 80 cyl, 2 head, 18 sec
mtrr: Pentium Pro MTRR support
vscsi0 at root
scsibus3 at vscsi0: 256 targets
softraid0 at root
root on sd0a swap on sd0b dump on sd0b
jr...@varley:/var/postgresql $ sudo bioctl -vvv ami0
Volume Status Size Device
ami0 0 Online 36747345920 sd0 RAID1
0 Online 36747345920 0:0.0 ses0 <FUJITSU MAP3367NC 0108>
'UPQ0P5201W8L'
1 Online 36747345920 0:1.0 ses0 <FUJITSU MAP3367NC 0108>
'UPQ0P5201W8E'
ami0 1 Online 36747345920 sd1 RAID1
0 Online 36747345920 0:2.0 ses0 <FUJITSU MAP3367NC 0108>
'UPQ0P5201W86'
1 Online 36747345920 0:3.0 ses0 <FUJITSU MAP3367NC 0108>
'UPQ0P5201W8R'
ami0 2 Online 147083755520 sd2 RAID10
0 Online 73541877760 0:8.0 ses0 <ModusLnkMXO3073SC800600UM108>
' ML00011418'
1 Online 73541877760 0:9.0 ses0 <ModusLnkMXO3073SC800600UM108>
' ML00011447'
2 Online 73541877760 0:10.0 ses0 <ModusLnkMXO3073SC800600UM108>
' ML00011439'
3 Online 73541877760 0:11.0 ses0 <ModusLnkMXO3073SC800600UM108>
' ML00011450'
ami0 3 Online 73541877760 sd3 RAID1
0 Online 73541877760 0:12.0 ses0 <ModusLnkMXO3073SC800600UM108>
' ML00011443'
1 Online 73541877760 0:13.0 ses0 <ModusLnkMXO3073SC800600XM108>
' ML00009129'
ami0 4 Hot spare 36748944896 0:4.0 ses0 <FUJITSU MAP3367NC 0108>
'UPQ0P5201W8U'
ami0 5 Hot spare 73543163392 0:5.0 ses0 <ModusLnkMXO3073SC800600UM108>
' ML00011444'