Re: Benchmarks, raid0 performance, 1,2,3,4 drives
Content-Type: text/plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
Hello,
Just to let you know, I also see very similar IDE-RAID0 performance
problems:
I have RAID0 with two 30G DiamondMax (Maxtor) ATA-66 drives connected to
a Promise Ultra66 controller.
I am using kernel 2.4.0-test1-ac15+B5 raid on a dual PII-450 with 256M
RAM (but have seen the same problems on all of the 2.3.XX series.
Here are the results from bonnie:
---Sequential Output ---Sequential Input-- --Random--
-Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---
MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU
1200 6813 98.2 41157 42.0 10101 25.9 5205 78.9 14890 27.3 137.8 1.8
Here are the results from hdparm on my drives (just showing one because
they are identical):
/dev/hde:
Model=Maxtor 53073U6, FwRev=DA620CQ0, SerialNo=K604F9MC
Config={ Fixed }
RawCHS=4092/16/63, TrkSize=0, SectSize=0, ECCbytes=57
BuffType=DualPortCache, BuffSize=2048kB, MaxMultSect=16, MultSect=off
CurCHS=16383/16/63, CurSects=16514064, LBA=yes, LBAsects=60030432
IORDY=on/off, tPIO={min:120,w/IORDY:120}, tDMA={min:120,rec:120}
PIO modes: pio0 pio1 pio2 pio3 pio4
DMA modes: mdma0 mdma1 mdma2 udma0 udma1 udma2 udma3 *udma4
/dev/hde:
multcount= 0 (off)
I/O support = 0 (default 16-bit)
unmaskirq= 0 (off)
using_dma= 1 (on)
keepsettings = 0 (off)
nowerr = 0 (off)
readonly = 0 (off)
readahead= 8 (on)
geometry = 59554/16/63, sectors = 60030432, start = 0
Performance using 2.2.16 with raid+IDE patches gives very good
performance:
---Sequential Output ---Sequential Input-- --Random--
-Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---
MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU
1200 6813 98.9 40923 40.7 15584 35.3 7154 97.6 40258 26.6 151.5 1.7
Here is my raidtab:
raiddev /dev/md0
raid-level0
nr-raid-disks 2
persistent-superblock 1
chunk-size32
device/dev/hdg2
raid-disk 0
device/dev/hde2
raid-disk 1
And here are single-disk and md0 performance tests using hdparm -tT:
/dev/hde:
Timing buffer-cache reads: 128 MB in 1.13 seconds =113.27 MB/sec
Timing buffered disk reads: 64 MB in 2.46 seconds = 26.02 MB/sec
/dev/md0:
Timing buffer-cache reads: 128 MB in 0.94 seconds =136.17 MB/sec
Timing buffered disk reads: 64 MB in 1.66 seconds = 38.55 MB/sec
Hope this helps sort the matter out...
Scott
--
Scott M. Ransom Address: Harvard-Smithsonian CfA
Phone: (617) 495-4142 60 Garden St. MS 10
email: [EMAIL PROTECTED] Cambridge, MA 02138
PGP Fingerprint: D2 0E D0 10 CD 95 06 DA EF 78 FE 2B CB 3A D3 53
Re: performance limitations of linux raid
Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit > What stripe size, CPU and memory is used here? System is a dual-cpu PII 450Mhz with 256MB RAM. Disks are configured with chunk-size of 32kb (ext2 block-size is 4kb). > Is this a dual CPU system perhaps? Something Yes. See above. > unusual about the interrupt handling? UDMA33 vs. UDMA 66 (I'm using 40 > conductor cables, perhaps I need the 80s)? I am using UDMA66. When testing against UDMA33, I found a 10-15% speed difference. To get that speed increase you must have the UDMA66 cables... Scott -- Scott M. Ransom Phone: (781) 320-9867 Address: 75 Sanderson Ave. email: [EMAIL PROTECTED] Dedham, MA 02026 PGP Fingerprint: D2 0E D0 10 CD 95 06 DA EF 78 FE 2B CB 3A D3 53
RE: performance limitations of linux raid
Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit >> There's "specs" and then there's real life. I have never >> seen a hard drive >> that could do this. I've got brand new IBM 7200rpm ATA66 >> drives and I can't >> seem to get them to do much better than 6-7mb/sec with either Win98, >> Win2000, or Linux. That's with Abit BH6, an Asus P3C2000, >> and Supermicro >> PIIIDME boards. And yes, I'm using an 80 conductor cable. I'm using >> Wintune on the windows platforms and bonnie on Linux to do benchmarks. > > I don't believe the specs either, because they are for the "ideal" case. Believe it. I was getting about 45MB/s writes and 14 MB/s reads using RAID0 with the 2.3.99pre kernels on a Dual PII 450 with two 30G DiamondMax (7200rpm Maxtor) ATA-66 drives connected to a Promise Ultra66 controller. Then I moved back to kernel 2.2.15-pre18 with the RAID and IDE patches and here are my results: RAID0 on Promise Card 2.2.15-pre18 (1200MB test) -- ---Sequential Output ---Sequential Input-- --Random-- -Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks--- K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU 6833 99.2 42532 44.4 18397 42.2 7227 98.3 47754 33.0 182.8 1.5 ** When doing _actual_ work (I/O bound reads on huge data sets), I often see sustained read performance as high as 50MB/s. Tests on the individual drives show 28+ MB/s. The performance is simply amazing -- even during real work (at least mine -- YMMV). And best of all, the whole set-up (Promise card + 2X Maxtor drives only cost me $550) I simply can't see how SCSI can compete with that. Scott -- Scott M. Ransom Phone: (781) 320-9867 Address: 75 Sanderson Ave. email: [EMAIL PROTECTED] Dedham, MA 02026 PGP Fingerprint: D2 0E D0 10 CD 95 06 DA EF 78 FE 2B CB 3A D3 53
Re: RAID0: Fast writes, Slow reads...
Jakob Østergaard wrote: > > Someone (Probably Andre Hedrick, or perhaps Andrea Arcangali -- sorry guys, I > don't recall) explained this on LKML. Out of my memory it has something to do > with ATA modes and the kernel configuration. You haven't enabled ``Generic > busmaster support'', or perhaps one of the other IDE driver options, I don't > exactly remember which. But I was going to try it out myself as I see the same > odd numbers on a test system. Nope. That's not the problem (I think) here are the applicabel defines from my config: CONFIG_BLK_DEV_IDE=y CONFIG_BLK_DEV_IDEDISK=y CONFIG_BLK_DEV_IDECD=y CONFIG_BLK_DEV_IDEFLOPPY=y CONFIG_BLK_DEV_CMD640=y CONFIG_BLK_DEV_RZ1000=y CONFIG_BLK_DEV_IDEPCI=y CONFIG_IDEPCI_SHARE_IRQ=y CONFIG_BLK_DEV_IDEDMA_PCI=y CONFIG_IDEDMA_PCI_AUTO=y CONFIG_BLK_DEV_IDEDMA=y CONFIG_IDEDMA_AUTO=y CONFIG_IDEDMA_PCI_EXPERIMENTAL=y CONFIG_BLK_DEV_PIIX=y CONFIG_PIIX_TUNING=y CONFIG_BLK_DEV_PDC202XX=y CONFIG_BLK_DEV_IDE_MODES=y Scott PS: Am now using 2.3.99-pre1 and the problem still persists... -- Scott M. Ransom Phone: (781) 320-9867 Address: 75 Sanderson Ave. email: [EMAIL PROTECTED] Dedham, MA 02026 PGP Fingerprint: D2 0E D0 10 CD 95 06 DA EF 78 FE 2B CB 3A D3 53
RAID0: Fast writes, Slow reads...
Hello,
I have just set up RAID0 with two 30G DiamondMax (Maxtor) ATA-66 drives
connected to a Promise Ultra66 controller.
I am using raid 0.90 in kernel 2.3.51 on a dual PII-450 with 256M RAM.
Here are the results from bonnie:
---Sequential Output ---Sequential Input-- --Random--
-Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---
MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU
1200 6813 98.2 41157 42.0 10101 25.9 5205 78.9 14890 27.3 137.8 1.8
Seems like my sequential block writes are 3 times faster than the
reads. Any idea why that would be?
Here are the results from hdparm on my drives (just showing one because
they are identical):
Model=Maxtor 53073U6, FwRev=DA620CQ0, SerialNo=K604F9AC
Config={ Fixed }
RawCHS=4092/16/63, TrkSize=0, SectSize=0, ECCbytes=57
BuffType=3(DualPortCache), BuffSize=2048kB, MaxMultSect=16,
MultSect=off
DblWordIO=no, OldPIO=2, DMA=yes, OldDMA=0
CurCHS=16383/16/63, CurSects=16514064, LBA=yes, LBAsects=60030432
tDMA={min:120,rec:120}, DMA modes: mword0 mword1 mword2
IORDY=on/off, tPIO={min:120,w/IORDY:120}, PIO modes: mode3 mode4
UDMA modes: mode0 mode1 mode2 mode3 *mode4
/dev/hde:
multcount= 0 (off)
I/O support = 0 (default 16-bit)
unmaskirq= 0 (off)
using_dma= 1 (on)
keepsettings = 0 (off)
nowerr = 0 (off)
readonly = 0 (off)
readahead= 8 (on)
geometry = 59554/16/63, sectors = 60030432, start = 0
And here are the boot messaged corresponding to IDE and or RAID:
Uniform Multi-Platform E-IDE driver Revision: 6.30
ide: Assuming 40MHz system bus speed for PIO modes; override with
idebus=xx
PIIX4: IDE controller on PCI bus 00 dev 21
PIIX4: not 100% native mode: will probe irqs later
ide0: BM-DMA at 0xd800-0xd807, BIOS settings: hda:DMA, hdb:pio
ide1: BM-DMA at 0xd808-0xd80f, BIOS settings: hdc:DMA, hdd:pio
PDC20262: IDE controller on PCI bus 00 dev 50
PDC20262: not 100% native mode: will probe irqs later
PDC20262: (U)DMA Burst Bit ENABLED Primary PCI Mode Secondary PCI Mode.
ide2: BM-DMA at 0xa400-0xa407, BIOS settings: hde:DMA, hdf:pio
ide3: BM-DMA at 0xa408-0xa40f, BIOS settings: hdg:DMA, hdh:pio
hda: WDC AC420400D, ATA DISK drive
hdb: IOMEGA ZIP 100 ATAPI, ATAPI FLOPPY drive
hdc: LTN382, ATAPI CDROM drive
hde: Maxtor 53073U6, ATA DISK drive
hdg: Maxtor 53073U6, ATA DISK drive
ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
ide1 at 0x170-0x177,0x376 on irq 15
ide2 at 0xb800-0xb807,0xb402 on irq 3
ide3 at 0xb000-0xb007,0xa802 on irq 3
hda: WDC AC420400D, 19470MB w/1966kB Cache, CHS=39560/16/63, UDMA(33)
hde: Maxtor 53073U6, 29311MB w/2048kB Cache, CHS=59554/16/63, UDMA(66)
hdg: Maxtor 53073U6, 29311MB w/2048kB Cache, CHS=59554/16/63, UDMA(66)
hdc: ATAPI 40X CD-ROM drive, 120kB Cache, UDMA(33)
Uniform CD-ROM driver Revision: 3.07
hdb: 98304kB, 196608 blocks, 512 sector size,
hdb: 98304kB, 96/64/32 CHS, 4096 kBps, 512 sector size, 2941 rpm
Partition check:
hda: hda1 hda2 < hda5 hda6 hda7 hda8 >
hdb: hdb4
hde: hde1 hde2
hdg: hdg1 hdg2
Floppy drive(s): fd0 is 1.44M
FDC 0 is a post-1991 82077
md driver 0.90.0 MAX_MD_DEVS=256, MAX_REAL=12
raid0 personality registered
md.c: sizeof(mdp_super_t) = 4096
...
autorun ...
considering hdg2 ...
adding hdg2 ...
adding hde2 ...
created md0
bind
bind
running:
now!
hdg2's event counter: 0003
hde2's event counter: 0003
md0: max total readahead window set to 256k
md0: 2 data-disks, max readahead per data-disk: 128k
raid0: looking at hde2
raid0: comparing hde2(29883584) with hde2(29883584)
raid0: END
raid0: ==> UNIQUE
raid0: 1 zones
raid0: looking at hdg2
raid0: comparing hdg2(29883584) with hde2(29883584)
raid0: EQUAL
raid0: FINAL 1 zones
zone 0
checking hde2 ... contained as device 0
(29883584) is smallest!.
checking hdg2 ... contained as device 1
zone->nb_dev: 2, size: 59767168
current zone offset: 29883584
done.
raid0 : md_size is 59767168 blocks.
raid0 : conf->smallest->size is 59767168 blocks.
raid0 : nb_zone is 1.
raid0 : Allocating 8 bytes for hash.
md: updating md0 RAID superblock on device
hdg2 [events: 0004](write) hdg2's sb offset: 29883584
hde2 [events: 0004](write) hde2's sb offset: 29883584
.
... autorun DONE.
Thanks a bunch,
Scott
--
Scott M. Ransom Address: Harvard-Smithsonian CfA
Phone: (617) 495-4142 60 Garden St. MS 10
email: [EMAIL PROTECTED] Cambridge, MA 02138
PGP Fingerprint: D2 0E D0 10 CD 95 06 DA EF 78 FE 2B CB 3A D3 53
Re: RAID0: Fast writes, Slow reads...
Kent Nilsen wrote: > > Do you by any chance have problems with the entire system > freezing after a while or during lots of activity? Only freezes I have seen seem to be coming from Netscape occasionally hogging all available resources (I think). But I will look more carefully in the future... Scott -- Scott M. Ransom Address: Harvard-Smithsonian CfA Phone: (617) 495-4142 60 Garden St. MS 10 email: [EMAIL PROTECTED] Cambridge, MA 02138 PGP Fingerprint: D2 0E D0 10 CD 95 06 DA EF 78 FE 2B CB 3A D3 53
RAID0: Fast writes, Slow reads...
Hello,
I have just set up RAID0 with two 30G DiamondMax (Maxtor) ATA-66 drives
connected to a Promise Ultra66 controller.
I am using raid 0.90 in kernel 2.3.51 on a dual PII-450 with 256M RAM.
Here are the results from bonnie:
---Sequential Output ---Sequential Input-- --Random--
-Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---
MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU
1200 6813 98.2 41157 42.0 10101 25.9 5205 78.9 14890 27.3 137.8 1.8
Seems like my sequential block writes are 3 times faster than the
reads. Any idea why that would be?
Here are the results from hdparm on my drives (just showing one because
they are identical):
Model=Maxtor 53073U6, FwRev=DA620CQ0, SerialNo=K604F9AC
Config={ Fixed }
RawCHS=4092/16/63, TrkSize=0, SectSize=0, ECCbytes=57
BuffType=3(DualPortCache), BuffSize=2048kB, MaxMultSect=16,
MultSect=off
DblWordIO=no, OldPIO=2, DMA=yes, OldDMA=0
CurCHS=16383/16/63, CurSects=16514064, LBA=yes, LBAsects=60030432
tDMA={min:120,rec:120}, DMA modes: mword0 mword1 mword2
IORDY=on/off, tPIO={min:120,w/IORDY:120}, PIO modes: mode3 mode4
UDMA modes: mode0 mode1 mode2 mode3 *mode4
/dev/hde:
multcount= 0 (off)
I/O support = 0 (default 16-bit)
unmaskirq= 0 (off)
using_dma= 1 (on)
keepsettings = 0 (off)
nowerr = 0 (off)
readonly = 0 (off)
readahead= 8 (on)
geometry = 59554/16/63, sectors = 60030432, start = 0
And here are the boot messaged corresponding to IDE and or RAID:
Uniform Multi-Platform E-IDE driver Revision: 6.30
ide: Assuming 40MHz system bus speed for PIO modes; override with
idebus=xx
PIIX4: IDE controller on PCI bus 00 dev 21
PIIX4: not 100% native mode: will probe irqs later
ide0: BM-DMA at 0xd800-0xd807, BIOS settings: hda:DMA, hdb:pio
ide1: BM-DMA at 0xd808-0xd80f, BIOS settings: hdc:DMA, hdd:pio
PDC20262: IDE controller on PCI bus 00 dev 50
PDC20262: not 100% native mode: will probe irqs later
PDC20262: (U)DMA Burst Bit ENABLED Primary PCI Mode Secondary PCI Mode.
ide2: BM-DMA at 0xa400-0xa407, BIOS settings: hde:DMA, hdf:pio
ide3: BM-DMA at 0xa408-0xa40f, BIOS settings: hdg:DMA, hdh:pio
hda: WDC AC420400D, ATA DISK drive
hdb: IOMEGA ZIP 100 ATAPI, ATAPI FLOPPY drive
hdc: LTN382, ATAPI CDROM drive
hde: Maxtor 53073U6, ATA DISK drive
hdg: Maxtor 53073U6, ATA DISK drive
ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
ide1 at 0x170-0x177,0x376 on irq 15
ide2 at 0xb800-0xb807,0xb402 on irq 3
ide3 at 0xb000-0xb007,0xa802 on irq 3
hda: WDC AC420400D, 19470MB w/1966kB Cache, CHS=39560/16/63, UDMA(33)
hde: Maxtor 53073U6, 29311MB w/2048kB Cache, CHS=59554/16/63, UDMA(66)
hdg: Maxtor 53073U6, 29311MB w/2048kB Cache, CHS=59554/16/63, UDMA(66)
hdc: ATAPI 40X CD-ROM drive, 120kB Cache, UDMA(33)
Uniform CD-ROM driver Revision: 3.07
hdb: 98304kB, 196608 blocks, 512 sector size,
hdb: 98304kB, 96/64/32 CHS, 4096 kBps, 512 sector size, 2941 rpm
Partition check:
hda: hda1 hda2 < hda5 hda6 hda7 hda8 >
hdb: hdb4
hde: hde1 hde2
hdg: hdg1 hdg2
Floppy drive(s): fd0 is 1.44M
FDC 0 is a post-1991 82077
md driver 0.90.0 MAX_MD_DEVS=256, MAX_REAL=12
raid0 personality registered
md.c: sizeof(mdp_super_t) = 4096
...
autorun ...
considering hdg2 ...
adding hdg2 ...
adding hde2 ...
created md0
bind
bind
running:
now!
hdg2's event counter: 0003
hde2's event counter: 0003
md0: max total readahead window set to 256k
md0: 2 data-disks, max readahead per data-disk: 128k
raid0: looking at hde2
raid0: comparing hde2(29883584) with hde2(29883584)
raid0: END
raid0: ==> UNIQUE
raid0: 1 zones
raid0: looking at hdg2
raid0: comparing hdg2(29883584) with hde2(29883584)
raid0: EQUAL
raid0: FINAL 1 zones
zone 0
checking hde2 ... contained as device 0
(29883584) is smallest!.
checking hdg2 ... contained as device 1
zone->nb_dev: 2, size: 59767168
current zone offset: 29883584
done.
raid0 : md_size is 59767168 blocks.
raid0 : conf->smallest->size is 59767168 blocks.
raid0 : nb_zone is 1.
raid0 : Allocating 8 bytes for hash.
md: updating md0 RAID superblock on device
hdg2 [events: 0004](write) hdg2's sb offset: 29883584
hde2 [events: 0004](write) hde2's sb offset: 29883584
.
... autorun DONE.
Thanks a bunch,
Scott
--
Scott M. Ransom Address: Harvard-Smithsonian CfA
Phone: (617) 495-4142 60 Garden St. MS 10
email: [EMAIL PROTECTED] Cambridge, MA 02138
PGP Fingerprint: D2 0E D0 10 CD 95 06 DA EF 78 FE 2B CB 3A D3 53
