Re: RAID0: Fast writes, Slow reads...
When running Bonnie, you should always set the file size to 3-4 times the size of your RAM, else you get the 200Mb /sec speeds (which are very pleasant, but not realistic). I think the 100% CPU is in great part Bonnie generating the test files. I've tried copying files, this takes almost no CPU power. The crashes are very annoying, no messages in the logs or anything. I've run extensive memory tests and today I'm installing a new 3c905 card i case that's the problem. After that I don't know... Rearranging all PCI cards? I'll tell if I discover anything useful. Kent > Funny (or not), this sounds a lot like my current problems. > > I have a HP Netserver LH4 with integrated HP Netraid controller. When > doing heavy I/O on the Netraid controller the entire system more or > less freezes. I am using newet firmware version (have even tried a > few older versions), and have tried it on 2.2.14 and 2.2.15pre14. > > Doing bonnie on a single 9GB HP disk shows the following: > > ---Sequential Output ---Sequential Input-- > --Random-- -Per Char- --Block--- -Rewrite-- -Per Char- > --Block--- --Seeks--- > MachineMB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU > /sec %CPU > 100 7771 99.5 6753 3.8 4513 9.2 7830 99.6 245756 100.8 > 22572.5 95.9 > > > That is approx. 4 times faster on block read than block write, but > 100% cpu load on block read!! > > I was coming to the conclusion that I had to look deep into the AMI > Megaraid driver to try and locate the problem, but could the problem > by chance be more generic ? > > Can anyone offer some qualified guidance about where to start look for > this problem ? > > /bart
Re: RAID0: Fast writes, Slow reads...
Jakob Østergaard wrote: > > Someone (Probably Andre Hedrick, or perhaps Andrea Arcangali -- sorry guys, I > don't recall) explained this on LKML. Out of my memory it has something to do > with ATA modes and the kernel configuration. You haven't enabled ``Generic > busmaster support'', or perhaps one of the other IDE driver options, I don't > exactly remember which. But I was going to try it out myself as I see the same > odd numbers on a test system. Nope. That's not the problem (I think) here are the applicabel defines from my config: CONFIG_BLK_DEV_IDE=y CONFIG_BLK_DEV_IDEDISK=y CONFIG_BLK_DEV_IDECD=y CONFIG_BLK_DEV_IDEFLOPPY=y CONFIG_BLK_DEV_CMD640=y CONFIG_BLK_DEV_RZ1000=y CONFIG_BLK_DEV_IDEPCI=y CONFIG_IDEPCI_SHARE_IRQ=y CONFIG_BLK_DEV_IDEDMA_PCI=y CONFIG_IDEDMA_PCI_AUTO=y CONFIG_BLK_DEV_IDEDMA=y CONFIG_IDEDMA_AUTO=y CONFIG_IDEDMA_PCI_EXPERIMENTAL=y CONFIG_BLK_DEV_PIIX=y CONFIG_PIIX_TUNING=y CONFIG_BLK_DEV_PDC202XX=y CONFIG_BLK_DEV_IDE_MODES=y Scott PS: Am now using 2.3.99-pre1 and the problem still persists... -- Scott M. Ransom Phone: (781) 320-9867 Address: 75 Sanderson Ave. email: [EMAIL PROTECTED] Dedham, MA 02026 PGP Fingerprint: D2 0E D0 10 CD 95 06 DA EF 78 FE 2B CB 3A D3 53
Re: RAID0: Fast writes, Slow reads...
On Tue, 14 Mar 2000, Scott M. Ransom wrote:
> Hello,
>
> I have just set up RAID0 with two 30G DiamondMax (Maxtor) ATA-66 drives
> connected to a Promise Ultra66 controller.
>
> I am using raid 0.90 in kernel 2.3.51 on a dual PII-450 with 256M RAM.
>
> Here are the results from bonnie:
>
> ---Sequential Output ---Sequential Input-- --Random--
> -Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---
> MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU
> 1200 6813 98.2 41157 42.0 10101 25.9 5205 78.9 14890 27.3 137.8 1.8
>
> Seems like my sequential block writes are 3 times faster than the
> reads. Any idea why that would be?
Someone (Probably Andre Hedrick, or perhaps Andrea Arcangali -- sorry guys, I
don't recall) explained this on LKML. Out of my memory it has something to do
with ATA modes and the kernel configuration. You haven't enabled ``Generic
busmaster support'', or perhaps one of the other IDE driver options, I don't
exactly remember which. But I was going to try it out myself as I see the same
odd numbers on a test system.
If you experiment a little and find the right option, please post here :)
Or search the LKML archives, the mail was posted last week (I think).
--
: [EMAIL PROTECTED] : And I see the elder races, :
:.: putrid forms of man:
: Jakob Østergaard : See him rise and claim the earth, :
:OZ9ABN : his downfall is at hand. :
:.:{Konkhra}...:
Re: RAID0: Fast writes, Slow reads...
> "Kent" == Kent Nilsen <[EMAIL PROTECTED]> writes: Kent> I've got exactly the same problem on a Mylex hardware RAID- Kent> controller, writing is nearly twice as fast as reading. The Kent> drives are Barracuda 50Gb drives, the controller is a Kent> DAC1164P. I use the latest firmware, and latest drivers from Kent> dandelion.com. Kernel version is 2.2.14, distribution=Mandrake Kent> 7.0. Single PIII-600 on dual motherboard (Asus P2B-DS), 392 Mb Kent> RAM. Kent> Do you by any chance have problems with the entire system Kent> freezing after a while or during lots of activity? I've got that Kent> problem, though my firmware should be a fixed version. Funny (or not), this sounds a lot like my current problems. I have a HP Netserver LH4 with integrated HP Netraid controller. When doing heavy I/O on the Netraid controller the entire system more or less freezes. I am using newet firmware version (have even tried a few older versions), and have tried it on 2.2.14 and 2.2.15pre14. Doing bonnie on a single 9GB HP disk shows the following: ---Sequential Output ---Sequential Input-- --Random-- -Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks--- MachineMB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU 100 7771 99.5 6753 3.8 4513 9.2 7830 99.6 245756 100.8 22572.5 95.9 That is approx. 4 times faster on block read than block write, but 100% cpu load on block read!! I was coming to the conclusion that I had to look deep into the AMI Megaraid driver to try and locate the problem, but could the problem by chance be more generic ? Can anyone offer some qualified guidance about where to start look for this problem ? /bart
RAID0: Fast writes, Slow reads...
Hello,
I have just set up RAID0 with two 30G DiamondMax (Maxtor) ATA-66 drives
connected to a Promise Ultra66 controller.
I am using raid 0.90 in kernel 2.3.51 on a dual PII-450 with 256M RAM.
Here are the results from bonnie:
---Sequential Output ---Sequential Input-- --Random--
-Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---
MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU
1200 6813 98.2 41157 42.0 10101 25.9 5205 78.9 14890 27.3 137.8 1.8
Seems like my sequential block writes are 3 times faster than the
reads. Any idea why that would be?
Here are the results from hdparm on my drives (just showing one because
they are identical):
Model=Maxtor 53073U6, FwRev=DA620CQ0, SerialNo=K604F9AC
Config={ Fixed }
RawCHS=4092/16/63, TrkSize=0, SectSize=0, ECCbytes=57
BuffType=3(DualPortCache), BuffSize=2048kB, MaxMultSect=16,
MultSect=off
DblWordIO=no, OldPIO=2, DMA=yes, OldDMA=0
CurCHS=16383/16/63, CurSects=16514064, LBA=yes, LBAsects=60030432
tDMA={min:120,rec:120}, DMA modes: mword0 mword1 mword2
IORDY=on/off, tPIO={min:120,w/IORDY:120}, PIO modes: mode3 mode4
UDMA modes: mode0 mode1 mode2 mode3 *mode4
/dev/hde:
multcount= 0 (off)
I/O support = 0 (default 16-bit)
unmaskirq= 0 (off)
using_dma= 1 (on)
keepsettings = 0 (off)
nowerr = 0 (off)
readonly = 0 (off)
readahead= 8 (on)
geometry = 59554/16/63, sectors = 60030432, start = 0
And here are the boot messaged corresponding to IDE and or RAID:
Uniform Multi-Platform E-IDE driver Revision: 6.30
ide: Assuming 40MHz system bus speed for PIO modes; override with
idebus=xx
PIIX4: IDE controller on PCI bus 00 dev 21
PIIX4: not 100% native mode: will probe irqs later
ide0: BM-DMA at 0xd800-0xd807, BIOS settings: hda:DMA, hdb:pio
ide1: BM-DMA at 0xd808-0xd80f, BIOS settings: hdc:DMA, hdd:pio
PDC20262: IDE controller on PCI bus 00 dev 50
PDC20262: not 100% native mode: will probe irqs later
PDC20262: (U)DMA Burst Bit ENABLED Primary PCI Mode Secondary PCI Mode.
ide2: BM-DMA at 0xa400-0xa407, BIOS settings: hde:DMA, hdf:pio
ide3: BM-DMA at 0xa408-0xa40f, BIOS settings: hdg:DMA, hdh:pio
hda: WDC AC420400D, ATA DISK drive
hdb: IOMEGA ZIP 100 ATAPI, ATAPI FLOPPY drive
hdc: LTN382, ATAPI CDROM drive
hde: Maxtor 53073U6, ATA DISK drive
hdg: Maxtor 53073U6, ATA DISK drive
ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
ide1 at 0x170-0x177,0x376 on irq 15
ide2 at 0xb800-0xb807,0xb402 on irq 3
ide3 at 0xb000-0xb007,0xa802 on irq 3
hda: WDC AC420400D, 19470MB w/1966kB Cache, CHS=39560/16/63, UDMA(33)
hde: Maxtor 53073U6, 29311MB w/2048kB Cache, CHS=59554/16/63, UDMA(66)
hdg: Maxtor 53073U6, 29311MB w/2048kB Cache, CHS=59554/16/63, UDMA(66)
hdc: ATAPI 40X CD-ROM drive, 120kB Cache, UDMA(33)
Uniform CD-ROM driver Revision: 3.07
hdb: 98304kB, 196608 blocks, 512 sector size,
hdb: 98304kB, 96/64/32 CHS, 4096 kBps, 512 sector size, 2941 rpm
Partition check:
hda: hda1 hda2 < hda5 hda6 hda7 hda8 >
hdb: hdb4
hde: hde1 hde2
hdg: hdg1 hdg2
Floppy drive(s): fd0 is 1.44M
FDC 0 is a post-1991 82077
md driver 0.90.0 MAX_MD_DEVS=256, MAX_REAL=12
raid0 personality registered
md.c: sizeof(mdp_super_t) = 4096
...
autorun ...
considering hdg2 ...
adding hdg2 ...
adding hde2 ...
created md0
bind
bind
running:
now!
hdg2's event counter: 0003
hde2's event counter: 0003
md0: max total readahead window set to 256k
md0: 2 data-disks, max readahead per data-disk: 128k
raid0: looking at hde2
raid0: comparing hde2(29883584) with hde2(29883584)
raid0: END
raid0: ==> UNIQUE
raid0: 1 zones
raid0: looking at hdg2
raid0: comparing hdg2(29883584) with hde2(29883584)
raid0: EQUAL
raid0: FINAL 1 zones
zone 0
checking hde2 ... contained as device 0
(29883584) is smallest!.
checking hdg2 ... contained as device 1
zone->nb_dev: 2, size: 59767168
current zone offset: 29883584
done.
raid0 : md_size is 59767168 blocks.
raid0 : conf->smallest->size is 59767168 blocks.
raid0 : nb_zone is 1.
raid0 : Allocating 8 bytes for hash.
md: updating md0 RAID superblock on device
hdg2 [events: 0004](write) hdg2's sb offset: 29883584
hde2 [events: 0004](write) hde2's sb offset: 29883584
.
... autorun DONE.
Thanks a bunch,
Scott
--
Scott M. Ransom Address: Harvard-Smithsonian CfA
Phone: (617) 495-4142 60 Garden St. MS 10
email: [EMAIL PROTECTED] Cambridge, MA 02138
PGP Fingerprint: D2 0E D0 10 CD 95 06 DA EF 78 FE 2B CB 3A D3 53
Re: RAID0: Fast writes, Slow reads...
I've got exactly the same problem on a Mylex hardware RAID- controller, writing is nearly twice as fast as reading. The drives are Barracuda 50Gb drives, the controller is a DAC1164P. I use the latest firmware, and latest drivers from dandelion.com. Kernel version is 2.2.14, distribution=Mandrake 7.0. Single PIII-600 on dual motherboard (Asus P2B-DS), 392 Mb RAM. Do you by any chance have problems with the entire system freezing after a while or during lots of activity? I've got that problem, though my firmware should be a fixed version. Kent R. Nilsen > Hello, > > I have just set up RAID0 with two 30G DiamondMax (Maxtor) ATA-66 > drives connected to a Promise Ultra66 controller. > > I am using raid 0.90 in kernel 2.3.51 on a dual PII-450 with 256M RAM. > > Here are the results from bonnie:
Re: RAID0: Fast writes, Slow reads...
Kent Nilsen wrote: > > Do you by any chance have problems with the entire system > freezing after a while or during lots of activity? Only freezes I have seen seem to be coming from Netscape occasionally hogging all available resources (I think). But I will look more carefully in the future... Scott -- Scott M. Ransom Address: Harvard-Smithsonian CfA Phone: (617) 495-4142 60 Garden St. MS 10 email: [EMAIL PROTECTED] Cambridge, MA 02138 PGP Fingerprint: D2 0E D0 10 CD 95 06 DA EF 78 FE 2B CB 3A D3 53
RAID0: Fast writes, Slow reads...
Hello,
I have just set up RAID0 with two 30G DiamondMax (Maxtor) ATA-66 drives
connected to a Promise Ultra66 controller.
I am using raid 0.90 in kernel 2.3.51 on a dual PII-450 with 256M RAM.
Here are the results from bonnie:
---Sequential Output ---Sequential Input-- --Random--
-Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---
MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU
1200 6813 98.2 41157 42.0 10101 25.9 5205 78.9 14890 27.3 137.8 1.8
Seems like my sequential block writes are 3 times faster than the
reads. Any idea why that would be?
Here are the results from hdparm on my drives (just showing one because
they are identical):
Model=Maxtor 53073U6, FwRev=DA620CQ0, SerialNo=K604F9AC
Config={ Fixed }
RawCHS=4092/16/63, TrkSize=0, SectSize=0, ECCbytes=57
BuffType=3(DualPortCache), BuffSize=2048kB, MaxMultSect=16,
MultSect=off
DblWordIO=no, OldPIO=2, DMA=yes, OldDMA=0
CurCHS=16383/16/63, CurSects=16514064, LBA=yes, LBAsects=60030432
tDMA={min:120,rec:120}, DMA modes: mword0 mword1 mword2
IORDY=on/off, tPIO={min:120,w/IORDY:120}, PIO modes: mode3 mode4
UDMA modes: mode0 mode1 mode2 mode3 *mode4
/dev/hde:
multcount= 0 (off)
I/O support = 0 (default 16-bit)
unmaskirq= 0 (off)
using_dma= 1 (on)
keepsettings = 0 (off)
nowerr = 0 (off)
readonly = 0 (off)
readahead= 8 (on)
geometry = 59554/16/63, sectors = 60030432, start = 0
And here are the boot messaged corresponding to IDE and or RAID:
Uniform Multi-Platform E-IDE driver Revision: 6.30
ide: Assuming 40MHz system bus speed for PIO modes; override with
idebus=xx
PIIX4: IDE controller on PCI bus 00 dev 21
PIIX4: not 100% native mode: will probe irqs later
ide0: BM-DMA at 0xd800-0xd807, BIOS settings: hda:DMA, hdb:pio
ide1: BM-DMA at 0xd808-0xd80f, BIOS settings: hdc:DMA, hdd:pio
PDC20262: IDE controller on PCI bus 00 dev 50
PDC20262: not 100% native mode: will probe irqs later
PDC20262: (U)DMA Burst Bit ENABLED Primary PCI Mode Secondary PCI Mode.
ide2: BM-DMA at 0xa400-0xa407, BIOS settings: hde:DMA, hdf:pio
ide3: BM-DMA at 0xa408-0xa40f, BIOS settings: hdg:DMA, hdh:pio
hda: WDC AC420400D, ATA DISK drive
hdb: IOMEGA ZIP 100 ATAPI, ATAPI FLOPPY drive
hdc: LTN382, ATAPI CDROM drive
hde: Maxtor 53073U6, ATA DISK drive
hdg: Maxtor 53073U6, ATA DISK drive
ide0 at 0x1f0-0x1f7,0x3f6 on irq 14
ide1 at 0x170-0x177,0x376 on irq 15
ide2 at 0xb800-0xb807,0xb402 on irq 3
ide3 at 0xb000-0xb007,0xa802 on irq 3
hda: WDC AC420400D, 19470MB w/1966kB Cache, CHS=39560/16/63, UDMA(33)
hde: Maxtor 53073U6, 29311MB w/2048kB Cache, CHS=59554/16/63, UDMA(66)
hdg: Maxtor 53073U6, 29311MB w/2048kB Cache, CHS=59554/16/63, UDMA(66)
hdc: ATAPI 40X CD-ROM drive, 120kB Cache, UDMA(33)
Uniform CD-ROM driver Revision: 3.07
hdb: 98304kB, 196608 blocks, 512 sector size,
hdb: 98304kB, 96/64/32 CHS, 4096 kBps, 512 sector size, 2941 rpm
Partition check:
hda: hda1 hda2 < hda5 hda6 hda7 hda8 >
hdb: hdb4
hde: hde1 hde2
hdg: hdg1 hdg2
Floppy drive(s): fd0 is 1.44M
FDC 0 is a post-1991 82077
md driver 0.90.0 MAX_MD_DEVS=256, MAX_REAL=12
raid0 personality registered
md.c: sizeof(mdp_super_t) = 4096
...
autorun ...
considering hdg2 ...
adding hdg2 ...
adding hde2 ...
created md0
bind
bind
running:
now!
hdg2's event counter: 0003
hde2's event counter: 0003
md0: max total readahead window set to 256k
md0: 2 data-disks, max readahead per data-disk: 128k
raid0: looking at hde2
raid0: comparing hde2(29883584) with hde2(29883584)
raid0: END
raid0: ==> UNIQUE
raid0: 1 zones
raid0: looking at hdg2
raid0: comparing hdg2(29883584) with hde2(29883584)
raid0: EQUAL
raid0: FINAL 1 zones
zone 0
checking hde2 ... contained as device 0
(29883584) is smallest!.
checking hdg2 ... contained as device 1
zone->nb_dev: 2, size: 59767168
current zone offset: 29883584
done.
raid0 : md_size is 59767168 blocks.
raid0 : conf->smallest->size is 59767168 blocks.
raid0 : nb_zone is 1.
raid0 : Allocating 8 bytes for hash.
md: updating md0 RAID superblock on device
hdg2 [events: 0004](write) hdg2's sb offset: 29883584
hde2 [events: 0004](write) hde2's sb offset: 29883584
.
... autorun DONE.
Thanks a bunch,
Scott
--
Scott M. Ransom Address: Harvard-Smithsonian CfA
Phone: (617) 495-4142 60 Garden St. MS 10
email: [EMAIL PROTECTED] Cambridge, MA 02138
PGP Fingerprint: D2 0E D0 10 CD 95 06 DA EF 78 FE 2B CB 3A D3 53
