On 24/06/2010 15:54, Bob Friesenhahn wrote:
On Thu, 24 Jun 2010, Ross Walker wrote:

Raidz is definitely made for sequential IO patterns not random. To get good random IO with raidz you need a zpool with X raidz vdevs where X = desired IOPS/IOPS of single drive.

Remarkably, I have yet to see mention of someone testing a raidz which is comprised entirely of FLASH SSDs. This should help with the IOPS, particularly when reading.

I have.

Briefly:


  X4270 2x Quad-core 2.93GHz, 72GB RAM
  Open Solaris 2009.06 (snv_111b)
  ARC limited to 4GB
  44x SSD in a F5100.
4x SAS HBAs, 4x physical SAS connections to the f5100 (16x SAS channels in total), each to a different domain.


1. RAID-10 pool

    22x mirrors across domains
    ZFS: 16KB recordsize, atime=off
randomread filebennch benchmark with a 16KB block size with 1, 16, ..., 128 threads, 128GB working set.

    maximum performance when 128 threads: ~137,000 ops/s

2. RAID-Z pool

    11x 4-way RAID-z, each raid-z vdev across domains
    ZFS: recordsize=16k, atime=off
randomread filebennch benchmark with a 16KB block size with 1, 16, ..., 128 threads, 128GB working set.

    maximum performance when 64-128 threads: ~34,000 ops/s

    With a ZFS recordsize of 32KB it got up-to ~41,000 ops/s.
    Larger ZFS record sizes produced worse results.



RAID-Z delivered about 3.3X less ops/s compared to RAID-10 here.
SSDs do not make any fundamental chanage here and RAID-Z characteristics are basically the same whether it is configured out of SSDs or HDDs.

However SSDs could of course provide a good-enough performance even with RAID-Z, as at the end of a day it is not about benchmarks but your environment requirements.

A given number of SSDs in a RAID-Z configuration is able to deliver the same performance as a much greater number of disk drives in RAID-10 configuration and if you don't need much space it could make sense.


--
Robert Milkowski
http://milek.blogspot.com

_______________________________________________
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

Reply via email to