Ross Becker wrote: > Well, I just got in a system I am intending to be a BIG fileserver; > background- I work for a SAN startup, and we're expecting in our first > year to collect 30-60 terabytes of Fibre Channel traces. The purpose of > this is to be a large repository for those traces w/ statistical analysis > run against them. Looking at that storage figure, I decided this would > be a perfect application for ZFS. I purchased a Super Micro chassis > that's 4u and has 24 slots for SATA drives. I've put one quad-core 2.66 > ghz processor in & 8gig of ECC ram. I put in two Areca 1231ML ( > http://www.areca.com.tw/products/pcie341.htm ) controllers which come > with Solaris drivers. I've half-populated the chassis with 12 1Tb > drives to begin with, and I'm running some experiments. I loaded > OpenSolaris 05-2008 on the system. > > I configured up an 11 drive RAID6 set + 1 hot spare on the Areca > controller put a ZFS on that raid volume, and ran bonnie++ against it > (16g size), and achieved 150 mb/s write, & 200 mb/s read. I then blew > that away, configured the Areca to present JBOD, and configured ZFS with > RAIDZ2 11 disks, and a hot spare. Running bonnie++ against that, it > achieved 40 mb/sec read and 40 mb/sec write. I wasn't expecting RAIDZ to > outrun the controller-based RAID, but I wasn't expecting 1/3rd to 1/4 the > performance. I've looked at the ZFS tuning info on the solaris site, and > mostly what they said is "tuning is evil", with a few things for Database > tuning. > > Anyone got suggestions on whether there's something I might poke at to at > least get this puppy up closer to 100 mb/sec? Otherwise, I may dump the > JBOD and go back to the controller-based RAID.
While running pre-integration testing of arcmsr(7d), I noticed that random IO was pretty terrible. My results matched what I saw in benchmark PDFs from http://www.areca.com.tw/support/main.htm (bottom of page), but I'd still like to improve the results. Were you doing more random or more sequential IO? The source is here: http://src.opensolaris.org/source/xref/onnv/onnv-gate/usr/src/uts/intel/io/scsi/adapters/arcmsr ... and I'm keen to talk with you in detail about the issues you're seeing with arcmsr too. James C. McPherson -- Senior Kernel Software Engineer, Solaris Sun Microsystems http://blogs.sun.com/jmcp http://www.jmcp.homeunix.com/blog _______________________________________________ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
