Re: [zfs-discuss] ZFS Random Read Performance

2009-11-25 Thread Richard Elling
more below... On Nov 25, 2009, at 7:10 AM, Paul Kraus wrote: I posted baseline stats at http://www.ilk.org/~ppk/Geek/ baseline test was 1 thread, 3 GiB file, 64KiB to 512 KiB record size 480-3511-baseline.xls is an iozone output file iostat-baseline.txt is the iostat output for the device in

Re: [zfs-discuss] ZFS Random Read Performance

2009-11-25 Thread Richard Elling
more below... On Nov 25, 2009, at 5:54 AM, Paul Kraus wrote: Richard, First, thank you for the detailed reply ... (comments in line below) On Tue, Nov 24, 2009 at 6:31 PM, Richard Elling wrote: more below... On Nov 24, 2009, at 9:29 AM, Paul Kraus wrote: On Tue, Nov 24, 2009 at

Re: [zfs-discuss] ZFS Random Read Performance

2009-11-25 Thread Mike Gerdts
On Wed, Nov 25, 2009 at 7:54 AM, Paul Kraus wrote: >> You're peaking at 658 256KB random IOPS for the 3511, or ~66 >> IOPS per drive.  Since ZFS will max out at 128KB per I/O, the disks >> see something more than 66 IOPS each.  The IOPS data from >> iostat would be a better metric to observe than

Re: [zfs-discuss] ZFS Random Read Performance

2009-11-25 Thread William D. Hathaway
If you are using (3) 3511's, then won't it be possibly that your 3GB workload will be largely or entirely served out of RAID controller cache? Also, I had a question for your production backups (millions of small files), do you have atime=off set for the filesystems? That might be helpful. --

Re: [zfs-discuss] ZFS Random Read Performance

2009-11-25 Thread Paul Kraus
I posted baseline stats at http://www.ilk.org/~ppk/Geek/ baseline test was 1 thread, 3 GiB file, 64KiB to 512 KiB record size 480-3511-baseline.xls is an iozone output file iostat-baseline.txt is the iostat output for the device in use (annotated) I also noted an odd behavior yesterady and have

Re: [zfs-discuss] ZFS Random Read Performance

2009-11-25 Thread Paul Kraus
Richard, First, thank you for the detailed reply ... (comments in line below) On Tue, Nov 24, 2009 at 6:31 PM, Richard Elling wrote: > more below... > > On Nov 24, 2009, at 9:29 AM, Paul Kraus wrote: > >> On Tue, Nov 24, 2009 at 11:03 AM, Richard Elling >> wrote: >> >>> Try disabling pre

Re: [zfs-discuss] ZFS Random Read Performance

2009-11-24 Thread Richard Elling
more below... On Nov 24, 2009, at 9:29 AM, Paul Kraus wrote: On Tue, Nov 24, 2009 at 11:03 AM, Richard Elling wrote: Try disabling prefetch. Just tried it... no change in random read (still 17-18 MB/sec for a single thread), but sequential read performance dropped from about 200 MB/sec. to

Re: [zfs-discuss] ZFS Random Read Performance

2009-11-24 Thread Bob Friesenhahn
On Tue, 24 Nov 2009, Paul Kraus wrote: On Tue, Nov 24, 2009 at 11:03 AM, Richard Elling wrote: Try disabling prefetch. Just tried it... no change in random read (still 17-18 MB/sec for a single thread), but sequential read performance dropped from about 200 MB/sec. to 100 MB/sec. (as expect

Re: [zfs-discuss] ZFS Random Read Performance

2009-11-24 Thread Paul Kraus
On Tue, Nov 24, 2009 at 11:03 AM, Richard Elling wrote: > Try disabling prefetch. Just tried it... no change in random read (still 17-18 MB/sec for a single thread), but sequential read performance dropped from about 200 MB/sec. to 100 MB/sec. (as expected). Test case is a 3 GB file accessed in

Re: [zfs-discuss] ZFS Random Read Performance

2009-11-24 Thread Richard Elling
Try disabling prefetch. -- richard On Nov 24, 2009, at 6:45 AM, Paul Kraus wrote: I know there have been a bunch of discussion of various ZFS performance issues, but I did not see anything specifically on this. In testing a new configuration of an SE-3511 (SATA) array, I ran into an int

[zfs-discuss] ZFS Random Read Performance

2009-11-24 Thread Paul Kraus
I know there have been a bunch of discussion of various ZFS performance issues, but I did not see anything specifically on this. In testing a new configuration of an SE-3511 (SATA) array, I ran into an interesting ZFS performance issue. I do not believe that this is creating a major issue f