Re: [zfs-discuss] Z-Raid performance with Random reads/writes

2007-06-21 Thread Mario Goebbels
Because you have to read the entire stripe (which probably spans all the disks) to verify the checksum. Then I have a wrong idea of what a stripe is. I always thought it's the interleave block size. -mg signature.asc Description: This is a digitally signed message part

Re: [zfs-discuss] Z-Raid performance with Random reads/writes

2007-06-21 Thread Roch Bourbonnais
Le 20 juin 07 à 04:59, Ian Collins a écrit : I'm not sure why, but when I was testing various configurations with bonnie++, 3 pairs of mirrors did give about 3x the random read performance of a 6 disk raidz, but with 4 pairs, the random read performance dropped by 50%: 3x2 Blockread:

Re: [zfs-discuss] Z-Raid performance with Random reads/writes

2007-06-21 Thread Richard Elling
Mario Goebbels wrote: Because you have to read the entire stripe (which probably spans all the disks) to verify the checksum. Then I have a wrong idea of what a stripe is. I always thought it's the interleave block size. Nope. A stripe generally refers to the logical block as spread across

Re: [zfs-discuss] Z-Raid performance with Random reads/writes

2007-06-21 Thread Ian Collins
Roch Bourbonnais wrote: Le 20 juin 07 à 04:59, Ian Collins a écrit : I'm not sure why, but when I was testing various configurations with bonnie++, 3 pairs of mirrors did give about 3x the random read performance of a 6 disk raidz, but with 4 pairs, the random read performance dropped by

Re: [zfs-discuss] Z-Raid performance with Random reads/writes

2007-06-20 Thread Mario Goebbels
A 6 disk raidz set is not optimal for random reads, since each disk in the raidz set needs to be accessed to retrieve each item. I don't understand, if the file is contained within a single stripe, why would it need to access the other disks, if the checksum of the stripe is OK? Also, why

Re: [zfs-discuss] Z-Raid performance with Random reads/writes

2007-06-20 Thread Ian Collins
Mario Goebbels wrote: A 6 disk raidz set is not optimal for random reads, since each disk in the raidz set needs to be accessed to retrieve each item. I don't understand, if the file is contained within a single stripe, why would it need to access the other disks, if the checksum of

Re: [zfs-discuss] Z-Raid performance with Random reads/writes

2007-06-19 Thread Richard Elling
michael T sedwick wrote: Given a 1.6TB ZFS Z-Raid consisting 6 disks: And a system that does an extreme amount of small /(20K) /random reads /(more than twice as many reads as writes) / 1) What performance gains, if any does Z-Raid offer over other RAID or Large filesystem configurations?

Re: [zfs-discuss] Z-Raid performance with Random reads/writes

2007-06-19 Thread Bart Smaalders
michael T sedwick wrote: Given a 1.6TB ZFS Z-Raid consisting 6 disks: And a system that does an extreme amount of small /(20K) /random reads /(more than twice as many reads as writes) / 1) What performance gains, if any does Z-Raid offer over other RAID or Large filesystem configurations?

Re: [zfs-discuss] Z-Raid performance with Random reads/writes

2007-06-19 Thread Ian Collins
Bart Smaalders wrote: michael T sedwick wrote: Given a 1.6TB ZFS Z-Raid consisting 6 disks: And a system that does an extreme amount of small /(20K) /random reads /(more than twice as many reads as writes) / 1) What performance gains, if any does Z-Raid offer over other RAID or Large

Re: [zfs-discuss] Z-Raid performance with Random reads/writes

2007-06-19 Thread Bart Smaalders
Ian Collins wrote: Bart Smaalders wrote: michael T sedwick wrote: Given a 1.6TB ZFS Z-Raid consisting 6 disks: And a system that does an extreme amount of small /(20K) /random reads /(more than twice as many reads as writes) / 1) What performance gains, if any does Z-Raid offer over other

Re: [zfs-discuss] Z-Raid performance with Random reads/writes

2007-06-19 Thread Matthew Ahrens
Bart Smaalders wrote: Ian Collins wrote: Bart Smaalders wrote: A 6 disk raidz set is not optimal for random reads, since each disk in the raidz set needs to be accessed to retrieve each item. Note that if the reads are single threaded, this doesn't apply. However, if multiple reads are

Re: [zfs-discuss] Z-Raid performance with Random reads/writes

2007-06-19 Thread michael T sedwick
OK... Is all this 3x; 6x potential performance boost still going to hold true in a Single Controller scenario? Hardware is x4100's (Solaris 10) w/ 6-disk raidz on external 3320's? I seem to remember /(wait... checking Notes...) / correct... the ZFS filesystem is 50% capacity. This info