Hi.
This time some RAID5/RAID-Z benchmarks.
This time I connected 3510 head unit with one link to the same server as 3510
JBODs are connected (using second link). snv_44 is used, server is v440.
I also tried changing max pending IO requests for HW raid5 lun and checked with
DTrace that larger value is really used - it is but it doesn't change benchmark
numbers.
1. ZFS on HW RAID5 with 6 disks, atime=off
IO Summary: 444386 ops 7341.7 ops/s, (1129/1130 r/w) 36.1mb/s, 297us
cpu/op, 6.6ms latency
IO Summary: 438649 ops 7247.0 ops/s, (1115/1115 r/w) 35.5mb/s, 293us
cpu/op, 6.7ms latency
2. ZFS with software RAID-Z with 6 disks, atime=off
IO Summary: 457505 ops 7567.3 ops/s, (1164/1164 r/w) 37.2mb/s, 340us
cpu/op, 6.4ms latency
IO Summary: 457767 ops 7567.8 ops/s, (1164/1165 r/w) 36.9mb/s, 340us
cpu/op, 6.4ms latency
3. UFS on HW RAID5 with 6 disks, noatime
IO Summary: 62776 ops 1037.3 ops/s, (160/160 r/w) 5.5mb/s, 481us
cpu/op, 49.7ms latency
IO Summary: 63661 ops 1051.6 ops/s, (162/162 r/w) 5.4mb/s, 477us
cpu/op, 49.1ms latency
4. UFS on HW RAID5 with 6 disks, noatime, S10U2 + patches (the same filesystem
mounted as in 3)
IO Summary: 393167 ops 6503.1 ops/s, (1000/1001 r/w) 32.4mb/s, 405us
cpu/op, 7.5ms latency
IO Summary: 394525 ops 6521.2 ops/s, (1003/1003 r/w) 32.0mb/s, 407us
cpu/op, 7.7ms latency
5. ZFS with software RAID-Z with 6 disks, atime=off, S10U2 + patches (the same
disks as in test #2)
IO Summary: 461708 ops 7635.5 ops/s, (1175/1175 r/w) 37.4mb/s, 330us
cpu/op, 6.4ms latency
IO Summary: 457649 ops 7562.1 ops/s, (1163/1164 r/w) 37.0mb/s, 328us
cpu/op, 6.5ms latency
In this benchmark software raid-5 with ZFS (raid-z to be precise) gives a
little bit better performance than hardware raid-5. ZFS is also faster in both
cases (HW ans SW raid) than UFS on HW raid.
Something is wrong with UFS on snv_44 - the same ufs filesystem on s10U2 works
as expected.
ZFS on S10U2 in this benchmark gives the same results as on snv_44.
#### details ####
// c2t43d0 is a HW raid5 made of 6 disks
// array is configured for random IO's
# zpool create HW_RAID5_6disks c2t43d0
#
# zpool create -f zfs_raid5_6disks raidz c3t16d0 c3t17d0 c3t18d0 c3t19d0
c3t20d0 c3t21d0
#
# zfs set atime=off zfs_raid5_6disks HW_RAID5_6disks
#
# zfs create HW_RAID5_6disks/t1
# zfs create zfs_raid5_6disks/t1
#
# /opt/filebench/bin/sparcv9/filebench
filebench> load varmail
450: 3.175: Varmail Version 1.24 2005/06/22 08:08:30 personality successfully
loaded
450: 3.199: Usage: set $dir=<dir>
450: 3.199: set $filesize=<size> defaults to 16384
450: 3.199: set $nfiles=<value> defaults to 1000
450: 3.199: set $nthreads=<value> defaults to 16
450: 3.199: set $meaniosize=<value> defaults to 16384
450: 3.199: set $meandirwidth=<size> defaults to 1000000
450: 3.199: (sets mean dir width and dir depth is calculated as log (width,
nfiles)
450: 3.199: dirdepth therefore defaults to dir depth of 1 as in postmark
450: 3.199: set $meandir lower to increase depth beyond 1 if desired)
450: 3.199:
450: 3.199: run runtime (e.g. run 60)
450: 3.199: syntax error, token expected on line 51
filebench> set $dir=/HW_RAID5_6disks/t1
filebench> run 60
450: 13.320: Fileset bigfileset: 1000 files, avg dir = 1000000.0, avg depth =
0.5, mbytes=15
450: 13.321: Creating fileset bigfileset...
450: 15.514: Preallocated 812 of 1000 of fileset bigfileset in 3 seconds
450: 15.515: Creating/pre-allocating files
450: 15.515: Starting 1 filereader instances
451: 16.525: Starting 16 filereaderthread threads
450: 19.535: Running...
450: 80.065: Run took 60 seconds...
450: 80.079: Per-Operation Breakdown
closefile4 565ops/s 0.0mb/s 0.0ms/op 8us/op-cpu
readfile4 565ops/s 9.2mb/s 0.1ms/op 60us/op-cpu
openfile4 565ops/s 0.0mb/s 0.1ms/op 64us/op-cpu
closefile3 565ops/s 0.0mb/s 0.0ms/op 11us/op-cpu
fsyncfile3 565ops/s 0.0mb/s 12.9ms/op 147us/op-cpu
appendfilerand3 565ops/s 8.8mb/s 0.1ms/op 126us/op-cpu
readfile3 565ops/s 9.2mb/s 0.1ms/op 60us/op-cpu
openfile3 565ops/s 0.0mb/s 0.1ms/op 63us/op-cpu
closefile2 565ops/s 0.0mb/s 0.0ms/op 11us/op-cpu
fsyncfile2 565ops/s 0.0mb/s 12.9ms/op 102us/op-cpu
appendfilerand2 565ops/s 8.8mb/s 0.1ms/op 92us/op-cpu
createfile2 565ops/s 0.0mb/s 0.2ms/op 154us/op-cpu
deletefile1 565ops/s 0.0mb/s 0.1ms/op 86us/op-cpu
450: 80.079:
IO Summary: 444386 ops 7341.7 ops/s, (1129/1130 r/w) 36.1mb/s, 297us
cpu/op, 6.6ms latency
450: 80.079: Shutting down processes
filebench> run 60
450: 115.945: Fileset bigfileset: 1000 files, avg dir = 1000000.0, avg depth
= 0.5, mbytes=15
450: 115.998: Removed any existing fileset bigfileset in 1 seconds
450: 115.998: Creating fileset bigfileset...
450: 118.049: Preallocated 786 of 1000 of fileset bigfileset in 3 seconds
450: 118.049: Creating/pre-allocating files
450: 118.049: Starting 1 filereader instances
454: 119.055: Starting 16 filereaderthread threads
450: 122.065: Running...
450: 182.595: Run took 60 seconds...
450: 182.608: Per-Operation Breakdown
closefile4 557ops/s 0.0mb/s 0.0ms/op 8us/op-cpu
readfile4 557ops/s 9.0mb/s 0.1ms/op 59us/op-cpu
openfile4 557ops/s 0.0mb/s 0.1ms/op 64us/op-cpu
closefile3 557ops/s 0.0mb/s 0.0ms/op 11us/op-cpu
fsyncfile3 557ops/s 0.0mb/s 13.0ms/op 149us/op-cpu
appendfilerand3 558ops/s 8.7mb/s 0.1ms/op 120us/op-cpu
readfile3 558ops/s 9.0mb/s 0.1ms/op 59us/op-cpu
openfile3 558ops/s 0.0mb/s 0.1ms/op 64us/op-cpu
closefile2 558ops/s 0.0mb/s 0.0ms/op 11us/op-cpu
fsyncfile2 558ops/s 0.0mb/s 13.2ms/op 100us/op-cpu
appendfilerand2 558ops/s 8.7mb/s 0.1ms/op 90us/op-cpu
createfile2 557ops/s 0.0mb/s 0.1ms/op 151us/op-cpu
deletefile1 557ops/s 0.0mb/s 0.1ms/op 86us/op-cpu
450: 182.609:
IO Summary: 438649 ops 7247.0 ops/s, (1115/1115 r/w) 35.5mb/s, 293us
cpu/op, 6.7ms latency
450: 182.609: Shutting down processes
filebench> quit
# /opt/filebench/bin/sparcv9/filebench
filebench> load varmail
458: 2.590: Varmail Version 1.24 2005/06/22 08:08:30 personality successfully
loaded
458: 2.591: Usage: set $dir=<dir>
458: 2.591: set $filesize=<size> defaults to 16384
458: 2.591: set $nfiles=<value> defaults to 1000
458: 2.591: set $nthreads=<value> defaults to 16
458: 2.591: set $meaniosize=<value> defaults to 16384
458: 2.591: set $meandirwidth=<size> defaults to 1000000
458: 2.591: (sets mean dir width and dir depth is calculated as log (width,
nfiles)
458: 2.591: dirdepth therefore defaults to dir depth of 1 as in postmark
458: 2.592: set $meandir lower to increase depth beyond 1 if desired)
458: 2.592:
458: 2.592: run runtime (e.g. run 60)
458: 2.592: syntax error, token expected on line 51
filebench> set $dir=/zfs_raid5_6disks/t1
filebench> run 60
458: 9.251: Fileset bigfileset: 1000 files, avg dir = 1000000.0, avg depth =
0.5, mbytes=15
458: 9.251: Creating fileset bigfileset...
458: 14.232: Preallocated 812 of 1000 of fileset bigfileset in 5 seconds
458: 14.232: Creating/pre-allocating files
458: 14.232: Starting 1 filereader instances
459: 15.235: Starting 16 filereaderthread threads
458: 18.245: Running...
458: 78.704: Run took 60 seconds...
458: 78.718: Per-Operation Breakdown
closefile4 582ops/s 0.0mb/s 0.0ms/op 8us/op-cpu
readfile4 582ops/s 9.6mb/s 0.1ms/op 62us/op-cpu
openfile4 582ops/s 0.0mb/s 0.1ms/op 67us/op-cpu
closefile3 582ops/s 0.0mb/s 0.0ms/op 11us/op-cpu
fsyncfile3 582ops/s 0.0mb/s 12.4ms/op 206us/op-cpu
appendfilerand3 582ops/s 9.1mb/s 0.1ms/op 125us/op-cpu
readfile3 582ops/s 9.5mb/s 0.1ms/op 61us/op-cpu
openfile3 582ops/s 0.0mb/s 0.1ms/op 66us/op-cpu
closefile2 582ops/s 0.0mb/s 0.0ms/op 11us/op-cpu
fsyncfile2 582ops/s 0.0mb/s 12.4ms/op 132us/op-cpu
appendfilerand2 582ops/s 9.1mb/s 0.1ms/op 94us/op-cpu
createfile2 582ops/s 0.0mb/s 0.2ms/op 160us/op-cpu
deletefile1 582ops/s 0.0mb/s 0.1ms/op 89us/op-cpu
458: 78.718:
IO Summary: 457505 ops 7567.3 ops/s, (1164/1164 r/w) 37.2mb/s, 340us
cpu/op, 6.4ms latency
458: 78.718: Shutting down processes
filebench> run 60
458: 98.396: Fileset bigfileset: 1000 files, avg dir = 1000000.0, avg depth =
0.5, mbytes=15
458: 98.449: Removed any existing fileset bigfileset in 1 seconds
458: 98.449: Creating fileset bigfileset...
458: 103.837: Preallocated 786 of 1000 of fileset bigfileset in 6 seconds
458: 103.837: Creating/pre-allocating files
458: 103.837: Starting 1 filereader instances
468: 104.845: Starting 16 filereaderthread threads
458: 107.854: Running...
458: 168.345: Run took 60 seconds...
458: 168.358: Per-Operation Breakdown
closefile4 582ops/s 0.0mb/s 0.0ms/op 8us/op-cpu
readfile4 582ops/s 9.4mb/s 0.1ms/op 61us/op-cpu
openfile4 582ops/s 0.0mb/s 0.1ms/op 66us/op-cpu
closefile3 582ops/s 0.0mb/s 0.0ms/op 11us/op-cpu
fsyncfile3 582ops/s 0.0mb/s 12.5ms/op 207us/op-cpu
appendfilerand3 582ops/s 9.1mb/s 0.1ms/op 124us/op-cpu
readfile3 582ops/s 9.4mb/s 0.1ms/op 61us/op-cpu
openfile3 582ops/s 0.0mb/s 0.1ms/op 66us/op-cpu
closefile2 582ops/s 0.0mb/s 0.0ms/op 11us/op-cpu
fsyncfile2 582ops/s 0.0mb/s 12.3ms/op 132us/op-cpu
appendfilerand2 582ops/s 9.1mb/s 0.1ms/op 94us/op-cpu
createfile2 582ops/s 0.0mb/s 0.2ms/op 156us/op-cpu
deletefile1 582ops/s 0.0mb/s 0.1ms/op 89us/op-cpu
458: 168.359:
IO Summary: 457767 ops 7567.8 ops/s, (1164/1165 r/w) 36.9mb/s, 340us
cpu/op, 6.4ms latency
458: 168.359: Shutting down processes
filebench>
# zpool destroy HW_RAID5_6disks
# newfs -C 20 /dev/rdsk/c2t43d0s0
newfs: construct a new file system /dev/rdsk/c2t43d0s0: (y/n)? y
Warning: 68 sector(s) in last cylinder unallocated
/dev/rdsk/c2t43d0s0: 714233788 sectors in 116249 cylinders of 48 tracks, 128
sectors
348747.0MB in 7266 cyl groups (16 c/g, 48.00MB/g, 5824 i/g)
super-block backups (for fsck -F ufs -o b=#) at:
32, 98464, 196896, 295328, 393760, 492192, 590624, 689056, 787488, 885920,
Initializing cylinder groups:
...............................................................................
..................................................................
super-block backups for last 10 cylinder groups at:
713296928, 713395360, 713493792, 713592224, 713690656, 713789088, 713887520,
713985952, 714084384, 714182816
#
# mount -o noatime /dev/dsk/c2t43d0s0 /mnt
#
# /opt/filebench/bin/sparcv9/filebench
filebench> load varmail
546: 2.573: Varmail Version 1.24 2005/06/22 08:08:30 personality successfully
loaded
546: 2.573: Usage: set $dir=<dir>
546: 2.573: set $filesize=<size> defaults to 16384
546: 2.573: set $nfiles=<value> defaults to 1000
546: 2.574: set $nthreads=<value> defaults to 16
546: 2.574: set $meaniosize=<value> defaults to 16384
546: 2.574: set $meandirwidth=<size> defaults to 1000000
546: 2.574: (sets mean dir width and dir depth is calculated as log (width,
nfiles)
546: 2.574: dirdepth therefore defaults to dir depth of 1 as in postmark
546: 2.574: set $meandir lower to increase depth beyond 1 if desired)
546: 2.574:
546: 2.574: run runtime (e.g. run 60)
546: 2.574: syntax error, token expected on line 51
filebench> set $dir=/mnt
filebench> run 60
546: 22.095: Fileset bigfileset: 1000 files, avg dir = 1000000.0, avg depth =
0.5, mbytes=15
546: 22.109: Creating fileset bigfileset...
546: 24.577: Preallocated 812 of 1000 of fileset bigfileset in 3 seconds
546: 24.577: Creating/pre-allocating files
546: 24.577: Starting 1 filereader instances
548: 25.584: Starting 16 filereaderthread threads
546: 28.594: Running...
546: 89.114: Run took 60 seconds...
546: 89.128: Per-Operation Breakdown
closefile4 80ops/s 0.0mb/s 0.0ms/op 8us/op-cpu
readfile4 80ops/s 1.5mb/s 0.1ms/op 76us/op-cpu
openfile4 80ops/s 0.0mb/s 0.0ms/op 39us/op-cpu
closefile3 80ops/s 0.0mb/s 0.0ms/op 12us/op-cpu
fsyncfile3 80ops/s 0.0mb/s 29.2ms/op 107us/op-cpu
appendfilerand3 80ops/s 1.2mb/s 30.4ms/op 189us/op-cpu
readfile3 80ops/s 1.5mb/s 0.1ms/op 73us/op-cpu
openfile3 80ops/s 0.0mb/s 0.0ms/op 38us/op-cpu
closefile2 80ops/s 0.0mb/s 0.0ms/op 12us/op-cpu
fsyncfile2 80ops/s 0.0mb/s 30.8ms/op 125us/op-cpu
appendfilerand2 80ops/s 1.2mb/s 22.6ms/op 173us/op-cpu
createfile2 80ops/s 0.0mb/s 37.2ms/op 224us/op-cpu
deletefile1 80ops/s 0.0mb/s 48.5ms/op 108us/op-cpu
546: 89.128:
IO Summary: 62776 ops 1037.3 ops/s, (160/160 r/w) 5.5mb/s, 481us
cpu/op, 49.7ms latency
546: 89.128: Shutting down processes
filebench> run 60
546: 738.541: Fileset bigfileset: 1000 files, avg dir = 1000000.0, avg depth
= 0.5, mbytes=15
546: 739.455: Removed any existing fileset bigfileset in 1 seconds
546: 739.455: Creating fileset bigfileset...
546: 741.387: Preallocated 786 of 1000 of fileset bigfileset in 2 seconds
546: 741.387: Creating/pre-allocating files
546: 741.387: Starting 1 filereader instances
557: 742.394: Starting 16 filereaderthread threads
546: 745.404: Running...
546: 805.944: Run took 60 seconds...
546: 805.958: Per-Operation Breakdown
closefile4 81ops/s 0.0mb/s 0.0ms/op 8us/op-cpu
readfile4 81ops/s 1.5mb/s 0.1ms/op 73us/op-cpu
openfile4 81ops/s 0.0mb/s 0.0ms/op 38us/op-cpu
closefile3 81ops/s 0.0mb/s 0.0ms/op 11us/op-cpu
fsyncfile3 81ops/s 0.0mb/s 27.8ms/op 105us/op-cpu
appendfilerand3 81ops/s 1.3mb/s 28.6ms/op 187us/op-cpu
readfile3 81ops/s 1.4mb/s 0.1ms/op 70us/op-cpu
openfile3 81ops/s 0.0mb/s 0.0ms/op 37us/op-cpu
closefile2 81ops/s 0.0mb/s 0.0ms/op 12us/op-cpu
fsyncfile2 81ops/s 0.0mb/s 29.9ms/op 124us/op-cpu
appendfilerand2 81ops/s 1.3mb/s 23.6ms/op 171us/op-cpu
createfile2 81ops/s 0.0mb/s 38.9ms/op 220us/op-cpu
deletefile1 81ops/s 0.0mb/s 47.4ms/op 109us/op-cpu
546: 805.958:
IO Summary: 63661 ops 1051.6 ops/s, (162/162 r/w) 5.4mb/s, 477us
cpu/op, 49.1ms latency
546: 805.958: Shutting down processes
filebench>
#### solaris 10 06/06 + patches, server with the same hardware specs #####
##### test # 4
# mount -o noatime /dev/dsk/c3t40d0s0 /mnt
# /opt/filebench/bin/sparcv9/filebench
filebench> load varmail
1384: 3.678: Varmail Version 1.24 2005/06/22 08:08:30 personality successfully
loaded
1384: 3.679: Usage: set $dir=<dir>
1384: 3.679: set $filesize=<size> defaults to 16384
1384: 3.679: set $nfiles=<value> defaults to 1000
1384: 3.679: set $nthreads=<value> defaults to 16
1384: 3.679: set $meaniosize=<value> defaults to 16384
1384: 3.679: set $meandirwidth=<size> defaults to 1000000
1384: 3.679: (sets mean dir width and dir depth is calculated as log (width,
nfiles)
1384: 3.679: dirdepth therefore defaults to dir depth of 1 as in postmark
1384: 3.679: set $meandir lower to increase depth beyond 1 if desired)
1384: 3.680:
1384: 3.680: run runtime (e.g. run 60)
1384: 3.680: syntax error, token expected on line 51
filebench> set $dir=/mnt
filebench> run 60
1384: 10.872: Fileset bigfileset: 1000 files, avg dir = 1000000.0, avg depth =
0.5, mbytes=15
1384: 11.858: Removed any existing fileset bigfileset in 1 seconds
1384: 11.859: Creating fileset bigfileset...
1384: 14.221: Preallocated 812 of 1000 of fileset bigfileset in 3 seconds
1384: 14.221: Creating/pre-allocating files
1384: 14.221: Starting 1 filereader instances
1387: 15.231: Starting 16 filereaderthread threads
1384: 18.241: Running...
1384: 78.701: Run took 60 seconds...
1384: 78.715: Per-Operation Breakdown
closefile4 500ops/s 0.0mb/s 0.0ms/op 8us/op-cpu
readfile4 500ops/s 8.4mb/s 0.1ms/op 65us/op-cpu
openfile4 500ops/s 0.0mb/s 0.0ms/op 36us/op-cpu
closefile3 500ops/s 0.0mb/s 0.0ms/op 12us/op-cpu
fsyncfile3 500ops/s 0.0mb/s 9.7ms/op 169us/op-cpu
appendfilerand3 500ops/s 7.8mb/s 2.6ms/op 187us/op-cpu
readfile3 500ops/s 8.3mb/s 0.1ms/op 64us/op-cpu
openfile3 500ops/s 0.0mb/s 0.0ms/op 36us/op-cpu
closefile2 500ops/s 0.0mb/s 0.0ms/op 12us/op-cpu
fsyncfile2 500ops/s 0.0mb/s 8.4ms/op 154us/op-cpu
appendfilerand2 500ops/s 7.8mb/s 1.7ms/op 168us/op-cpu
createfile2 500ops/s 0.0mb/s 4.3ms/op 298us/op-cpu
deletefile1 500ops/s 0.0mb/s 3.2ms/op 144us/op-cpu
1384: 78.715:
IO Summary: 393167 ops 6503.1 ops/s, (1000/1001 r/w) 32.4mb/s, 405us
cpu/op, 7.5ms latency
1384: 78.715: Shutting down processes
filebench> run 60
1384: 94.146: Fileset bigfileset: 1000 files, avg dir = 1000000.0, avg depth =
0.5, mbytes=15
1384: 95.767: Removed any existing fileset bigfileset in 2 seconds
1384: 95.768: Creating fileset bigfileset...
1384: 97.972: Preallocated 786 of 1000 of fileset bigfileset in 3 seconds
1384: 97.973: Creating/pre-allocating files
1384: 97.973: Starting 1 filereader instances
1393: 98.981: Starting 16 filereaderthread threads
1384: 101.991: Running...
1384: 162.491: Run took 60 seconds...
1384: 162.505: Per-Operation Breakdown
closefile4 502ops/s 0.0mb/s 0.0ms/op 8us/op-cpu
readfile4 502ops/s 8.1mb/s 0.1ms/op 64us/op-cpu
openfile4 502ops/s 0.0mb/s 0.0ms/op 37us/op-cpu
closefile3 502ops/s 0.0mb/s 0.0ms/op 12us/op-cpu
fsyncfile3 502ops/s 0.0mb/s 9.9ms/op 172us/op-cpu
appendfilerand3 502ops/s 7.8mb/s 2.7ms/op 189us/op-cpu
readfile3 502ops/s 8.2mb/s 0.1ms/op 65us/op-cpu
openfile3 502ops/s 0.0mb/s 0.0ms/op 37us/op-cpu
closefile2 502ops/s 0.0mb/s 0.0ms/op 12us/op-cpu
fsyncfile2 502ops/s 0.0mb/s 8.6ms/op 156us/op-cpu
appendfilerand2 502ops/s 7.8mb/s 1.7ms/op 166us/op-cpu
createfile2 502ops/s 0.0mb/s 4.4ms/op 301us/op-cpu
deletefile1 502ops/s 0.0mb/s 3.2ms/op 148us/op-cpu
1384: 162.506:
IO Summary: 394525 ops 6521.2 ops/s, (1003/1003 r/w) 32.0mb/s, 407us
cpu/op, 7.7ms latency
1384: 162.506: Shutting down processes
filebench>
#### test 5
#### these are the same disks as used in test #2
# zpool create zfs_raid5_6disks raidz c2t16d0 c2t17d0 c2t18d0 c2t19d0 c2t20d0
c2t21d0
# zfs set atime=off zfs_raid5_6disks
# zfs create zfs_raid5_6disks/t1
#
# /opt/filebench/bin/sparcv9/filebench
filebench> load varmail
1437: 3.762: Varmail Version 1.24 2005/06/22 08:08:30 personality successfully
loaded
1437: 3.762: Usage: set $dir=<dir>
1437: 3.762: set $filesize=<size> defaults to 16384
1437: 3.762: set $nfiles=<value> defaults to 1000
1437: 3.763: set $nthreads=<value> defaults to 16
1437: 3.763: set $meaniosize=<value> defaults to 16384
1437: 3.763: set $meandirwidth=<size> defaults to 1000000
1437: 3.763: (sets mean dir width and dir depth is calculated as log (width,
nfiles)
1437: 3.763: dirdepth therefore defaults to dir depth of 1 as in postmark
1437: 3.763: set $meandir lower to increase depth beyond 1 if desired)
1437: 3.763:
1437: 3.763: run runtime (e.g. run 60)
1437: 3.763: syntax error, token expected on line 51
filebench> set $dir=/zfs_raid5_6disks/t1
filebench> run 60
1437: 13.102: Fileset bigfileset: 1000 files, avg dir = 1000000.0, avg depth =
0.5, mbytes=15
1437: 13.102: Creating fileset bigfileset...
1437: 20.092: Preallocated 812 of 1000 of fileset bigfileset in 7 seconds
1437: 20.092: Creating/pre-allocating files
1437: 20.092: Starting 1 filereader instances
1438: 21.095: Starting 16 filereaderthread threads
1437: 24.105: Running...
1437: 84.575: Run took 60 seconds...
1437: 84.589: Per-Operation Breakdown
closefile4 587ops/s 0.0mb/s 0.0ms/op 9us/op-cpu
readfile4 587ops/s 9.5mb/s 0.1ms/op 63us/op-cpu
openfile4 587ops/s 0.0mb/s 0.1ms/op 63us/op-cpu
closefile3 587ops/s 0.0mb/s 0.0ms/op 11us/op-cpu
fsyncfile3 587ops/s 0.0mb/s 12.1ms/op 196us/op-cpu
appendfilerand3 587ops/s 9.2mb/s 0.1ms/op 123us/op-cpu
readfile3 587ops/s 9.5mb/s 0.1ms/op 64us/op-cpu
openfile3 587ops/s 0.0mb/s 0.1ms/op 63us/op-cpu
closefile2 587ops/s 0.0mb/s 0.0ms/op 11us/op-cpu
fsyncfile2 587ops/s 0.0mb/s 12.6ms/op 145us/op-cpu
appendfilerand2 588ops/s 9.2mb/s 0.1ms/op 93us/op-cpu
createfile2 587ops/s 0.0mb/s 0.2ms/op 166us/op-cpu
deletefile1 587ops/s 0.0mb/s 0.1ms/op 90us/op-cpu
1437: 84.589:
IO Summary: 461708 ops 7635.5 ops/s, (1175/1175 r/w) 37.4mb/s, 330us
cpu/op, 6.4ms latency
1437: 84.589: Shutting down processes
filebench> run 60
1437: 136.114: Fileset bigfileset: 1000 files, avg dir = 1000000.0, avg depth
= 0.5, mbytes=15
1437: 136.171: Removed any existing fileset bigfileset in 1 seconds
1437: 136.172: Creating fileset bigfileset...
1437: 141.880: Preallocated 786 of 1000 of fileset bigfileset in 6 seconds
1437: 141.880: Creating/pre-allocating files
1437: 141.880: Starting 1 filereader instances
1441: 142.885: Starting 16 filereaderthread threads
1437: 145.895: Running...
1437: 206.415: Run took 60 seconds...
1437: 206.429: Per-Operation Breakdown
closefile4 582ops/s 0.0mb/s 0.0ms/op 8us/op-cpu
readfile4 582ops/s 9.4mb/s 0.1ms/op 63us/op-cpu
openfile4 582ops/s 0.0mb/s 0.1ms/op 62us/op-cpu
closefile3 582ops/s 0.0mb/s 0.0ms/op 11us/op-cpu
fsyncfile3 582ops/s 0.0mb/s 12.2ms/op 202us/op-cpu
appendfilerand3 582ops/s 9.1mb/s 0.1ms/op 122us/op-cpu
readfile3 582ops/s 9.4mb/s 0.1ms/op 64us/op-cpu
openfile3 582ops/s 0.0mb/s 0.1ms/op 62us/op-cpu
closefile2 582ops/s 0.0mb/s 0.0ms/op 11us/op-cpu
fsyncfile2 582ops/s 0.0mb/s 12.9ms/op 141us/op-cpu
appendfilerand2 582ops/s 9.1mb/s 0.1ms/op 91us/op-cpu
createfile2 582ops/s 0.0mb/s 0.2ms/op 157us/op-cpu
deletefile1 582ops/s 0.0mb/s 0.1ms/op 89us/op-cpu
1437: 206.429:
IO Summary: 457649 ops 7562.1 ops/s, (1163/1164 r/w) 37.0mb/s, 328us
cpu/op, 6.5ms latency
1437: 206.429: Shutting down processes
filebench>
This message posted from opensolaris.org
_______________________________________________
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
