Re: [zfs-discuss] ZFS Dedup Performance

2010-03-24 Thread Miles Nordin
srbi == Steve Radich, BitShop, Inc ste...@bitshop.com writes: srbi http://www.bitshop.com/Blogs/tabid/95/EntryId/78/Bug-in-OpenSolaris-SMB-Server-causes-slow-disk-i-o-always.aspx I'm having trouble understanding many things in here like ``our file move'' (moving what from where to where with

Re: [zfs-discuss] ZFS Dedup Performance

2010-03-23 Thread Steve Radich, BitShop, Inc.
http://www.bitshop.com/Blogs/tabid/95/EntryId/78/Bug-in-OpenSolaris-SMB-Server-causes-slow-disk-i-o-always.aspx This explains just how major of a bug this issue is IMHO - The SMB slowdown from Windows 2003 is doing something odd in the Kernel I think now from the symptoms - See the tests for

Re: [zfs-discuss] ZFS Dedup Performance

2010-01-22 Thread Steve Radich, BitShop, Inc.
We're having to split data to multiple pools if we enable dedup, 1+ TB pools each (one 6x750gb is particularly bad). The timeouts cause COMSTAR / iSCSI to fail, Windows clients are dropping the persistent targets due to timeouts ( 15 seconds it seems). This is causing bigger problems.

Re: [zfs-discuss] ZFS Dedup Performance

2010-01-22 Thread Steve Radich, BitShop, Inc.
I should note that trying zfs set primarycache=metadata tank1 took a few minutes. Seems changing what is cached in ram would be instant (we don't need to flush out from ram the data, just don't put it back in ram again). During this disk i/o seemed slow, could have been unrelated. -- This

[zfs-discuss] ZFS Dedup Performance

2010-01-08 Thread James Lee
I haven't seen much discussion on how deduplication affects performance. I've enabled dudup on my 4-disk raidz array and have seen a significant drop in write throughput, from about 100 MB/s to 3 MB/s. I can't imagine such a decrease is normal. # zpool iostat nest 1 (with dedup enabled): ...

Re: [zfs-discuss] ZFS Dedup Performance

2010-01-08 Thread Ray Van Dolson
On Fri, Jan 08, 2010 at 10:00:14AM -0800, James Lee wrote: I haven't seen much discussion on how deduplication affects performance. I've enabled dudup on my 4-disk raidz array and have seen a significant drop in write throughput, from about 100 MB/s to 3 MB/s. I can't imagine such a decrease

Re: [zfs-discuss] ZFS Dedup Performance

2010-01-08 Thread Lutz Schumann
See the reads on the pool with the low I/O ? I suspect reading the DDT causes the writes to slow down. See this bug http://bugs.opensolaris.org/bugdatabase/view_bug.do?bug_id=6913566. It seems to give some backgrounds. Can you test setting the primarycache=metadata on the volume you test ?

Re: [zfs-discuss] ZFS Dedup Performance

2010-01-08 Thread Ian Collins
James Lee wrote: I haven't seen much discussion on how deduplication affects performance. I've enabled dudup on my 4-disk raidz array and have seen a significant drop in write throughput, from about 100 MB/s to 3 MB/s. I can't imagine such a decrease is normal. What is you data? I've

Re: [zfs-discuss] ZFS Dedup Performance

2010-01-08 Thread James Dickens
On Fri, Jan 8, 2010 at 1:44 PM, Ian Collins i...@ianshome.com wrote: James Lee wrote: I haven't seen much discussion on how deduplication affects performance. I've enabled dudup on my 4-disk raidz array and have seen a significant drop in write throughput, from about 100 MB/s to 3 MB/s. I

Re: [zfs-discuss] ZFS Dedup Performance

2010-01-08 Thread James Lee
On 01/08/2010 02:42 PM, Lutz Schumann wrote: See the reads on the pool with the low I/O ? I suspect reading the DDT causes the writes to slow down. See this bug http://bugs.opensolaris.org/bugdatabase/view_bug.do?bug_id=6913566. It seems to give some backgrounds. Can you test setting the