Re: [zfs-discuss] $100 SSD = >5x faster dedupe

2010-01-08 Thread marty scholes
--- On Thu, 1/7/10, Tiernan OToole wrote: > Sorry to hijack the thread, but can you > explain your setup? Sounds interesting, but need more > info... This is just a home setup to amuse me and placate my three boys, each of whom has several Windows instances running under Virtualbox. Server is a

Re: [zfs-discuss] $100 SSD = >5x faster dedupe

2010-01-07 Thread Tiernan OToole
Sorry to hijack the thread, but can you explain your setup? Sounds interesting, but need more info... Thanks! --Tiernan On Jan 7, 2010 11:56 PM, "Marty Scholes" wrote: Ian wrote: > Why did you set dedup=verify on the USB pool? Because that is my last-ditch copy of the data and MUST be correct.

Re: [zfs-discuss] $100 SSD = >5x faster dedupe

2010-01-07 Thread Marty Scholes
Ian wrote: > Why did you set dedup=verify on the USB pool? Because that is my last-ditch copy of the data and MUST be correct. At the same time, I want to cram as much data as possible into the pool. If I ever go to the USB pool, something has already gone horribly wrong and I am desperate. I

Re: [zfs-discuss] $100 SSD = >5x faster dedupe

2010-01-07 Thread Ian Collins
Marty Scholes wrote: I did something similar, but with a SCSI drive. I keep a large external USB drive as a "last ditch" recovery pool which is synchronized hourly from the main pool. Kind of like a poor man's tape backup. When I enabled dedup=verify on the USB pool, the sync performance we

Re: [zfs-discuss] $100 SSD = >5x faster dedupe

2010-01-06 Thread Marty Scholes
Michael Herf wrote: > I've written about my slow-to-dedupe RAIDZ. > > After a week of.waitingI finally bought a > little $100 30G OCZ > Vertex and plugged it in as a cache. > > After <2 hours of warmup, my zfs send/receive rate on > the pool is > >16MB/sec (reading and writing each at 16M

Re: [zfs-discuss] $100 SSD = >5x faster dedupe

2010-01-03 Thread Brendan Gregg - Sun Microsystems
On Sun, Jan 03, 2010 at 08:26:47PM -0800, Richard Elling wrote: > On Jan 3, 2010, at 4:05 PM, Jack Kielsmeier wrote: > > > >With L2arc, no such redundancy is needed. So, with a $100 SSD, if > >you can get 8x the performance out of your dedup'd dataset, and you > >don't have to worry about "what

Re: [zfs-discuss] $100 SSD = >5x faster dedupe

2010-01-03 Thread Thomas Burgess
On Thu, Dec 31, 2009 at 9:37 PM, Michael Herf wrote: > I've written about my slow-to-dedupe RAIDZ. > > After a week of.waitingI finally bought a little $100 30G OCZ > Vertex and plugged it in as a cache. > > After <2 hours of warmup, my zfs send/receive rate on the pool is > >16MB/sec (re

Re: [zfs-discuss] $100 SSD = >5x faster dedupe

2010-01-03 Thread Richard Elling
On Jan 3, 2010, at 4:05 PM, Jack Kielsmeier wrote: With L2arc, no such redundancy is needed. So, with a $100 SSD, if you can get 8x the performance out of your dedup'd dataset, and you don't have to worry about "what if the device fails", I'd call that an awesome investment. AFAIK, the L

Re: [zfs-discuss] $100 SSD = >5x faster dedupe

2010-01-03 Thread Jack Kielsmeier
> On Sun, 3 Jan 2010, Jack Kielsmeier wrote: > > > > help. It is suggested not to put zil on a device > external to the > > disks in the pool unless you mirror the zil device. > This is > > suggested to prevent data loss if the zil device > dies. > > The reason why it is suggested that the inten

Re: [zfs-discuss] $100 SSD = >5x faster dedupe

2010-01-03 Thread Bob Friesenhahn
On Sun, 3 Jan 2010, Jack Kielsmeier wrote: help. It is suggested not to put zil on a device external to the disks in the pool unless you mirror the zil device. This is suggested to prevent data loss if the zil device dies. The reason why it is suggested that the intent log reside in the same

Re: [zfs-discuss] $100 SSD = >5x faster dedupe

2010-01-03 Thread Jack Kielsmeier
> Just l2arc. Guess I can always repartition later. > > mike > > > On Sun, Jan 3, 2010 at 11:39 AM, Jack Kielsmeier > wrote: > > Are you using the SSD for l2arc or zil or both? > > -- > > This message posted from opensolaris.org > > ___ > > zfs-discus

Re: [zfs-discuss] $100 SSD = >5x faster dedupe

2010-01-03 Thread Michael Herf
Just l2arc. Guess I can always repartition later. mike On Sun, Jan 3, 2010 at 11:39 AM, Jack Kielsmeier wrote: > Are you using the SSD for l2arc or zil or both? > -- > This message posted from opensolaris.org > ___ > zfs-discuss mailing list > zfs-dis

Re: [zfs-discuss] $100 SSD = >5x faster dedupe

2010-01-03 Thread Jack Kielsmeier
Are you using the SSD for l2arc or zil or both? -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

Re: [zfs-discuss] $100 SSD = >5x faster dedupe

2009-12-31 Thread Michael Herf
Make that 25MB/sec, and rising... So it's 8x faster now. mike -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

[zfs-discuss] $100 SSD = >5x faster dedupe

2009-12-31 Thread Michael Herf
I've written about my slow-to-dedupe RAIDZ. After a week of.waitingI finally bought a little $100 30G OCZ Vertex and plugged it in as a cache. After <2 hours of warmup, my zfs send/receive rate on the pool is >16MB/sec (reading and writing each at 16MB as measured by zpool iostat). That's