Re: [zfs-discuss] Announce: zfsdump

2010-07-05 Thread Tristram Scott
At this point, I will repeat my recommendation about using zpool-in-files as a backup (staging) target. Depending where you ost, and how you combine the files, you can achieve these scenarios without clunkery, and with all the benefits a zpool provides. This is another good scheme. I

Re: [zfs-discuss] Announce: zfsdump

2010-07-05 Thread Joerg Schilling
Tristram Scott tristram.sc...@quantmodels.co.uk wrote: I see a number of points to consider when choosing amongst the various suggestions for backing up zfs file systems. In no particular order, I have these: Let me fill this out for star ;-) 1. Does it work in place, or need an

Re: [zfs-discuss] Announce: zfsdump

2010-07-03 Thread Daniel Carosone
On Wed, Jun 30, 2010 at 12:54:19PM -0400, Edward Ned Harvey wrote: If you're talking about streaming to a bunch of separate tape drives (or whatever) on a bunch of separate systems because the recipient storage is the bottleneck instead of the network ... then split probably isn't the most

Re: [zfs-discuss] Announce: zfsdump

2010-07-01 Thread Edward Ned Harvey
From: Asif Iqbal [mailto:vad...@gmail.com] currently to speed up the zfs send| zfs recv I am using mbuffer. It moves the data lot faster than using netcat (or ssh) as the transport method Yup, this works because network and disk latency can both be variable. So without buffering, your data

Re: [zfs-discuss] Announce: zfsdump

2010-06-30 Thread Edward Ned Harvey
From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss- boun...@opensolaris.org] On Behalf Of Asif Iqbal would be nice if i could pipe the zfs send stream to a split and then send of those splitted stream over the network to a remote system. it would help sending it over to remote

Re: [zfs-discuss] Announce: zfsdump

2010-06-30 Thread Asif Iqbal
On Wed, Jun 30, 2010 at 12:54 PM, Edward Ned Harvey solar...@nedharvey.com wrote: From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss- boun...@opensolaris.org] On Behalf Of Asif Iqbal would be nice if i could pipe the zfs send stream to a split and then send of those splitted stream

Re: [zfs-discuss] Announce: zfsdump

2010-06-29 Thread Tristram Scott
would be nice if i could pipe the zfs send stream to a split and then send of those splitted stream over the network to a remote system. it would help sending it over to remote system quicker. can your tool do that? something like this s | - | j -

Re: [zfs-discuss] Announce: zfsdump

2010-06-29 Thread Asif Iqbal
On Tue, Jun 29, 2010 at 8:17 AM, Tristram Scott tristram.sc...@quantmodels.co.uk wrote: would be nice if i could pipe the zfs send stream to a split and then send of those splitted stream over the network to a remote system. it would help sending it over to remote system quicker. can your

Re: [zfs-discuss] Announce: zfsdump

2010-06-29 Thread Kyle McDonald
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 6/28/2010 10:30 PM, Edward Ned Harvey wrote: From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss- boun...@opensolaris.org] On Behalf Of Tristram Scott If you would like to try it out, download the package from:

Re: [zfs-discuss] Announce: zfsdump

2010-06-29 Thread Tristram Scott
if, for example, the network pipe is bigger then one unsplitted stream of zfs send | zfs recv then splitting it to multiple streams should optimize the network bandwidth, shouldn't it ? Well, I guess so. But I wonder, what is the bottle neck here. If it is the rate at which zfs send

Re: [zfs-discuss] Announce: zfsdump

2010-06-29 Thread Tristram Scott
evik wrote: Reading this list for a while made it clear that zfs send is not a backup solution, it can be used for cloning the filesystem to a backup array if you are consuming the stream with zfs receive so you get notified immediately about errors. Even one bitflip will render the stream

[zfs-discuss] Announce: zfsdump

2010-06-28 Thread Tristram Scott
For quite some time I have been using zfs send -R fsn...@snapname | dd of=/dev/rmt/1ln to make a tape backup of my zfs file system. A few weeks back the size of the file system grew to larger than would fit on a single DAT72 tape, and I once again searched for a simple solution to allow

Re: [zfs-discuss] Announce: zfsdump

2010-06-28 Thread Brian Kolaci
I use Bacula which works very well (much better than Amanda did). You may be able to customize it to do direct zfs send/receive, however I find that although they are great for copying file systems to other machines, they are inadequate for backups unless you always intend to restore the whole

Re: [zfs-discuss] Announce: zfsdump

2010-06-28 Thread Tristram Scott
I use Bacula which works very well (much better than Amanda did). You may be able to customize it to do direct zfs send/receive, however I find that although they are great for copying file systems to other machines, they are inadequate for backups unless you always intend to restore the

Re: [zfs-discuss] Announce: zfsdump

2010-06-28 Thread Brian Kolaci
On Jun 28, 2010, at 12:26 PM, Tristram Scott wrote: I use Bacula which works very well (much better than Amanda did). You may be able to customize it to do direct zfs send/receive, however I find that although they are great for copying file systems to other machines, they are inadequate

Re: [zfs-discuss] Announce: zfsdump

2010-06-28 Thread Edward Ned Harvey
From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss- boun...@opensolaris.org] On Behalf Of Tristram Scott If you would like to try it out, download the package from: http://www.quantmodels.co.uk/zfsdump/ I haven't tried this yet, but thank you very much! Other people have pointed

Re: [zfs-discuss] Announce: zfsdump

2010-06-28 Thread Asif Iqbal
On Mon, Jun 28, 2010 at 11:26 AM, Tristram Scott tristram.sc...@quantmodels.co.uk wrote: For quite some time I have been using zfs send -R fsn...@snapname | dd of=/dev/rmt/1ln to make a tape backup of my zfs file system.  A few weeks back the size of the file system grew to larger than would