Re: [zfs-discuss] ZFS send and receive corruption across a WAN link?

2010-03-23 Thread Richard Jahnel
Not quite brave enough to put dedup into prodiction here. Concerned about the issues some folks have had when releasing large numbers of blocks in one go. -- This message posted from opensolaris.org ___ zfs-discuss mailing list

Re: [zfs-discuss] ZFS send and receive corruption across a WAN link?

2010-03-22 Thread Richard Elling
On Mar 19, 2010, at 1:28 PM, Richard Jahnel wrote: They way we do this here is: zfs snapshot voln...@snapnow [i]#code to break on error and email not shown.[/i] zfs send -i voln...@snapbefore voln...@snapnow | pigz -p4 -1 file [i]#code to break on error and email not shown.[/i] scp

Re: [zfs-discuss] ZFS send and receive corruption across a WAN link?

2010-03-22 Thread Brandon High
On Mon, Mar 22, 2010 at 10:26 AM, Richard Elling richard.ell...@gmail.comwrote: NB. deduped streams should further reduce the snapshot size. I haven't seen a lot of discussion on the list regarding send dedup, but I understand it'll use the DDT if you have dedup enabled on your dataset. What's

Re: [zfs-discuss] ZFS send and receive corruption across a WAN link?

2010-03-22 Thread Lori Alt
On 03/22/10 05:04 PM, Brandon High wrote: On Mon, Mar 22, 2010 at 10:26 AM, Richard Elling richard.ell...@gmail.com mailto:richard.ell...@gmail.com wrote: NB. deduped streams should further reduce the snapshot size. I haven't seen a lot of discussion on the list regarding send dedup,

Re: [zfs-discuss] ZFS send and receive corruption across a WAN link?

2010-03-22 Thread Nicolas Williams
On Thu, Mar 18, 2010 at 10:38:00PM -0700, Rob wrote: Can a ZFS send stream become corrupt when piped between two hosts across a WAN link using 'ssh'? No. SSHv2 uses HMAC-MD5 and/or HMAC-SHA-1, depending on what gets negotiated, for integrity protection. The chances of random on the wire

Re: [zfs-discuss] ZFS send and receive corruption across a WAN link?

2010-03-19 Thread Fajar A. Nugraha
On Fri, Mar 19, 2010 at 12:38 PM, Rob slewb...@yahoo.com wrote: Can a ZFS send stream become corrupt when piped between two hosts across a WAN link using 'ssh'? unless the end computers are bad (memory problems, etc.), then the answer should be no. ssh has its own error detection method, and

Re: [zfs-discuss] ZFS send and receive corruption across a WAN link?

2010-03-19 Thread David Dyer-Bennet
On Fri, March 19, 2010 00:38, Rob wrote: Can a ZFS send stream become corrupt when piped between two hosts across a WAN link using 'ssh'? For example a host in Australia sends a stream to a host in the UK as follows: # zfs send tank/f...@now | ssh host.uk receive tank/bar In general,

Re: [zfs-discuss] ZFS send and receive corruption across a WAN link?

2010-03-19 Thread Bob Friesenhahn
On Fri, 19 Mar 2010, David Dyer-Bennet wrote: However, these legacy mechanisms aren't guaranteed to give you the less-than-one-wrong-bit-in-10^15 level of accuracy people tend to want for enterprise backups today (or am I off a couple of orders of magnitude there?). They were defined when

Re: [zfs-discuss] ZFS send and receive corruption across a WAN link?

2010-03-19 Thread David Dyer-Bennet
On Fri, March 19, 2010 09:49, Bob Friesenhahn wrote: On Fri, 19 Mar 2010, David Dyer-Bennet wrote: However, these legacy mechanisms aren't guaranteed to give you the less-than-one-wrong-bit-in-10^15 level of accuracy people tend to want for enterprise backups today (or am I off a couple of

Re: [zfs-discuss] ZFS send and receive corruption across a WAN link?

2010-03-19 Thread Bob Friesenhahn
On Fri, 19 Mar 2010, David Dyer-Bennet wrote: I don't think of stream crypto as inherently including validity checking, though in practice I suppose it would always be a good idea. This is obviously a vital and necessary function of ssh in order to defend against man in the middle attacks.

Re: [zfs-discuss] ZFS send and receive corruption across a WAN link?

2010-03-19 Thread Richard Jahnel
They way we do this here is: zfs snapshot voln...@snapnow [i]#code to break on error and email not shown.[/i] zfs send -i voln...@snapbefore voln...@snapnow | pigz -p4 -1 file [i]#code to break on error and email not shown.[/i] scp /dir/file u...@remote:/dir/file [i]#code to break on error and

Re: [zfs-discuss] ZFS send and receive corruption across a WAN link?

2010-03-19 Thread Ian Collins
On 03/20/10 09:28 AM, Richard Jahnel wrote: They way we do this here is: zfs snapshot voln...@snapnow [i]#code to break on error and email not shown.[/i] zfs send -i voln...@snapbefore voln...@snapnow | pigz -p4 -1 file [i]#code to break on error and email not shown.[/i] scp /dir/file

Re: [zfs-discuss] ZFS send and receive corruption across a WAN link?

2010-03-19 Thread Richard Jahnel
no, but I'm slightly paranoid that way. ;) -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

[zfs-discuss] ZFS send and receive corruption across a WAN link?

2010-03-18 Thread Rob
Can a ZFS send stream become corrupt when piped between two hosts across a WAN link using 'ssh'? For example a host in Australia sends a stream to a host in the UK as follows: # zfs send tank/f...@now | ssh host.uk receive tank/bar -- This message posted from opensolaris.org