Re: [zfs-discuss] zfs send to remote any ideas for a faster way than ssh?

2010-07-21 Thread Edward Ned Harvey
> From: Giovanni Tirloni [mailto:gtirl...@sysdroid.com] > > We have hundreds of servers using LACP and so far have not noticed any > increase in the error rate. If the error rate is not zero, you have an increased error rate. In linux, you just do this: sudo /sbin/ifconfig -a | grep errors | gre

Re: [zfs-discuss] zfs send to remote any ideas for a faster way than ssh?

2010-07-20 Thread Ian Collins
On 07/21/10 03:12 AM, Richard Jahnel wrote: On the receiver /opt/csw/bin/mbuffer -m 1G -I Ostor-1:8000 | zfs recv -F e...@sunday in @ 0.0 kB/s, out @ 0.0 kB/s, 43.7 GB total, buffer 100% fullcannot receive new filesystem stream: invalid backup stream mbuffer: error: outputThread: error writin

Re: [zfs-discuss] zfs send to remote any ideas for a faster way than ssh?

2010-07-20 Thread Richard Jahnel
I'll try an export/import and scrub of the receiving pool and see what that does. I can't take the sending pool offline to try that stuff though. -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http:/

Re: [zfs-discuss] zfs send to remote any ideas for a faster way than ssh?

2010-07-20 Thread Richard Jahnel
On the receiver /opt/csw/bin/mbuffer -m 1G -I Ostor-1:8000 | zfs recv -F e...@sunday in @ 0.0 kB/s, out @ 0.0 kB/s, 43.7 GB total, buffer 100% fullcannot receive new filesystem stream: invalid backup stream mbuffer: error: outputThread: error writing to at offset 0xaedf6a000: Broken pipe sum

Re: [zfs-discuss] zfs send to remote any ideas for a faster way than ssh?

2010-07-20 Thread Giovanni Tirloni
On Tue, Jul 20, 2010 at 12:59 AM, Edward Ned Harvey wrote: >> From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss- >> boun...@opensolaris.org] On Behalf Of Richard Jahnel >> >> I'vw also tried mbuffer, but I get broken pipe errors part way through >> the transfer. > > The standard answer

Re: [zfs-discuss] zfs send to remote any ideas for a faster way than ssh?

2010-07-19 Thread Fajar A. Nugraha
On Mon, Jul 19, 2010 at 11:06 PM, Richard Jahnel wrote: > I've tried ssh blowfish and scp arcfour. both are CPU limited long before the > 10g link is. > > I'vw also tried mbuffer, but I get broken pipe errors part way through the > transfer. > > I'm open to ideas for faster ways to to either zfs

Re: [zfs-discuss] zfs send to remote any ideas for a faster way than ssh?

2010-07-19 Thread Edward Ned Harvey
> From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss- > boun...@opensolaris.org] On Behalf Of Richard Jahnel > > I'vw also tried mbuffer, but I get broken pipe errors part way through > the transfer. The standard answer is mbuffer. I think you should ask yourself what's going wrong wi

Re: [zfs-discuss] zfs send to remote any ideas for a faster way than ssh?

2010-07-19 Thread Ian Collins
On 07/20/10 08:20 AM, Richard Jahnel wrote: I've used mbuffer to transfer hundreds of TB without a problem in mbuffer itself. You will get disconnected if the send or receive prematurely ends, though. mbuffer itself very specifically ends with a broken pipe error. Very quickly with s set

Re: [zfs-discuss] zfs send to remote any ideas for a faster way than ssh?

2010-07-19 Thread Richard Jahnel
FWIW I found netcat over at CSW. http://www.opencsw.org/packages/CSWnetcat/ -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

Re: [zfs-discuss] zfs send to remote any ideas for a faster way than ssh?

2010-07-19 Thread Richard Jahnel
[zfs-discuss] zfs send to remote any ideas for a faster way than ssh? On Mon, Jul 19, 2010 at 9:06 AM, Richard Jahnel wrote: > I've tried ssh blowfish and scp arcfour. both are CPU limited long before the 10g link is. > > I'vw also tried mbuffer, but I get broken pipe err

Re: [zfs-discuss] zfs send to remote any ideas for a faster way than ssh?

2010-07-19 Thread Richard Jahnel
>I've used mbuffer to transfer hundreds of TB without a problem in mbuffer >itself. You will get disconnected if the send or receive prematurely ends, >though. mbuffer itself very specifically ends with a broken pipe error. Very quickly with s set to 128 or after sometime with s set over 1024.

Re: [zfs-discuss] zfs send to remote any ideas for a faster way than ssh?

2010-07-19 Thread Richard Elling
On Jul 19, 2010, at 10:49 AM, Richard Jahnel wrote: >> Any idea why? Does the zfs send or zfs receive bomb out part way through? > > I have no idea why mbuffer fails. Changing the -s from 128 to 1536 made it > take longer to occur and slowed it down bu about 20% but didn't resolve the > issue.

Re: [zfs-discuss] zfs send to remote any ideas for a faster way than ssh?

2010-07-19 Thread Bruno Sousa
On 19-7-2010 20:36, Brent Jones wrote: > On Mon, Jul 19, 2010 at 11:14 AM, Bruno Sousa wrote: > >> Hi, >> >> If you can share those scripts that make use of mbuffer, please feel >> free to do so ;) >> >> >> Bruno >> On 19-7-2010 20:02, Brent Jones wrote: >> >>> On Mon, Jul 19, 2010 at 9:06

Re: [zfs-discuss] zfs send to remote any ideas for a faster way than ssh?

2010-07-19 Thread Brent Jones
On Mon, Jul 19, 2010 at 11:14 AM, Bruno Sousa wrote: > Hi, > > If you can share those scripts that make use of mbuffer, please feel > free to do so ;) > > > Bruno > On 19-7-2010 20:02, Brent Jones wrote: >> On Mon, Jul 19, 2010 at 9:06 AM, Richard Jahnel >> wrote: >> >>> I've tried ssh blowfish

Re: [zfs-discuss] zfs send to remote any ideas for a faster way than ssh?

2010-07-19 Thread Andrew Gabriel
Richard Jahnel wrote: Any idea why? Does the zfs send or zfs receive bomb out part way through? I have no idea why mbuffer fails. Changing the -s from 128 to 1536 made it take longer to occur and slowed it down bu about 20% but didn't resolve the issue. It just ment I might get as far as

Re: [zfs-discuss] zfs send to remote any ideas for a faster way than ssh?

2010-07-19 Thread Daniel Taylor
Richard, On 19 Jul 2010, at 18:49, Richard Jahnel wrote: I heard of some folks using netcat. I haven't figured out where to get netcat nor the syntax for using it yet. I also did a bit of research into using netcat and found this... http://www.mail-archive.com/storage-disc...@opensolaris.

Re: [zfs-discuss] zfs send to remote any ideas for a faster way than ssh?

2010-07-19 Thread Bruno Sousa
Hi, If you can share those scripts that make use of mbuffer, please feel free to do so ;) Bruno On 19-7-2010 20:02, Brent Jones wrote: > On Mon, Jul 19, 2010 at 9:06 AM, Richard Jahnel > wrote: > >> I've tried ssh blowfish and scp arcfour. both are CPU limited long before >> the 10g link i

Re: [zfs-discuss] zfs send to remote any ideas for a faster way than ssh?

2010-07-19 Thread Brent Jones
On Mon, Jul 19, 2010 at 9:06 AM, Richard Jahnel wrote: > I've tried ssh blowfish and scp arcfour. both are CPU limited long before the > 10g link is. > > I'vw also tried mbuffer, but I get broken pipe errors part way through the > transfer. > > I'm open to ideas for faster ways to to either zfs

Re: [zfs-discuss] zfs send to remote any ideas for a faster way than ssh?

2010-07-19 Thread Richard Jahnel
>If this is across a trusted link, have a look at the HPN patches to >ZFS. There are three main benefits to these patches: >- increased (and dynamic) buffers internal to SSH >- adds a multi-threaded aes cipher >- adds the NONE cipher for non-encrypted data transfers >(authentication is still encryp

Re: [zfs-discuss] zfs send to remote any ideas for a faster way than ssh?

2010-07-19 Thread Richard Jahnel
>Any idea why? Does the zfs send or zfs receive bomb out part way through? I have no idea why mbuffer fails. Changing the -s from 128 to 1536 made it take longer to occur and slowed it down bu about 20% but didn't resolve the issue. It just ment I might get as far as 2.5gb before mbuffer bombed

Re: [zfs-discuss] zfs send to remote any ideas for a faster way than ssh?

2010-07-19 Thread Andrew Gabriel
Richard Jahnel wrote: I've tried ssh blowfish and scp arcfour. both are CPU limited long before the 10g link is. I'vw also tried mbuffer, but I get broken pipe errors part way through the transfer. Any idea why? Does the zfs send or zfs receive bomb out part way through? Might be worth t

Re: [zfs-discuss] zfs send to remote any ideas for a faster way than ssh?

2010-07-19 Thread Freddie Cash
On Mon, Jul 19, 2010 at 9:06 AM, Richard Jahnel wrote: > I've tried ssh blowfish and scp arcfour. both are CPU limited long before the > 10g link is. > > I'vw also tried mbuffer, but I get broken pipe errors part way through the > transfer. > > I'm open to ideas for faster ways to to either zfs

[zfs-discuss] zfs send to remote any ideas for a faster way than ssh?

2010-07-19 Thread Richard Jahnel
I've tried ssh blowfish and scp arcfour. both are CPU limited long before the 10g link is. I'vw also tried mbuffer, but I get broken pipe errors part way through the transfer. I'm open to ideas for faster ways to to either zfs send directly or through a compressed file of the zfs send output.