[OmniOS-discuss] zfs send via SRP or other RDMA enabled protocol

2014-11-01 Thread Rune Tipsmark
Hi all, Is it possible to do zfs send/recv via SRP or some other RMDA enabled protocol? IPoIB is really slow, about 50 MB/sec between two boxes, no disks are more than 10-15% busy. If not, is there a way I can aggregate say 8 or 16 IPoIB partitions and push throughput to a more reasonable sp

Re: [OmniOS-discuss] zfs send via SRP or other RDMA enabled protocol

2014-11-01 Thread David Bomba
I usually mount a iSer target and perform ZFS send to the target. This was the best way to exploit the rdma bandwidth to its full potential. > On 2 Nov 2014, at 11:45 am, Rune Tipsmark > wrote: > > Hi all, > > Is it possible to do zfs send/recv via SRP or some other

Re: [OmniOS-discuss] zfs send via SRP or other RDMA enabled protocol

2014-11-01 Thread Rune Tipsmark
://www.ssec.wisc.edu/~scottn/Lustre_ZFS_notes/lustre_zfs_srp_mirror.html Br, Rune From: David Bomba [mailto:turbo...@gmail.com] Sent: Saturday, November 01, 2014 6:01 PM To: Rune Tipsmark Cc: omnios-discuss@lists.omniti.com Subject: Re: [OmniOS-discuss] zfs send via SRP or other RDMA enabled

Re: [OmniOS-discuss] zfs send via SRP or other RDMA enabled protocol

2014-11-01 Thread David Bomba
01 PM > To: Rune Tipsmark > Cc: omnios-discuss@lists.omniti.com > Subject: Re: [OmniOS-discuss] zfs send via SRP or other RDMA enabled protocol > > I usually mount a iSer target and perform ZFS send to the target. This was > the best way to exploit the rdma bandwidth to it

Re: [OmniOS-discuss] zfs send via SRP or other RDMA enabled protocol

2014-11-02 Thread Rune Tipsmark
ct: Ang: Re: [OmniOS-discuss] zfs send via SRP or other RDMA enabled protocol -"OmniOS-discuss" skrev: - Till: David Bomba Från: Rune Tipsmark Sänt av: "OmniOS-discuss" Datum: 2014-11-02 07:55 Kopia: "omnios-discuss@lists.omniti.com" Ärende: Re: [OmniOS-discus

Re: [OmniOS-discuss] zfs send via SRP or other RDMA enabled protocol

2014-11-02 Thread Rune Tipsmark
nios-discuss@lists.omniti.com<mailto:omnios-discuss@lists.omniti.com>" mailto:omnios-discuss@lists.omniti.com>> Ärende: RE: Re: [OmniOS-discuss] zfs send via SRP or other RDMA enabled protocol Hi Johan Got two ZFS boxes (ZFS00 recv, ZFS10 send), both with IB and all configured and

Re: [OmniOS-discuss] zfs send via SRP or other RDMA enabled protocol

2014-11-02 Thread Rune Tipsmark
: omnios-discuss@lists.omniti.com Subject: Ang: RE: RE: RE: Re: [OmniOS-discuss] zfs send via SRP or other RDMA enabled protocol Hej! I can see I forgot the list in previous mail... Anyway, are you using connectx adapters? Have you checked if the driver is loaded in the host system? Best

Re: [OmniOS-discuss] zfs send via SRP or other RDMA enabled protocol

2014-11-02 Thread Rune Tipsmark
PM To: Rune Tipsmark Cc: omnios-discuss@lists.omniti.com Subject: Ang: RE: RE: RE: RE: Re: [OmniOS-discuss] zfs send via SRP or other RDMA enabled protocol Hej! Hmm, how about the target/initiiator configuration of the HCA's? When I think about it, I have never done this that you're

Re: [OmniOS-discuss] zfs send via SRP or other RDMA enabled protocol

2014-11-03 Thread Rune Tipsmark
mnios-discuss@lists.omniti.com Subject: Ang: RE: RE: RE: RE: RE: Re: [OmniOS-discuss] zfs send via SRP or other RDMA enabled protocol Hej! If you want to mirror a local volume with a remote LU, I don't think it is a good idea. Asking for trubble... I understand you want to get an HA solut