Re: rsockets addressing

2013-09-16 Thread Gandalf Corvotempesta
2013/9/16 Yann Droneaud : > The InfiniBand fabrics support "ISL" ... indeed. [cut] > You definitely need link between switches if you want to use a "high > availability" fabric topology with HCA ports connected to differents > switches. (additionally, a switch should have a link to two others > swi

Re: rsockets addressing

2013-09-16 Thread Yann Droneaud
Hi, Le lundi 16 septembre 2013 à 18:31 +0200, Gandalf Corvotempesta a écrit : > 2013/9/16 Yann Droneaud : > > You have to use InfiniBand port bonding to benefit from fail-over (through > > APM: Automatic Path Migration ?) > > > > http://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git/tree/

Re: rsockets addressing

2013-09-16 Thread Gandalf Corvotempesta
2013/9/16 Yann Droneaud : > You have to use InfiniBand port bonding to benefit from fail-over (through > APM: Automatic Path Migration ?) > > http://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git/tree/Documentation/networking/bonding.txt IB boinding is exactly what I would like to do but

Re: Slow performance with librspreload.so

2013-09-16 Thread Gandalf Corvotempesta
2013/9/3 Gandalf Corvotempesta : > $ sudo qperf -ub 172.17.0.2 rc_bi_bw rc_lat rc_bw rc_rdma_read_lat > rc_rdma_read_bw rc_rdma_write_lat rc_rdma_write_bw tcp_lat tcp_bw > rc_bi_bw: > bw = 20.5 Gb/sec > rc_lat: > latency = 15.4 us > rc_bw: > bw = 13.7 Gb/sec > rc_rdma_read_lat: >

Re: rsockets addressing

2013-09-16 Thread Yann Droneaud
Le 16.09.2013 17:59, Gandalf Corvotempesta a écrit : 2013/9/16 Hefty, Sean : rsockets does not implement failover. An application would need to reestablish a connection in the case of a failure. I have not looked to see what it would take to implement failover inside rsockets, and that's not

Re: rsockets addressing

2013-09-16 Thread Gandalf Corvotempesta
2013/9/16 Hefty, Sean : > rsockets does not implement failover. An application would need to > reestablish a connection in the case of a failure. I have not looked to see > what it would take to implement failover inside rsockets, and that's not > something I would have time to implement anyti

RE: rsockets addressing

2013-09-16 Thread Hefty, Sean
> which kind of system is used by rsockets to address the remote host? > Is using IPoIB ? rsockets is built over the RDMA CM. The rdma cm uses ipoib indirectly when connecting over IB, by mapping the IP addresses to GIDs. rsockets can also support using native IB addresses, though this is a new

[PATCH] osm_state_mgr.c Add info to some error messages

2013-09-16 Thread Line Holen
Signed-off-by: Line Holen --- diff --git a/opensm/osm_state_mgr.c b/opensm/osm_state_mgr.c index adfea9a..20f91da 100644 --- a/opensm/osm_state_mgr.c +++ b/opensm/osm_state_mgr.c @@ -4,6 +4,7 @@ * Copyright (c) 2002-2009 Mellanox Technologies LTD. All rights reserved. * Copyright (c) 1996-20

Re: [PATCH 8/8] IB/srp: Make queue size configurable

2013-09-16 Thread David Dillow
On Mon, 2013-09-16 at 16:25 +0200, Bart Van Assche wrote: > On 09/12/13 00:16, David Dillow wrote: > > On Tue, 2013-09-10 at 19:44 +0200, Bart Van Assche wrote: > >> If this name was not yet in use in any interface that is visible in user > >> space, I would agree that we should come up with a bett

Re: [PATCH 8/8] IB/srp: Make queue size configurable

2013-09-16 Thread Bart Van Assche
On 09/12/13 00:16, David Dillow wrote: On Tue, 2013-09-10 at 19:44 +0200, Bart Van Assche wrote: If this name was not yet in use in any interface that is visible in user space, I would agree that we should come up with a better name. However, the SCSI mid-layer already uses that name today to ex

[PATCH infiniband-diags] ibdiag_sa.c: Output attribute ID in hex rather than decimal

2013-09-16 Thread Hal Rosenstock
so that it's easier to correlate to IBA spec For example: saquery PKTR 20/1/0 --smkey 1 ibwarn: sa_query: umad_send failed: attr 51: Bad file description 0x33 would be easier than 51 as no conversion is required to look it up in IBA spec. Signed-off-by: Hal Rosenstock --- diff --git a/src/ibdi

Re: [ceph-users] Help needed porting Ceph to RSockets

2013-09-16 Thread Gandalf Corvotempesta
2013/9/12 Andreas Bluemle : > I have not yet done any performance testing. > > The next step I have to take is more related to setting up > a larger cluster with sth. like 150 osd's without hitting any > resource limitations. How do you manage failover ? Will you use mulitple HBA (or dual-port HBA

rsockets addressing

2013-09-16 Thread Gandalf Corvotempesta
Hi to all, which kind of system is used by rsockets to address the remote host? Is using IPoIB ? Will I be able to support two redundant fabrics with failover managed by OpenSM with rsockets ? For example, two nodes connected (with 2 HBA on each) to two different IB fabrics. In case of an HBA fail

memory registration using zero based virtual address

2013-09-16 Thread Eva Mishra
i understood following steps for memory registration using zero based virtual address step 1: allocate a buffer. return address is a virtual address. step 2: in memory registration verb, provide virtual address returned in step 1 and set Type of VA as zbva. step 3: in the verb for posting opera