Re: Issue with RDMA_CM on systems with multiple IB HCA's.

2010-07-22 Thread Or Gerlitz
Hari Subramoni wrote: [subra...@amd6 perftest]$ ./ib_rdma_bw -c 172.16.1.5 11928: | port=18515 | ib_port=1 | size=65536 | tx_depth=100 | iters=1000 | duplex=0 | cma=1 | 11928: Local address: LID , QPN 00, PSN 0x5bfbba RKey 0x90042602 VAddr 0x002b27feabe000 11928: Remote address:

Re: about cxgb3 and cxgb4

2010-07-22 Thread Steve Wise
Andrea Gozzelino wrote: Hi all, I ask you an opinion about RDMA driver cxgb3 and cxb4. I installed two NetEffect Intel cards on machines with OS Linux and driver cxgb3. Please see the detail below: cxgb3/4 is for the Chelsio T3/T4 hardware, not the NetEffect/Intel hardware. You want

Re: [PATCH] rdma/ib_cm: check LAP state before sending an MRA

2010-07-22 Thread Arthur Kepner
On Wed, Jul 21, 2010 at 04:36:52PM -0700, Hefty, Sean wrote: ... Josh or Arthur, can either of you confirm if this patch fixes the crashes that you've seen? I can't. It's been practically impossible for us to reproduce. (Only our customer seems to have the magic recipe.) -- Arthur -- To

mlx4_core unable to use MSI-x on our nodes

2010-07-22 Thread Meyer, Donald J
In our dmesg log I see mlx4_core :02:00.0: Only 12 MSI-X vectors available, need 25. Not using MSI-X which if I read it correctly says our mlx4_core is unable to use MSI-X which if I also understand correctly means the mlx4_core can't use the sharing of interrupts among all processors. If

Re: more partition questions

2010-07-22 Thread Hal Rosenstock
Tom, On Thu, Jul 22, 2010 at 1:19 PM, Tom Ammon tom.am...@utah.edu wrote: Hal, On 7/21/2010 2:45 PM, Hal Rosenstock wrote: Hi Tom, On 7/19/10, Tom Ammontom.am...@utah.edu  wrote: I'm trying to set up partitions in a little test environment, and I'm having trouble. I have opensm

Re: mlx4_core unable to use MSI-x on our nodes

2010-07-22 Thread Jason Gunthorpe
On Thu, Jul 22, 2010 at 10:56:55AM -0700, Meyer, Donald J wrote: In our dmesg log I see mlx4_core :02:00.0: Only 12 MSI-X vectors available, need 25. Not using MSI-X which if I read it correctly says our mlx4_core is unable to use MSI-X which if I also understand correctly means the

Re: more partition questions

2010-07-22 Thread Tom Ammon
Hal, Thanks for looking at all of this with me. ifconfig output is below. On 7/22/2010 12:08 PM, Hal Rosenstock wrote: Tom, On Thu, Jul 22, 2010 at 1:19 PM, Tom Ammontom.am...@utah.edu wrote: Hal, On 7/21/2010 2:45 PM, Hal Rosenstock wrote: Hi Tom, On 7/19/10, Tom

Re: more partition questions

2010-07-22 Thread Hal Rosenstock
Hi Tom, On Thu, Jul 22, 2010 at 5:05 PM, Tom Ammon tom.am...@utah.edu wrote: Hi Hal, I also found this in opensm.log on the SM machine (on a different server): Jul 22 14:39:29 646241 [4AD86940] 0x01 - mcmr_rcv_join_mgrp: ERR 1B11: method = SubnAdmSet, scope_state = 0x1, component mask =

Re: more partition questions

2010-07-22 Thread Hal Rosenstock
Tom, On Thu, Jul 22, 2010 at 4:49 PM, Tom Ammon tom.am...@utah.edu wrote: Hal, Thanks for looking at all of this with me. ifconfig output is below. On 7/22/2010 12:08 PM, Hal Rosenstock wrote: Tom, On Thu, Jul 22, 2010 at 1:19 PM, Tom Ammontom.am...@utah.edu  wrote: Hal, On 7/21/2010

[PATCH 1/6] librdmacm/man: add rdma_get_request man page to release

2010-07-22 Thread Hefty, Sean
Signed-off-by: Sean Hefty sean.he...@intel.com --- Makefile.am |1 + 1 files changed, 1 insertions(+), 0 deletions(-) diff --git a/Makefile.am b/Makefile.am index 4ddbcfa..c752b4f 100644 --- a/Makefile.am +++ b/Makefile.am @@ -70,6 +70,7 @@ man_MANS = \ man/rdma_resolve_route.3 \

[PATCH 3/6] librdmacm: convert ibv error values to errno

2010-07-22 Thread Hefty, Sean
The librdmacm documentation (rdma_cm.7 man page) specifies that librdmacm functions return 0 on success and -1 on error, with errno set correctly. The libibverbs abstractions simply pass the libibverbs return codes through to the user. Since libibverbs may return errno directly through a given

[PATCH 4/6] librdmacm: specify return value in man pages

2010-07-22 Thread Hefty, Sean
Document the return value of all calls in their respective man pages. Signed-off-by: Sean Hefty sean.he...@intel.com --- man/rdma_accept.3|3 +++ man/rdma_ack_cm_event.3 |3 +++ man/rdma_bind_addr.3 |3 +++ man/rdma_connect.3 |3

[PATCH 5/6] librdmacm: fix all calls to set errno

2010-07-22 Thread Hefty, Sean
The librdmacm documentation (rdma_cm.7 man page) specifies that librdmacm functions return 0 on success and -1 on error, with errno set correctly. Update places in the code where errno is not set correctly and cleanup setting the error code. Signed-off-by: Sean Hefty sean.he...@intel.com ---