RE: OFA Management maintainership

2013-02-06 Thread Hal Rosenstock
Hi, I think we all owe a debt of gratitude for Alex's excellent 2+ years of OpenSM, libibumad, and ibsim maintainership. I hope I can live up to the high standard Alex set. Thanks for all you've done Alex! -- Hal -Original Message- From: Alex Netes [mailto:ale...@dev.mellanox.co.il] O

OFA Management maintainership

2013-02-06 Thread Alex Netes
Hi, I want to announce that starting from today Hal Rosenstock which you are familiar with, is going to maintain OpenSM, libibumad and ibsim development. So starting from today his trees should be considered as master development trees: git://git.openfabrics.org/~halr/libibumad g

[GIT PULL] please pull infiniband.git

2013-02-06 Thread Roland Dreier
Hi Linus, Please pull from git://git.kernel.org/pub/scm/linux/kernel/git/roland/infiniband.git tags/rdma-for-linus IB regression fixes for 3.8: - Fix mlx4 VFs not working on old guests because of 64B CQE changes - Fix ill-c

[PATCH 3/3] infiniband-diags: deprecate dump_[m|l]fts.sh scripts

2013-02-06 Thread Ira Weiny
Signed-off-by: Ira Weiny --- Makefile.am|6 +- configure.in |4 +- doc/man/dump_lfts.8.in | 177 doc/man/dump_mfts.8.in | 170 -- doc/rst/dump_lfts.8.in.rst | 73

[PATCH V3 2/3] infiniband-diags: add dump_fts tool

2013-02-06 Thread Ira Weiny
dump_fts adds a faster version of the functionality of dump_[l|m]fts.sh. This code is based off of the ibroute code and simply uses libibnetdisc to scan the fabric instead of using ibnetdiscover and letting ibroute requery all that data over again. This improves things in 3 ways. 1) performan

[PATCH V3 1/3] infiniband-diags: libibnetdisc add find node by lid

2013-02-06 Thread Ira Weiny
NOTE: this change adds a glib requirement to the package. Changes since V1: Use GINT_TO_POINTER rather than allocating keys Changes since V2: Use internal object everywhere rather than just hacked into discover_fabric Generate lid2port hash when reading cached fa

Re: NFS over RDMA crashing

2013-02-06 Thread Steve Wise
On 2/6/2013 4:24 PM, J. Bruce Fields wrote: On Wed, Feb 06, 2013 at 05:48:15PM +0200, Yan Burman wrote: When killing mount command that got stuck: --- BUG: unable to handle kernel paging request at 880324dc7ff8 IP: [] rdma_read_xdr+0x8bb/0xd40 [svcrdm

Re: NFS over RDMA crashing

2013-02-06 Thread J. Bruce Fields
On Wed, Feb 06, 2013 at 05:48:15PM +0200, Yan Burman wrote: > When killing mount command that got stuck: > --- > > BUG: unable to handle kernel paging request at 880324dc7ff8 > IP: [] rdma_read_xdr+0x8bb/0xd40 [svcrdma] > PGD 1a0c063 PUD 32f82e063 PMD 32

Re: [PATCH for 3.8 v3, resend 0/3] IB/SRP patches for kernel 3.8

2013-02-06 Thread Vu Pham
Bart Van Assche wrote: On 02/05/13 21:54, Or Gerlitz wrote: On Tue, Feb 5, 2013 at 6:25 PM, Bart Van Assche wrote: On 02/04/13 22:11, Or Gerlitz wrote: Bart, I'd like to sharpen the point: could you please clarify if the series posted to linux-rdma stands for itself in the sense that SRP HA s

[PATCH 38/77] IB/core: convert to idr_alloc()

2013-02-06 Thread Tejun Heo
Convert to the much saner new idr interface. Only compile tested. v2: Mike triggered WARN_ON() in idr_preload() because send_mad(), which may be used from non-process context, was calling idr_preload() unconditionally. Preload iff @gfp_mask has __GFP_WAIT. Signed-off-by: Tejun Heo

[PATCH 40/77] IB/cxgb3: convert to idr_alloc()

2013-02-06 Thread Tejun Heo
Convert to the much saner new idr interface. Only compile tested. Signed-off-by: Tejun Heo Reviewed-by: Steve Wise Cc: linux-rdma@vger.kernel.org --- drivers/infiniband/hw/cxgb3/iwch.h | 24 +++- 1 file changed, 11 insertions(+), 13 deletions(-) diff --git a/drivers/infini

[PATCH 39/77] IB/amso1100: convert to idr_alloc()

2013-02-06 Thread Tejun Heo
Convert to the much saner new idr interface. Only compile tested. Signed-off-by: Tejun Heo Reviewed-by: Steve Wise Cc: Tom Tucker Cc: linux-rdma@vger.kernel.org --- drivers/infiniband/hw/amso1100/c2_qp.c | 19 +++ 1 file changed, 11 insertions(+), 8 deletions(-) diff --git a/

[PATCH 43/77] IB/ipath: convert to idr_alloc()

2013-02-06 Thread Tejun Heo
Convert to the much saner new idr interface. Only compile tested. Signed-off-by: Tejun Heo Cc: Mike Marciniszyn Cc: linux-rdma@vger.kernel.org --- drivers/infiniband/hw/ipath/ipath_driver.c | 16 1 file changed, 4 insertions(+), 12 deletions(-) diff --git a/drivers/infiniband

[PATCH 46/77] IB/qib: convert to idr_alloc()

2013-02-06 Thread Tejun Heo
Convert to the much saner new idr interface. Only compile tested. Signed-off-by: Tejun Heo Cc: Mike Marciniszyn Cc: linux-rdma@vger.kernel.org --- drivers/infiniband/hw/qib/qib_init.c | 21 - 1 file changed, 8 insertions(+), 13 deletions(-) diff --git a/drivers/infiniband/

[PATCH 44/77] IB/mlx4: convert to idr_alloc()

2013-02-06 Thread Tejun Heo
Convert to the much saner new idr interface. Only compile tested. Signed-off-by: Tejun Heo Cc: Jack Morgenstein Cc: Or Gerlitz Cc: Roland Dreier Cc: linux-rdma@vger.kernel.org --- drivers/infiniband/hw/mlx4/cm.c | 32 +++- 1 file changed, 15 insertions(+), 17 dele

[PATCH 45/77] IB/ocrdma: convert to idr_alloc()

2013-02-06 Thread Tejun Heo
Convert to the much saner new idr interface. Only compile tested. Signed-off-by: Tejun Heo Cc: Roland Dreier Cc: linux-rdma@vger.kernel.org --- drivers/infiniband/hw/ocrdma/ocrdma_main.c | 14 +- 1 file changed, 1 insertion(+), 13 deletions(-) diff --git a/drivers/infiniband/hw/oc

[PATCH 41/77] IB/cxgb4: convert to idr_alloc()

2013-02-06 Thread Tejun Heo
Convert to the much saner new idr interface. Only compile tested. Signed-off-by: Tejun Heo Reviewed-by: Steve Wise Cc: linux-rdma@vger.kernel.org --- drivers/infiniband/hw/cxgb4/iw_cxgb4.h | 27 ++- 1 file changed, 14 insertions(+), 13 deletions(-) diff --git a/drivers

[PATCH 42/77] IB/ehca: convert to idr_alloc()

2013-02-06 Thread Tejun Heo
Convert to the much saner new idr interface. Only compile tested. Signed-off-by: Tejun Heo Cc: Hoang-Nam Nguyen Cc: Christoph Raisch Cc: linux-rdma@vger.kernel.org --- drivers/infiniband/hw/ehca/ehca_cq.c | 27 +++ drivers/infiniband/hw/ehca/ehca_qp.c | 34

Re: NFS over RDMA crashing

2013-02-06 Thread Jeff Becker
Hi. In case you're interested, I did the NFS/RDMA backports for OFED. I tested that NFS/RDMA in OFED 3.5 works on kernel 3.5, and also the RHEL 6.3 kernel. However, I did not test it with SRIOV. If you test it (OFED-3.5-rc6 was released last week), I'd like to know how it goes. Thanks. Jeff Be

[PATCH for-next 06/10] IB/core: Enhance memory windows support

2013-02-06 Thread Or Gerlitz
From: Shani Michaeli This patch enhanced the IB core support for Memory Windows. Memory Windows (MW) allow an application to have better/flexible control over remote access to memory. Two types of MWs are supported: Type 1 - associated with PD only Type 2A - associated with QPN only Type 2B -

[PATCH for-next 05/10] net/mlx4_core: Enable memory windows in {INIT,QUERY}_HCA

2013-02-06 Thread Or Gerlitz
From: Shani Michaeli Add memory windows related code to INIT_HCA and QUERY_HCA Signed-off-by: Haggai Eran Signed-off-by: Shani Michaeli Signed-off-by: Or Gerlitz --- drivers/net/ethernet/mellanox/mlx4/fw.c |3 +++ drivers/net/ethernet/mellanox/mlx4/fw.h |1 + drivers/net/ethernet

[PATCH for-next 02/10] net/mlx4_core: Rename MPT related service routines to have mpt_ prefix

2013-02-06 Thread Or Gerlitz
From: Shani Michaeli The MPT - Memory Protection Table - is used by both memory windows and memory regions. Hence, all MPT references are relevant for both types of memory objects. Rename the relevant functions to start with mpt_ instead of the current mr_ prefix. Signed-off-by: Haggai Eran S

[PATCH for-next 10/10] IB/mlx4_ib: Advertize MW support

2013-02-06 Thread Or Gerlitz
From: Shani Michaeli Indicate memory windows support through device capabilities, kernel verb entries and the relevant uverbs command mask entries. Signed-off-by: Haggai Eran Signed-off-by: Shani Michaeli Signed-off-by: Or Gerlitz --- drivers/infiniband/hw/mlx4/main.c | 19

[PATCH for-next 09/10] IB/mlx4_ib: Support memory window binding

2013-02-06 Thread Or Gerlitz
From: Shani Michaeli * Implement memory windows binding in mlx4_ib_post_send. * Implement mlx4_ib_bind_mw by deferring to mlx4_ib_post_send. * Rename MLX4_WQE_FMR_PERM_* flags to MLX4_WQE_FMR_AND_BIND_PERM_*, indicating that they are used both for fast registration work requests, and for me

[PATCH for-next 08/10] mlx4: Implement memory windows allocation and deallocation

2013-02-06 Thread Or Gerlitz
From: Shani Michaeli Implement MW allocation and deallocation in mlx4_core and mlx4_ib. Pass down the enable bind flag when registering memory regions. Signed-off-by: Haggai Eran Signed-off-by: Shani Michaeli Signed-off-by: Or Gerlitz --- drivers/infiniband/hw/mlx4/mlx4_ib.h| 12

[PATCH for-next 07/10] IB/uverbs: Implement memory windows support in uverbs

2013-02-06 Thread Or Gerlitz
From: Shani Michaeli The existing user/kernel uverbs API has IB_USER_VERBS_CMD_ALLOC/DEALLOC_MW, implement these calls, along with destroying user memory windows during process cleanup. Signed-off-by: Haggai Eran Signed-off-by: Shani Michaeli Signed-off-by: Or Gerlitz --- drivers/infiniband/

[PATCH for-next 04/10] net/mlx4_core: Disable memory windows for VFs

2013-02-06 Thread Or Gerlitz
From: Shani Michaeli Do not enable memory windows allocation for virtual functions. In addition, add a few safety checks, such as: * Verifying the PD of a new MPT matches the VF. * Making sure binding memory window isn't enabled for FMRs, and that new memory windows are not FMR themselves.

[PATCH for-next 00/10] mlx4: Add Memory Windows support

2013-02-06 Thread Or Gerlitz
Hi Roland, Here's a series from Shani Michaeli and Haggai Eran adds mlx4 driver support for Memory Windows. The first entries in this set are "pre patches" preparing the grounds for the actual implementation of MWs. Later there're two core patches, one to ib_verbs.h adding support for type 2 M

[PATCH for-next 03/10] net/mlx4_core: Propogate MR deregistration failure

2013-02-06 Thread Or Gerlitz
From: Shani Michaeli MR deregistration fails when memory windows are bound to it. Handle such failures by propagating it to the caller ULP. Signed-off-by: Haggai Eran Signed-off-by: Shani Michaeli Signed-off-by: Or Gerlitz --- drivers/infiniband/hw/mlx4/mr.c | 13 +++

[PATCH for-next 01/10] IB/mlx4_ib: Remove local invalidate segment unused fields

2013-02-06 Thread Or Gerlitz
From: Shani Michaeli Remove unused fields from the local invalidate WQE segment structure. Signed-off-by: Haggai Eran Signed-off-by: Shani Michaeli Signed-off-by: Or Gerlitz --- drivers/infiniband/hw/mlx4/qp.c |6 ++ include/linux/mlx4/qp.h |8 +++- 2 files changed, 5

Re: NFS over RDMA crashing

2013-02-06 Thread Steve Wise
On 2/6/2013 9:48 AM, Yan Burman wrote: When I moved to commit 79f77bf9a4e3dd5ead006b8f17e7c4ff07d8374e I was no longer getting the server crashes, so the reset of my tests were done using that point (it is somewhere in the middle of 3.7.0-rc2). +tom tucker I'd try going back a few kernels,

NFS over RDMA crashing

2013-02-06 Thread Yan Burman
Hi. I have been trying to create a setup with NFS/RDMA, but I am getting crashes. I am using Mellanox ConnectX 3 HCA with SRIOV enabled with two KVM VMs with RHEL 6.3 getting one VF each. My test case is trying to use one VM's storage from another using NFS over RDMA (192.168.20.210 server,

Re: "Virtual" ibnetdiscover command fails

2013-02-06 Thread Or Gerlitz
On 06/02/2013 12:40, Sebastian Riemer wrote: So if I don't use the unmaintained srptools to get the SRP connection strings but instead send them directly to the initiator to connect to the SRP target, then also SRP should be possible with the virtual GUID. Am I right? Basically YES, you can u

Re: "Virtual" ibnetdiscover command fails

2013-02-06 Thread Sebastian Riemer
On 06.02.2013 11:20, Or Gerlitz wrote: > On 06/02/2013 12:04, Mathis GAVILLON wrote: >> Just a last question : is that possible VFs lid to be different from >> PF one ? > > NO, we've implemented a "shared port" model, so all functions on the > same IB port use the same lid, each function has its o

Re: "Virtual" ibnetdiscover command fails

2013-02-06 Thread Sebastian Riemer
On 06.02.2013 10:22, Or Gerlitz wrote: > On 06/02/2013 11:17, Mathis GAVILLON wrote: >> Ok. But what is it possible to do with Infiniband VFs if QP0 is not >> available ? > > EVERYTHING, e.g run IPoIB, iSER, RDS, MPI, etc, etc - except for what > requires QP0, such as running SM or issuing SMPs fo

Re: "Virtual" ibnetdiscover command fails

2013-02-06 Thread Or Gerlitz
On 06/02/2013 12:04, Mathis GAVILLON wrote: Just a last question : is that possible VFs lid to be different from PF one ? NO, we've implemented a "shared port" model, so all functions on the same IB port use the same lid, each function has its own virtual GUID though. Or. Thanks 2013/2/

[ANNOUNCE] OpenSM tarball release

2013-02-06 Thread Alex Netes
Hi, There is a new release of OpenSM. Tarball available in: http://www.openfabrics.org/downloads/management/ (listed in http://www.openfabrics.org/downloads/management/latest.txt) md5sum: 32b16efbaba69d478f8c05df42ce0462 opensm-3.3.16.tar.gz All component versions are from recent master branc

Re: "Virtual" ibnetdiscover command fails

2013-02-06 Thread Mathis GAVILLON
> EVERYTHING, e.g run IPoIB, iSER, RDS, MPI, etc, etc - except for what > requires QP0, such as running SM or issuing SMPs for discovery/diagnostics > purposes Ok. I just begin with Infiniband technologie so I don't know everything about this yet. Thanks Mathis -- To unsubscribe from this list:

Re: "Virtual" ibnetdiscover command fails

2013-02-06 Thread Or Gerlitz
On 06/02/2013 11:17, Mathis GAVILLON wrote: Ok. But what is it possible to do with Infiniband VFs if QP0 is not available ? EVERYTHING, e.g run IPoIB, iSER, RDS, MPI, etc, etc - except for what requires QP0, such as running SM or issuing SMPs for discovery/diagnostics purposes 2013/2/5

Re: [PATCH for 3.8 v3, resend 0/3] IB/SRP patches for kernel 3.8

2013-02-06 Thread Or Gerlitz
On 06/02/2013 09:59, Bart Van Assche wrote: On 02/06/13 08:44, Or Gerlitz wrote: On 06/02/2013 09:22, Bart Van Assche wrote: A huge number of patches have been taken upstream between 3.8-rc1 and 3.8-rc6. I have retested these three patches with 3.8-rc6 and would appreciate if you would also re