Re: Building 3.1-rc9 in kernel infiniband support with OFED libraries

2011-10-17 Thread Wendy Cheng
On Fri, Oct 14, 2011 at 2:22 PM, Doug Ledford dledf...@redhat.com wrote: - Original Message - On Wed, Oct 12, 2011 at 9:32 AM, Wendy Cheng s.wendy.ch...@gmail.com wrote: The OFED package itself does include XRC support. The issue here (my guess) is that its build script needs to

Re: Building 3.1-rc9 in kernel infiniband support with OFED libraries

2011-10-14 Thread Doug Ledford
- Original Message - On Thu, Oct 13, 2011 at 10:24 AM, Christoph Lameter c...@gentwo.org wrote: Clean reviewed patches for this are where? They are in OFED-1.5.3.1 so they were already released. OFED is neither clean nor reviewed. Really. The stuff in OFED always needs a

Re: Building 3.1-rc9 in kernel infiniband support with OFED libraries

2011-10-13 Thread Roland Dreier
My latest patches are at:        git://git.openfabrics.org/~shefty/rdma-dev.git xrc So I went through this and merged it to my tree (pretty much only conflicts from 3.0-3.1-rc fixed, commit log changes and other minor cleanups). The result is pushed out to my github for-next branch, with the

Re: Building 3.1-rc9 in kernel infiniband support with OFED libraries

2011-10-13 Thread Christoph Lameter
On Thu, 13 Oct 2011, Roland Dreier wrote: My latest patches are at:        git://git.openfabrics.org/~shefty/rdma-dev.git xrc So I went through this and merged it to my tree (pretty much only conflicts from 3.0-3.1-rc fixed, commit log changes and other minor cleanups). We got the XRC

Re: Building 3.1-rc9 in kernel infiniband support with OFED libraries

2011-10-13 Thread Christoph Lameter
Oh yeah and can we can FDR support in for-next as well? -- To unsubscribe from this list: send the line unsubscribe linux-rdma in the body of a message to majord...@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html

Re: Building 3.1-rc9 in kernel infiniband support with OFED libraries

2011-10-13 Thread Roland Dreier
On Thu, Oct 13, 2011 at 10:17 AM, Christoph Lameter c...@gentwo.org wrote: There seems to be some stuff missing in the upstream code compared to the OFED releases: 1. Raw ethernet support (IB_QPT_RAW_ETH) is missing. 2. MLX4_IB_QP_BLOCK_LOOPBACK is broken it seems? All packets are fed back

Re: Building 3.1-rc9 in kernel infiniband support with OFED libraries

2011-10-13 Thread Christoph Lameter
On Thu, 13 Oct 2011, Roland Dreier wrote: On Thu, Oct 13, 2011 at 10:17 AM, Christoph Lameter c...@gentwo.org wrote: There seems to be some stuff missing in the upstream code compared to the OFED releases: 1. Raw ethernet support (IB_QPT_RAW_ETH) is missing. 2.

Re: Building 3.1-rc9 in kernel infiniband support with OFED libraries

2011-10-13 Thread Roland Dreier
On Thu, Oct 13, 2011 at 10:24 AM, Christoph Lameter c...@gentwo.org wrote: Clean reviewed patches for this are where? They are in OFED-1.5.3.1 so they were already released. OFED is neither clean nor reviewed. Really. The stuff in OFED always needs a bunch of review before it is suitable for

RE: Building 3.1-rc9 in kernel infiniband support with OFED libraries

2011-10-13 Thread Hefty, Sean
The result is pushed out to my github for-next branch, with the expectation that I'll ask Linus to pull for 3.2. Thanks - I'll take a look and test again. However I do have one question: the last patch (RDMA/uverbs: Export ib_open_qp() capability to user space in my tree) adds

Re: Building 3.1-rc9 in kernel infiniband support with OFED libraries

2011-10-13 Thread Christoph Lameter
On Thu, 13 Oct 2011, Roland Dreier wrote: On Thu, Oct 13, 2011 at 10:24 AM, Christoph Lameter c...@gentwo.org wrote: Clean reviewed patches for this are where? They are in OFED-1.5.3.1 so they were already released. OFED is neither clean nor reviewed. Really. The stuff in OFED always

Re: Building 3.1-rc9 in kernel infiniband support with OFED libraries

2011-10-13 Thread Roland Dreier
On Thu, Oct 13, 2011 at 10:31 AM, Hefty, Sean sean.he...@intel.com wrote: ib_open_qp() is implemented entirely in the verbs layer (verbs.c).  The OFED API compatibility support that I added to libibverbs makes use of this call, which I tested by running OSU's mvapich2. Wait, now I'm baffled

RE: Building 3.1-rc9 in kernel infiniband support with OFED libraries

2011-10-13 Thread Hefty, Sean
Wait, now I'm baffled by the patch (ie http://git.openfabrics.org/git?p=~shefty/rdma- dev.git;a=commitdiff;h=1ec4e62a6e967ddc258e7c4e674168debb727d39) I don't see anything that calls ib_uverbs_open_qp(). Am I missing something?? Does the OFED API compatibility actually call this function

Re: Building 3.1-rc9 in kernel infiniband support with OFED libraries

2011-10-13 Thread Roland Dreier
On Thu, Oct 13, 2011 at 11:32 AM, Hefty, Sean sean.he...@intel.com wrote: I'm confused now.  The patch definitely looks like it's missing a change to uverbs_main.c to setup the command table.  (I thought you were referring to needing a change to struct ib_device before.) Right, we need to

Re: Building 3.1-rc9 in kernel infiniband support with OFED libraries

2011-10-12 Thread Bart Van Assche
On Tue, Oct 11, 2011 at 7:39 PM, Jason Gunthorpe jguntho...@obsidianresearch.com wrote: On Tue, Oct 11, 2011 at 09:02:41AM -0500, Christoph Lameter wrote: Has XRC support not been merged? How can I build the OFED libraries against Linux 3.1? I'd really like to get rid of the OFED kernel tree

Re: Building 3.1-rc9 in kernel infiniband support with OFED libraries

2011-10-12 Thread Wendy Cheng
On Wed, Oct 12, 2011 at 3:41 AM, Bart Van Assche bvanass...@acm.org wrote: On Tue, Oct 11, 2011 at 7:39 PM, Jason Gunthorpe jguntho...@obsidianresearch.com wrote: On Tue, Oct 11, 2011 at 09:02:41AM -0500, Christoph Lameter wrote: Has XRC support not been merged? How can I build the OFED

RE: Building 3.1-rc9 in kernel infiniband support with OFED libraries

2011-10-12 Thread Hefty, Sean
Why is the OFED libibverbs library binary incompatible with the non-OFED libibverbs library ? Why hasn't XRC support been implemented in the OFED libibverbs library such that applications built against the upstream libibverbs headers also work with the latest OFED version of that library ?

Re: Building 3.1-rc9 in kernel infiniband support with OFED libraries

2011-10-12 Thread Roland Dreier
On Wed, Oct 12, 2011 at 9:32 AM, Wendy Cheng s.wendy.ch...@gmail.com wrote: The OFED package itself does include XRC support. The issue here (my guess) is that its build script needs to understand the running system's kernel version to decide what should be pulled (from the source). Linux 3.1

RE: Building 3.1-rc9 in kernel infiniband support with OFED libraries

2011-10-12 Thread Hefty, Sean
Did we every resolve the controversy about the rcv QPs with MPI users? The design seemed sane to me, but Yes - I believe so. Also (I'm sure you already posted this once, but...) Sean, do you have a git tree with all the kernel patches included? My latest patches are at:

Re: Building 3.1-rc9 in kernel infiniband support with OFED libraries

2011-10-12 Thread Roland Dreier
On Wed, Oct 12, 2011 at 9:46 AM, Hefty, Sean sean.he...@intel.com wrote: though this is based on 3.0. Thanks, that's fine. I don't think I merged many changes for 3.1 ;) - R. -- To unsubscribe from this list: send the line unsubscribe linux-rdma in the body of a message to

Re: Building 3.1-rc9 in kernel infiniband support with OFED libraries

2011-10-11 Thread Jason Gunthorpe
On Tue, Oct 11, 2011 at 09:02:41AM -0500, Christoph Lameter wrote: Has XRC support not been merged? How can I build the OFED libraries against Linux 3.1? I'd really like to get rid of the OFED kernel tree nightmare. You have to use upstream libraries with upstream kernels. Be warned that the

Re: Building 3.1-rc9 in kernel infiniband support with OFED libraries

2011-10-11 Thread Christoph Lameter
On Tue, 11 Oct 2011, Jason Gunthorpe wrote: On Tue, Oct 11, 2011 at 09:02:41AM -0500, Christoph Lameter wrote: Has XRC support not been merged? How can I build the OFED libraries against Linux 3.1? I'd really like to get rid of the OFED kernel tree nightmare. You have to use upstream