Re: [OMPI devel] openmpi-1.7.2 fails to use the RDMACM CPC

2013-08-20 Thread Jeff Squyres (jsquyres)
On Aug 20, 2013, at 12:57 PM, Steve Wise wrote: > You won't let me forget. ;) I will do it. Awesome, thanks. >> Specifically: At some point iWARP support will break because we'll be >> removing >> ompi/mca/btl/openib/cpc and exclusively using ompi/mca/common/ofacm. > > When is this going to

Re: [OMPI devel] openmpi-1.7.2 fails to use the RDMACM CPC

2013-08-20 Thread Steve Wise
> > Don't forget that Chelsio is still on the hook for adding iWARP support into ompi/mca/common/ofacm, > however. :-) > You won't let me forget. ;) I will do it. > Specifically: At some point iWARP support will break because we'll be removing > ompi/mca/btl/openib/cpc and exclusively using om

Re: [OMPI devel] openmpi-1.7.2 fails to use the RDMACM CPC

2013-08-20 Thread Jeff Squyres (jsquyres)
On Aug 20, 2013, at 12:08 PM, Steve Wise wrote: >> Thank you for tracking this down! > > U R welcome. :) Don't forget that Chelsio is still on the hook for adding iWARP support into ompi/mca/common/ofacm, however. :-) Specifically: At some point iWARP support will break because we'll be rem

Re: [OMPI devel] openmpi-1.7.2 fails to use the RDMACM CPC

2013-08-20 Thread Steve Wise
> -Original Message- > From: Jeff Squyres (jsquyres) [mailto:jsquy...@cisco.com] > Sent: Tuesday, August 20, 2013 11:07 AM > To: Steve Wise > Cc: Open MPI Developers; Indranil Choudhury > Subject: Re: [OMPI devel] openmpi-1.7.2 fails to use the RDMACM CPC > > I t

Re: [OMPI devel] openmpi-1.7.2 fails to use the RDMACM CPC

2013-08-20 Thread Jeff Squyres (jsquyres)
(HAVE_IBV_LINK_LAYER_ETHERNET) > +#if defined(HAVE_DECL_IBV_LINK_LAYER_ETHERNET) > else if (flags & OMPI_COMMON_VERBS_FLAGS_LINK_LAYER_IB) { > if (IBV_LINK_LAYER_INFINIBAND == port_attr.link_layer) { > want = true; > > > >

Re: [OMPI devel] openmpi-1.7.2 fails to use the RDMACM CPC

2013-08-20 Thread Steve Wise
open-mpi.org] On Behalf Of Steve Wise > Sent: Tuesday, August 20, 2013 9:25 AM > To: 'Open MPI Developers'; 'Jeff Squyres (jsquyres)' > Cc: 'Indranil Choudhury' > Subject: Re: [OMPI devel] openmpi-1.7.2 fails to use the RDMACM CPC > > > Ah: >

Re: [OMPI devel] openmpi-1.7.2 fails to use the RDMACM CPC

2013-08-20 Thread Steve Wise
uyres (jsquyres)' > Cc: 'Open MPI Developers'; 'Indranil Choudhury' > Subject: Re: [OMPI devel] openmpi-1.7.2 fails to use the RDMACM CPC > > > > > -Original Message- > > From: Jeff Squyres (jsquyres) [mailto:jsquy...@cisco.com] > > Sen

Re: [OMPI devel] openmpi-1.7.2 fails to use the RDMACM CPC

2013-08-20 Thread Jeff Squyres (jsquyres)
On Aug 20, 2013, at 10:06 AM, Steve Wise wrote: > What is the correct fix then? I've never worked with any of this AC stuff... > > With the existing code (prior to my broken fix), HAVE_IBV_LINK_LAYER_ETHERNET > does not get defined. > Yet the enum and the link_type field are in verbs.h... Wh

Re: [OMPI devel] openmpi-1.7.2 fails to use the RDMACM CPC

2013-08-20 Thread Steve Wise
> -Original Message- > From: Jeff Squyres (jsquyres) [mailto:jsquy...@cisco.com] > Sent: Tuesday, August 20, 2013 8:59 AM > To: Steve Wise > Cc: Open MPI Developers; Indranil Choudhury > Subject: Re: [OMPI devel] openmpi-1.7.2 fails to use the RDMACM CPC > > On

Re: [OMPI devel] openmpi-1.7.2 fails to use the RDMACM CPC

2013-08-20 Thread Jeff Squyres (jsquyres)
On Aug 20, 2013, at 9:51 AM, Steve Wise wrote: > I checked in the correct fix, Er, no. Please re-read my email -- your fix was incorrect (you're overriding the output of an AC macro). :-) -- Jeff Squyres jsquy...@cisco.com For corporate legal information go to: http://www.cisco.com/web/abo

Re: [OMPI devel] openmpi-1.7.2 fails to use the RDMACM CPC

2013-08-20 Thread Steve Wise
> Thanks for finding r27212. It was about a year ago, and had clearly fallen > out of my cache (I have very > little to do with the openib BTL these days). > > Your solution isn't correct, because HAVE_IBV_LINK_LAYER_ETHERNET is defined > (nor not) via this m4 > macro in config/ompi_check_ope

Re: [OMPI devel] openmpi-1.7.2 fails to use the RDMACM CPC

2013-08-19 Thread Jeff Squyres (jsquyres)
Steve Wise wrote: > > >> -Original Message- >> From: Steve Wise [mailto:sw...@opengridcomputing.com] >> Sent: Monday, August 19, 2013 4:02 PM >> To: 'Open MPI Developers'; 'Jeff Squyres (jsquyres)' >> Cc: 'Indranil Choudhury' &

Re: [OMPI devel] openmpi-1.7.2 fails to use the RDMACM CPC

2013-08-19 Thread Steve Wise
> -Original Message- > From: Steve Wise [mailto:sw...@opengridcomputing.com] > Sent: Monday, August 19, 2013 4:02 PM > To: 'Open MPI Developers'; 'Jeff Squyres (jsquyres)' > Cc: 'Indranil Choudhury' > Subject: RE: [OMPI devel] openmp

Re: [OMPI devel] openmpi-1.7.2 fails to use the RDMACM CPC

2013-08-19 Thread Steve Wise
field in the ibv_port_attr structure. > -Original Message- > From: Steve Wise [mailto:sw...@opengridcomputing.com] > Sent: Monday, August 19, 2013 3:53 PM > To: 'Open MPI Developers'; 'Jeff Squyres (jsquyres)' > Cc: 'Indranil Choudhury' > Sub

Re: [OMPI devel] openmpi-1.7.2 fails to use the RDMACM CPC

2013-08-19 Thread Steve Wise
This patch fixes iwarp. dunno if it breaks RoCE though :) [root@r9 ompi-trunk]# svn diff Index: ompi/mca/btl/openib/connect/btl_openib_connect_oob.c === --- ompi/mca/btl/openib/connect/btl_openib_connect_oob.c(revision 290

Re: [OMPI devel] openmpi-1.7.2 fails to use the RDMACM CPC

2013-08-19 Thread Steve Wise
gt; > > wrote: > > > > > > >> -Original Message- > > > >> From: devel [mailto:devel-boun...@open-mpi.org] On Behalf Of Steve Wise > > > >> Sent: Monday, August 19, 2013 2:42 PM > > > >> To: 'Open MPI

Re: [OMPI devel] openmpi-1.7.2 fails to use the RDMACM CPC

2013-08-19 Thread Steve Wise
> -Original Message- > From: Steve Wise [mailto:sw...@opengridcomputing.com] > Sent: Monday, August 19, 2013 3:25 PM > To: 'Jeff Squyres (jsquyres)' > Cc: 'Open MPI Developers'; 'Indranil Choudhury' > Subject: RE: [OMPI

Re: [OMPI devel] openmpi-1.7.2 fails to use the RDMACM CPC

2013-08-19 Thread Steve Wise
> -Original Message- > From: Jeff Squyres (jsquyres) [mailto:jsquy...@cisco.com] > Sent: Monday, August 19, 2013 3:23 PM > To: Steve Wise > Cc: Open MPI Developers; Indranil Choudhury > Subject: Re: [OMPI devel] openmpi-1.7.2 fails to use the RDMACM CPC > > No

Re: [OMPI devel] openmpi-1.7.2 fails to use the RDMACM CPC

2013-08-19 Thread Jeff Squyres (jsquyres)
t 19, 2013 2:42 PM >> To: 'Open MPI Developers'; 'Jeff Squyres (jsquyres)' >> Cc: 'Indranil Choudhury' >> Subject: Re: [OMPI devel] openmpi-1.7.2 fails to use the RDMACM CPC >> >> I confirmed that this is a regression from 1.7.1... >> &

Re: [OMPI devel] openmpi-1.7.2 fails to use the RDMACM CPC

2013-08-19 Thread Steve Wise
> -Original Message- > From: devel [mailto:devel-boun...@open-mpi.org] On Behalf Of Steve Wise > Sent: Monday, August 19, 2013 2:42 PM > To: 'Open MPI Developers'; 'Jeff Squyres (jsquyres)' > Cc: 'Indranil Choudhury' > Subject: Re: [OMPI

Re: [OMPI devel] openmpi-1.7.2 fails to use the RDMACM CPC

2013-08-19 Thread Steve Wise
jsquyres)' > Cc: de...@open-mpi.org; 'Indranil Choudhury' > Subject: Re: [OMPI devel] openmpi-1.7.2 fails to use the RDMACM CPC > > > > > -Original Message- > > From: Jeff Squyres (jsquyres) [mailto:jsquy...@cisco.com] > > Sent: Monday, August 1

Re: [OMPI devel] openmpi-1.7.2 fails to use the RDMACM CPC

2013-08-19 Thread Steve Wise
> -Original Message- > From: Jeff Squyres (jsquyres) [mailto:jsquy...@cisco.com] > Sent: Monday, August 19, 2013 12:06 PM > To: Steve Wise > Cc: > Subject: Re: openmpi-1.7.2 fails to use the RDMACM CPC > > Not offhand. > > Given the lack of iWARP testing in the community, it's not enti

Re: [OMPI devel] openmpi-1.7.2 fails to use the RDMACM CPC

2013-08-19 Thread Jeff Squyres (jsquyres)
Not offhand. Given the lack of iWARP testing in the community, it's not entirely unsurprising that this broke. Will Chelsio setup some Open MPI + MTT to track this kind of stuff regularly? On Aug 19, 2013, at 10:57 AM, Steve Wise wrote: > Hello, > > I just tried to run openmpi-1.7.2 over c

Re: [OMPI devel] openmpi-1.7.2 fails to use the RDMACM CPC

2013-08-19 Thread Ralph Castain
I know that some of the connect codes moved to the new ompi/mca/common/ofacm area, and that *might* have come over to the 1.7 branch. Not sure of the status of the selection code On Aug 19, 2013, at 7:57 AM, Steve Wise wrote: > Hello, > > I just tried to run openmpi-1.7.2 over chelsio's IWAR

[OMPI devel] openmpi-1.7.2 fails to use the RDMACM CPC

2013-08-19 Thread Steve Wise
Hello, I just tried to run openmpi-1.7.2 over chelsio's IWARP device, and it no longer works. It appears that 1.7.2 fails to use the RDMACM CPC. I guess it is trying to use OOB, which is IB-specific. If I explicitly specify the RDMACM CPC via '--mca btl_openib_cpc_include rdmacm' then it wor