Re: [OMPI devel] OpenIB compile error

2012-06-25 Thread TERRY DONTJE
On 6/25/2012 10:12 AM, Jeff Squyres wrote: On Jun 25, 2012, at 5:44 AM, TERRY DONTJE wrote: Hmmm, I guess I could see the thinking of tying ofud and openib btls configuring together. However it seems inconsistent to me that one btl doesn't allow you to control configuring it in or not dire

Re: [OMPI devel] OpenIB compile error

2012-06-25 Thread Jeff Squyres
On Jun 25, 2012, at 5:44 AM, TERRY DONTJE wrote: > Hmmm, I guess I could see the thinking of tying ofud and openib btls > configuring together. However it seems inconsistent to me that one btl > doesn't allow you to control configuring it in or not directly. What if I > really do not want to

Re: [OMPI devel] OpenIB compile error

2012-06-25 Thread TERRY DONTJE
On 6/23/2012 6:32 AM, Jeff Squyres wrote: On Jun 22, 2012, at 11:26 PM, TERRY DONTJE wrote: 4. The behavior of --with[out]-verbs is as was described in a prior mail: - if --with-verbs is specified, all 3 verbs-based components must succeed - if --without-verbs is specified, all 4 verbs-

Re: [OMPI devel] OpenIB compile error

2012-06-23 Thread Jeff Squyres
On Jun 22, 2012, at 11:26 PM, TERRY DONTJE wrote: >> 4. The behavior of --with[out]-verbs is as was described in a prior mail: >> - if --with-verbs is specified, all 3 verbs-based components must succeed >> - if --without-verbs is specified, all 4 verbs-based components will not >> build >>

Re: [OMPI devel] OpenIB compile error

2012-06-22 Thread TERRY DONTJE
On 6/22/2012 3:36 PM, Jeff Squyres wrote: To update everyone: there was much more discussion about this off-list. :-) We decided to do the following: 1. The name --with-verbs seems better than --with-openfabrics, if for no other reason than the name "openfabrics" encompasses more things tha

Re: [OMPI devel] OpenIB compile error

2012-06-22 Thread Jeff Squyres
To update everyone: there was much more discussion about this off-list. :-) We decided to do the following: 1. The name --with-verbs seems better than --with-openfabrics, if for no other reason than the name "openfabrics" encompasses more things than we intend with this name (e.g., udapl, psm,

Re: [OMPI devel] OpenIB compile error

2012-06-21 Thread Jeff Squyres
On Jun 21, 2012, at 1:54 PM, Shamis, Pavel wrote: > About naming - I would agree with Terry, it makes sense to name it after > network API used for this btl - "verbs" (it is not obverts). I don't think that "verbs" is terrible, but I think that "openfabrics" has more user-level recognition. Fo

Re: [OMPI devel] OpenIB compile error

2012-06-21 Thread Jeff Squyres
On Jun 21, 2012, at 11:10 AM, Shamis, Pavel wrote: > OpenIB BTL is the primary source cause for existence of the OOB UD component. Err.. I'm confused. These are two unrelated things. I.e., there's no reason to think that OOB and MPI transport/protocol types are related. Indeed, we've been usi

Re: [OMPI devel] OpenIB compile error

2012-06-21 Thread Shamis, Pavel
BTW, if people want to rename openib btl to something else and then change the configure scripts - I'm ok. About naming - I would agree with Terry, it makes sense to name it after network API used for this btl - "verbs" (it is not ibverbs). Bottom line, I would recommend to keep configure option

Re: [OMPI devel] OpenIB compile error

2012-06-21 Thread Shamis, Pavel
> On Jun 20, 2012, at 4:25 PM, Shamis, Pavel wrote: > >> I hate it ... >> >> As far as I understand it is not reason to rename it. The OFED-lovin >> components should look at $with_openib. > > Ah, sorry -- I didn't think this would be controversial. It is not controversial. The "hate" was onl

Re: [OMPI devel] OpenIB compile error

2012-06-21 Thread Jeff Squyres
On Jun 21, 2012, at 9:16 AM, Jeff Squyres wrote: > 2. Have consistent behavior between the configury of all OFED-lovin' > components (currently the 4 I listed), per your description: > * --with-openfabrics[=DIR] means that all OFED-lovin' components must > configure successfully, or fail > *

Re: [OMPI devel] OpenIB compile error

2012-06-21 Thread Jeff Squyres
On Jun 21, 2012, at 9:06 AM, TERRY DONTJE wrote: > Ok, I think it is starting to sink in. the --with-openfabrics isn't > declaring that one builds the openib btl but that the openfabrics stack is > available to be used by any of the components that requires that stack (like > the list above).

Re: [OMPI devel] OpenIB compile error

2012-06-21 Thread TERRY DONTJE
On 6/21/2012 8:52 AM, Jeff Squyres wrote: On Jun 21, 2012, at 8:40 AM, TERRY DONTJE wrote: So you specify --with-ofed and you get mca_btl_openib generated? ICK!!! I think that will just make things more confusing. I am against this unless you change the btl name. We already have this si

Re: [OMPI devel] OpenIB compile error

2012-06-21 Thread Jeff Squyres
On Jun 21, 2012, at 8:40 AM, TERRY DONTJE wrote: > So you specify --with-ofed and you get mca_btl_openib generated? ICK!!! I > think that will just make things more confusing. I am against this unless > you change the btl name. We already have this situation. There are 4 components that use

Re: [OMPI devel] OpenIB compile error

2012-06-21 Thread TERRY DONTJE
On 6/21/2012 6:38 AM, Jeff Squyres wrote: On Jun 21, 2012, at 6:11 AM, TERRY DONTJE wrote: As far as I understand it is not reason to rename it. The OFED-lovin components should look at $with_openib. I agree with Pasha that the reason you give for renaming openib btl seem orthogonal to re

Re: [OMPI devel] OpenIB compile error

2012-06-21 Thread Jeff Squyres
On Jun 21, 2012, at 6:11 AM, TERRY DONTJE wrote: >>> As far as I understand it is not reason to rename it. The OFED-lovin >>> components should look at $with_openib. >>> > I agree with Pasha that the reason you give for renaming openib btl seem > orthogonal to renaming the btl. Note that I'm

Re: [OMPI devel] OpenIB compile error

2012-06-21 Thread TERRY DONTJE
On 6/20/2012 5:02 PM, Jeff Squyres wrote: On Jun 20, 2012, at 4:25 PM, Shamis, Pavel wrote: I hate it ... As far as I understand it is not reason to rename it. The OFED-lovin components should look at $with_openib. I agree with Pasha that the reason you give for renaming openib btl seem or

Re: [OMPI devel] OpenIB compile error

2012-06-20 Thread Jeff Squyres
On Jun 20, 2012, at 4:25 PM, Shamis, Pavel wrote: > I hate it ... > > As far as I understand it is not reason to rename it. The OFED-lovin > components should look at $with_openib. Ah, sorry -- I didn't think this would be controversial. Just curious: why do you hate it? OpenIB is a name that

Re: [OMPI devel] OpenIB compile error

2012-06-20 Thread Shamis, Pavel
I hate it ... As far as I understand it is not reason to rename it. The OFED-lovin components should look at $with_openib. Pavel (Pasha) Shamis --- Application Performance Tools Group Computer Science and Math Division Oak Ridge National Laboratory On Jun 20, 2012, at 4:09 PM, Jeff Squyre

Re: [OMPI devel] OpenIB compile error

2012-06-20 Thread Jeff Squyres
Brian and I talked about this more off list and figured out the problem. The issue is that Brian has OFED installed in a non-standard location, so he specified --with-openib=/path/to/ofed. The openib BTL therefore knows where OFED (and verbs.h) is installed, but other OFED-lovin' components do

Re: [OMPI devel] OpenIB compile error

2012-06-20 Thread Jeff Squyres
On Jun 20, 2012, at 1:18 PM, Barrett, Brian W wrote: > I'm seeing the compile error with the OMPI trunk and OFED 15.3.1. Has > anyone seen this before? I have vague recollections of seeing e-mail > discussion on the issue, but can't find those e-mails now... I know what this is -- see below. >