Re: [OMPI devel] OpenSHMEM up on bitbucket

2013-07-24 Thread Nathan Hjelm 
Its MAP_ANON on OS X... It works on Linux as well but it is marked deprecated.

-Nathan

On Wed, Jul 24, 2013 at 01:10:38PM +, Joshua Ladd wrote:
> Great feedback. Thanks, Jeff. We always compile on IB machines (in fact, no 
> one in MLNX has a Mac to test on OSX.) We appreciate the help!! We will 
> iterate on this.
> 
> Josh
> 
> -Original Message-
> From: devel-boun...@open-mpi.org [mailto:devel-boun...@open-mpi.org] On 
> Behalf Of Jeff Squyres (jsquyres)
> Sent: Wednesday, July 24, 2013 8:31 AM
> To: Open MPI Developers
> Subject: Re: [OMPI devel] OpenSHMEM up on bitbucket
> 
> In addition to the I-don't-have-verbs compile errors on my Mac, I also get 
> these:
> 
> base/memheap_base_alloc.c: In function '__shm_attach':
> base/memheap_base_alloc.c:216: error: 'SHM_HUGETLB' undeclared (first use in 
> this function)
> base/memheap_base_alloc.c:216: error: (Each undeclared identifier is reported 
> only once
> base/memheap_base_alloc.c:216: error: for each function it appears in.)
> base/memheap_base_alloc.c: In function '__mmap_attach':
> base/memheap_base_alloc.c:275: error: 'MAP_ANONYMOUS' undeclared (first use 
> in this function)
> make[2]: *** [base/memheap_base_alloc.lo] Error 1
> 
> 
> 
> On Jul 24, 2013, at 8:03 AM, Ralph Castain 
>  wrote:
> 
> > HI'm afraid this doesn't build for us folks that don't have IB on 
> > their system. From what I can see, it looks like you broke a fundamental 
> > abstraction layer rule by including a header from a component into a 
> > completely different component. That is definitely *not* allowed for 
> > precisely this reason.
> > 
> > In file included from ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:32,
> >  from ../../../oshmem/mca/spml/yoda/spml_yoda_rdmafrag.h:21,
> >  from ../../../oshmem/mca/spml/yoda/spml_yoda_putreq.h:19,
> >  from base/spml_base.c:19:
> > ../../../ompi/mca/btl/openib/btl_openib.h:34:30: error: 
> > infiniband/verbs.h: No such file or directory In file included from 
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:32,
> >  from ../../../oshmem/mca/spml/yoda/spml_yoda_rdmafrag.h:21,
> >  from ../../../oshmem/mca/spml/yoda/spml_yoda_putreq.h:19,
> >  from base/spml_base.c:19:
> > ../../../ompi/mca/btl/openib/btl_openib.h:374: error: field 
> > 'ib_dev_attr' has incomplete type In file included from 
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:32,
> >  from ../../../oshmem/mca/spml/yoda/spml_yoda_rdmafrag.h:21,
> >  from ../../../oshmem/mca/spml/yoda/spml_yoda_putreq.h:19,
> >  from base/spml_base.c:19:
> > ../../../ompi/mca/btl/openib/btl_openib.h:470: error: field 
> > 'ib_port_attr' has incomplete type In file included from 
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:33,
> >  from ../../../oshmem/mca/spml/yoda/spml_yoda_rdmafrag.h:21,
> >  from ../../../oshmem/mca/spml/yoda/spml_yoda_putreq.h:19,
> >  from base/spml_base.c:19:
> > ../../../ompi/mca/btl/openib/btl_openib_frag.h:306: error: field 
> > 'sg_entry' has incomplete type
> > ../../../ompi/mca/btl/openib/btl_openib_frag.h:318: error: field 
> > 'sr_desc' has incomplete type
> > ../../../ompi/mca/btl/openib/btl_openib_frag.h:345: error: field 
> > 'rd_desc' has incomplete type
> > ../../../ompi/mca/btl/openib/btl_openib_frag.h:359: error: field 
> > 'sr_desc' has incomplete type In file included from 
> > ../../../oshmem/mca/spml/yoda/spml_yoda_rdmafrag.h:21,
> >  from ../../../oshmem/mca/spml/yoda/spml_yoda_putreq.h:19,
> >  from base/spml_base.c:19:
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h: In function 
> > 'post_recvs':
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:367: error: 
> > dereferencing pointer to incomplete type
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:368: error: 
> > dereferencing pointer to incomplete type
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:368: error: 
> > dereferencing pointer to incomplete type
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:368: error: 
> > dereferencing pointer to incomplete type
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:368: error: 
> > dereferencing pointer to incomplete type
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:368: error: 
> > dereferencing pointer to incomplete type
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:376: error: 
> > dereferencing pointer to incomplete type
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:378: error: implicit 
> > declaration of function 'ibv_post_recv'
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h: In function 
> > 'ib_send_flags':
> > ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:515: error: 
> > 'IBV_SEND_SIGNALED' undeclared (first use in this function)
> >

Re: [OMPI devel] OpenSHMEM up on bitbucket

2013-07-24 Thread Ralph Castain 
FWIW: my report was from a non-IB Linux box.

On Jul 24, 2013, at 6:10 AM, Joshua Ladd  wrote:

> Great feedback. Thanks, Jeff. We always compile on IB machines (in fact, no 
> one in MLNX has a Mac to test on OSX.) We appreciate the help!! We will 
> iterate on this.
> 
> Josh
> 
> -Original Message-
> From: devel-boun...@open-mpi.org [mailto:devel-boun...@open-mpi.org] On 
> Behalf Of Jeff Squyres (jsquyres)
> Sent: Wednesday, July 24, 2013 8:31 AM
> To: Open MPI Developers
> Subject: Re: [OMPI devel] OpenSHMEM up on bitbucket
> 
> In addition to the I-don't-have-verbs compile errors on my Mac, I also get 
> these:
> 
> base/memheap_base_alloc.c: In function '__shm_attach':
> base/memheap_base_alloc.c:216: error: 'SHM_HUGETLB' undeclared (first use in 
> this function)
> base/memheap_base_alloc.c:216: error: (Each undeclared identifier is reported 
> only once
> base/memheap_base_alloc.c:216: error: for each function it appears in.)
> base/memheap_base_alloc.c: In function '__mmap_attach':
> base/memheap_base_alloc.c:275: error: 'MAP_ANONYMOUS' undeclared (first use 
> in this function)
> make[2]: *** [base/memheap_base_alloc.lo] Error 1
> 
> 
> 
> On Jul 24, 2013, at 8:03 AM, Ralph Castain 
> wrote:
> 
>> HI'm afraid this doesn't build for us folks that don't have IB on 
>> their system. From what I can see, it looks like you broke a fundamental 
>> abstraction layer rule by including a header from a component into a 
>> completely different component. That is definitely *not* allowed for 
>> precisely this reason.
>> 
>> In file included from ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:32,
>> from ../../../oshmem/mca/spml/yoda/spml_yoda_rdmafrag.h:21,
>> from ../../../oshmem/mca/spml/yoda/spml_yoda_putreq.h:19,
>> from base/spml_base.c:19:
>> ../../../ompi/mca/btl/openib/btl_openib.h:34:30: error: 
>> infiniband/verbs.h: No such file or directory In file included from 
>> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:32,
>> from ../../../oshmem/mca/spml/yoda/spml_yoda_rdmafrag.h:21,
>> from ../../../oshmem/mca/spml/yoda/spml_yoda_putreq.h:19,
>> from base/spml_base.c:19:
>> ../../../ompi/mca/btl/openib/btl_openib.h:374: error: field 
>> 'ib_dev_attr' has incomplete type In file included from 
>> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:32,
>> from ../../../oshmem/mca/spml/yoda/spml_yoda_rdmafrag.h:21,
>> from ../../../oshmem/mca/spml/yoda/spml_yoda_putreq.h:19,
>> from base/spml_base.c:19:
>> ../../../ompi/mca/btl/openib/btl_openib.h:470: error: field 
>> 'ib_port_attr' has incomplete type In file included from 
>> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:33,
>> from ../../../oshmem/mca/spml/yoda/spml_yoda_rdmafrag.h:21,
>> from ../../../oshmem/mca/spml/yoda/spml_yoda_putreq.h:19,
>> from base/spml_base.c:19:
>> ../../../ompi/mca/btl/openib/btl_openib_frag.h:306: error: field 
>> 'sg_entry' has incomplete type
>> ../../../ompi/mca/btl/openib/btl_openib_frag.h:318: error: field 
>> 'sr_desc' has incomplete type
>> ../../../ompi/mca/btl/openib/btl_openib_frag.h:345: error: field 
>> 'rd_desc' has incomplete type
>> ../../../ompi/mca/btl/openib/btl_openib_frag.h:359: error: field 
>> 'sr_desc' has incomplete type In file included from 
>> ../../../oshmem/mca/spml/yoda/spml_yoda_rdmafrag.h:21,
>> from ../../../oshmem/mca/spml/yoda/spml_yoda_putreq.h:19,
>> from base/spml_base.c:19:
>> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h: In function 'post_recvs':
>> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:367: error: 
>> dereferencing pointer to incomplete type
>> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:368: error: 
>> dereferencing pointer to incomplete type
>> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:368: error: 
>> dereferencing pointer to incomplete type
>> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:368: error: 
>> dereferencing pointer to incomplete type
>> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:368: error: 
>> dereferencing pointer to incomplete type
>> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:368: error: 
>> dereferencing pointer to incomplete type
>> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:376: error: 
>> dereferencing pointer to incomplete type
>> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:378: error: implicit 
>> declaration of function 'ibv_post_recv'
>> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h: In function 
>> 'ib_send_flags':
>> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:515: error: 
>> 'IBV_SEND_SIGNALED' undeclared (first use in this function)
>> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:515: error: (Each 
>> undeclared identifier is reported only once
>>

Re: [OMPI devel] OpenSHMEM up on bitbucket

2013-07-24 Thread Joshua Ladd 
Great feedback. Thanks, Jeff. We always compile on IB machines (in fact, no one 
in MLNX has a Mac to test on OSX.) We appreciate the help!! We will iterate on 
this.

Josh

-Original Message-
From: devel-boun...@open-mpi.org [mailto:devel-boun...@open-mpi.org] On Behalf 
Of Jeff Squyres (jsquyres)
Sent: Wednesday, July 24, 2013 8:31 AM
To: Open MPI Developers
Subject: Re: [OMPI devel] OpenSHMEM up on bitbucket

In addition to the I-don't-have-verbs compile errors on my Mac, I also get 
these:

base/memheap_base_alloc.c: In function '__shm_attach':
base/memheap_base_alloc.c:216: error: 'SHM_HUGETLB' undeclared (first use in 
this function)
base/memheap_base_alloc.c:216: error: (Each undeclared identifier is reported 
only once
base/memheap_base_alloc.c:216: error: for each function it appears in.)
base/memheap_base_alloc.c: In function '__mmap_attach':
base/memheap_base_alloc.c:275: error: 'MAP_ANONYMOUS' undeclared (first use in 
this function)
make[2]: *** [base/memheap_base_alloc.lo] Error 1



On Jul 24, 2013, at 8:03 AM, Ralph Castain 
 wrote:

> HI'm afraid this doesn't build for us folks that don't have IB on 
> their system. From what I can see, it looks like you broke a fundamental 
> abstraction layer rule by including a header from a component into a 
> completely different component. That is definitely *not* allowed for 
> precisely this reason.
> 
> In file included from ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:32,
>  from ../../../oshmem/mca/spml/yoda/spml_yoda_rdmafrag.h:21,
>  from ../../../oshmem/mca/spml/yoda/spml_yoda_putreq.h:19,
>  from base/spml_base.c:19:
> ../../../ompi/mca/btl/openib/btl_openib.h:34:30: error: 
> infiniband/verbs.h: No such file or directory In file included from 
> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:32,
>  from ../../../oshmem/mca/spml/yoda/spml_yoda_rdmafrag.h:21,
>  from ../../../oshmem/mca/spml/yoda/spml_yoda_putreq.h:19,
>  from base/spml_base.c:19:
> ../../../ompi/mca/btl/openib/btl_openib.h:374: error: field 
> 'ib_dev_attr' has incomplete type In file included from 
> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:32,
>  from ../../../oshmem/mca/spml/yoda/spml_yoda_rdmafrag.h:21,
>  from ../../../oshmem/mca/spml/yoda/spml_yoda_putreq.h:19,
>  from base/spml_base.c:19:
> ../../../ompi/mca/btl/openib/btl_openib.h:470: error: field 
> 'ib_port_attr' has incomplete type In file included from 
> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:33,
>  from ../../../oshmem/mca/spml/yoda/spml_yoda_rdmafrag.h:21,
>  from ../../../oshmem/mca/spml/yoda/spml_yoda_putreq.h:19,
>  from base/spml_base.c:19:
> ../../../ompi/mca/btl/openib/btl_openib_frag.h:306: error: field 
> 'sg_entry' has incomplete type
> ../../../ompi/mca/btl/openib/btl_openib_frag.h:318: error: field 
> 'sr_desc' has incomplete type
> ../../../ompi/mca/btl/openib/btl_openib_frag.h:345: error: field 
> 'rd_desc' has incomplete type
> ../../../ompi/mca/btl/openib/btl_openib_frag.h:359: error: field 
> 'sr_desc' has incomplete type In file included from 
> ../../../oshmem/mca/spml/yoda/spml_yoda_rdmafrag.h:21,
>  from ../../../oshmem/mca/spml/yoda/spml_yoda_putreq.h:19,
>  from base/spml_base.c:19:
> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h: In function 'post_recvs':
> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:367: error: 
> dereferencing pointer to incomplete type
> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:368: error: 
> dereferencing pointer to incomplete type
> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:368: error: 
> dereferencing pointer to incomplete type
> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:368: error: 
> dereferencing pointer to incomplete type
> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:368: error: 
> dereferencing pointer to incomplete type
> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:368: error: 
> dereferencing pointer to incomplete type
> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:376: error: 
> dereferencing pointer to incomplete type
> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:378: error: implicit 
> declaration of function 'ibv_post_recv'
> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h: In function 
> 'ib_send_flags':
> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:515: error: 
> 'IBV_SEND_SIGNALED' undeclared (first use in this function)
> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:515: error: (Each 
> undeclared identifier is reported only once
> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:515: error: for 
> each function it appears in.)
> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:516: error: 
> 'IBV_SEND_INLINE' undeclared (first use in this function)
>

Re: [OMPI devel] OpenSHMEM up on bitbucket

2013-07-24 Thread Ralph Castain 
I think this is going to need to be refactored, Josh. Looks to me like whoever 
wrote this "locked" it to IB. That's a problem for me, at least - I believe 
that OpenShmem should use the MPI transports, but respect the OMPI abstraction 
layer.

In other words, you should use the transports to move data around, but let the 
underlying abstractions choose how to do it. This would allow OpenShmem to run 
on top of any fabric, not just IB, which is the right way of doing things 
inside the OMPI code base.

Just my $0.02
Ralph

On Jul 24, 2013, at 5:03 AM, Ralph Castain  wrote:

> HI'm afraid this doesn't build for us folks that don't have IB on 
> their system. From what I can see, it looks like you broke a fundamental 
> abstraction layer rule by including a header from a component into a 
> completely different component. That is definitely *not* allowed for 
> precisely this reason.
> 
> In file included from ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:32,
>  from ../../../oshmem/mca/spml/yoda/spml_yoda_rdmafrag.h:21,
>  from ../../../oshmem/mca/spml/yoda/spml_yoda_putreq.h:19,
>  from base/spml_base.c:19:
> ../../../ompi/mca/btl/openib/btl_openib.h:34:30: error: infiniband/verbs.h: 
> No such file or directory
> In file included from ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:32,
>  from ../../../oshmem/mca/spml/yoda/spml_yoda_rdmafrag.h:21,
>  from ../../../oshmem/mca/spml/yoda/spml_yoda_putreq.h:19,
>  from base/spml_base.c:19:
> ../../../ompi/mca/btl/openib/btl_openib.h:374: error: field 'ib_dev_attr' has 
> incomplete type
> In file included from ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:32,
>  from ../../../oshmem/mca/spml/yoda/spml_yoda_rdmafrag.h:21,
>  from ../../../oshmem/mca/spml/yoda/spml_yoda_putreq.h:19,
>  from base/spml_base.c:19:
> ../../../ompi/mca/btl/openib/btl_openib.h:470: error: field 'ib_port_attr' 
> has incomplete type
> In file included from ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:33,
>  from ../../../oshmem/mca/spml/yoda/spml_yoda_rdmafrag.h:21,
>  from ../../../oshmem/mca/spml/yoda/spml_yoda_putreq.h:19,
>  from base/spml_base.c:19:
> ../../../ompi/mca/btl/openib/btl_openib_frag.h:306: error: field 'sg_entry' 
> has incomplete type
> ../../../ompi/mca/btl/openib/btl_openib_frag.h:318: error: field 'sr_desc' 
> has incomplete type
> ../../../ompi/mca/btl/openib/btl_openib_frag.h:345: error: field 'rd_desc' 
> has incomplete type
> ../../../ompi/mca/btl/openib/btl_openib_frag.h:359: error: field 'sr_desc' 
> has incomplete type
> In file included from ../../../oshmem/mca/spml/yoda/spml_yoda_rdmafrag.h:21,
>  from ../../../oshmem/mca/spml/yoda/spml_yoda_putreq.h:19,
>  from base/spml_base.c:19:
> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h: In function 'post_recvs':
> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:367: error: dereferencing 
> pointer to incomplete type
> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:368: error: dereferencing 
> pointer to incomplete type
> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:368: error: dereferencing 
> pointer to incomplete type
> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:368: error: dereferencing 
> pointer to incomplete type
> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:368: error: dereferencing 
> pointer to incomplete type
> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:368: error: dereferencing 
> pointer to incomplete type
> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:376: error: dereferencing 
> pointer to incomplete type
> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:378: error: implicit 
> declaration of function 'ibv_post_recv'
> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h: In function 
> 'ib_send_flags':
> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:515: error: 
> 'IBV_SEND_SIGNALED' undeclared (first use in this function)
> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:515: error: (Each 
> undeclared identifier is reported only once
> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:515: error: for each 
> function it appears in.)
> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:516: error: 
> 'IBV_SEND_INLINE' undeclared (first use in this function)
> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h: In function 'post_send':
> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:543: error: dereferencing 
> pointer to incomplete type
> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:546: error: dereferencing 
> pointer to incomplete type
> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:546: error: dereferencing 
> pointer to incomplete type
> ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:554: error: dereferencing 
> pointer to incomplete type
>

Re: [OMPI devel] OpenSHMEM up on bitbucket

2013-07-24 Thread Ralph Castain 
HI'm afraid this doesn't build for us folks that don't have IB on their 
system. From what I can see, it looks like you broke a fundamental abstraction 
layer rule by including a header from a component into a completely different 
component. That is definitely *not* allowed for precisely this reason.

In file included from ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:32,
 from ../../../oshmem/mca/spml/yoda/spml_yoda_rdmafrag.h:21,
 from ../../../oshmem/mca/spml/yoda/spml_yoda_putreq.h:19,
 from base/spml_base.c:19:
../../../ompi/mca/btl/openib/btl_openib.h:34:30: error: infiniband/verbs.h: No 
such file or directory
In file included from ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:32,
 from ../../../oshmem/mca/spml/yoda/spml_yoda_rdmafrag.h:21,
 from ../../../oshmem/mca/spml/yoda/spml_yoda_putreq.h:19,
 from base/spml_base.c:19:
../../../ompi/mca/btl/openib/btl_openib.h:374: error: field 'ib_dev_attr' has 
incomplete type
In file included from ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:32,
 from ../../../oshmem/mca/spml/yoda/spml_yoda_rdmafrag.h:21,
 from ../../../oshmem/mca/spml/yoda/spml_yoda_putreq.h:19,
 from base/spml_base.c:19:
../../../ompi/mca/btl/openib/btl_openib.h:470: error: field 'ib_port_attr' has 
incomplete type
In file included from ../../../ompi/mca/btl/openib/btl_openib_endpoint.h:33,
 from ../../../oshmem/mca/spml/yoda/spml_yoda_rdmafrag.h:21,
 from ../../../oshmem/mca/spml/yoda/spml_yoda_putreq.h:19,
 from base/spml_base.c:19:
../../../ompi/mca/btl/openib/btl_openib_frag.h:306: error: field 'sg_entry' has 
incomplete type
../../../ompi/mca/btl/openib/btl_openib_frag.h:318: error: field 'sr_desc' has 
incomplete type
../../../ompi/mca/btl/openib/btl_openib_frag.h:345: error: field 'rd_desc' has 
incomplete type
../../../ompi/mca/btl/openib/btl_openib_frag.h:359: error: field 'sr_desc' has 
incomplete type
In file included from ../../../oshmem/mca/spml/yoda/spml_yoda_rdmafrag.h:21,
 from ../../../oshmem/mca/spml/yoda/spml_yoda_putreq.h:19,
 from base/spml_base.c:19:
../../../ompi/mca/btl/openib/btl_openib_endpoint.h: In function 'post_recvs':
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:367: error: dereferencing 
pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:368: error: dereferencing 
pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:368: error: dereferencing 
pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:368: error: dereferencing 
pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:368: error: dereferencing 
pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:368: error: dereferencing 
pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:376: error: dereferencing 
pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:378: error: implicit 
declaration of function 'ibv_post_recv'
../../../ompi/mca/btl/openib/btl_openib_endpoint.h: In function 'ib_send_flags':
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:515: error: 
'IBV_SEND_SIGNALED' undeclared (first use in this function)
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:515: error: (Each undeclared 
identifier is reported only once
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:515: error: for each 
function it appears in.)
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:516: error: 
'IBV_SEND_INLINE' undeclared (first use in this function)
../../../ompi/mca/btl/openib/btl_openib_endpoint.h: In function 'post_send':
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:543: error: dereferencing 
pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:546: error: dereferencing 
pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:546: error: dereferencing 
pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:554: error: dereferencing 
pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:556: error: dereferencing 
pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:556: error: 
'IBV_WR_RDMA_WRITE' undeclared (first use in this function)
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:557: error: dereferencing 
pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:569: error: dereferencing 
pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:578: error: dereferencing 
pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:584: error: dereferencing 
pointer to incomplete type
../../../ompi/mca/btl/openib/btl_openib_endpoint.h:584: error: dereferencing 
pointer to incomplete type

Re: [OMPI devel] OpenSHMEM up on bitbucket

2013-07-24 Thread Ralph Castain 
I'm afraid Josh got bit by grabbing the wrong URL - here's the correct clone 
command for anyone not Josh:

git clone https://bitbucket.org/jladd_math/mlnx-oshmem.git


On Jul 23, 2013, at 6:43 AM, Joshua Ladd  wrote:

> Dear OMPI Developers,
>  
> I have put Mellanox OpenSHMEM up for review on my Bitbucket. Please “git” and 
> test at your leisure. Questions, comments, and critiques are most welcome.
>  
> git clone https://jladd_m...@bitbucket.org/jladd_math/mlnx-oshmem.git
>  
> To build with OSHMEM support, build as you would OMPI but simply include 
> ‘--with-oshmem’ on your configure line. This will get you started.
>  
> Best regards,
>  
> Josh
>  
>  
>  
> Joshua S. Ladd, PhD
> HPC Algorithms Engineer
> Mellanox Technologies
>  
> Email: josh...@mellanox.com
> Cell: +1 (865) 258 - 8898
>  
>  
> ___
> devel mailing list
> de...@open-mpi.org
> http://www.open-mpi.org/mailman/listinfo.cgi/devel

Re: [OMPI devel] Open-MPI build of NAMD launched from srun over 20% slowed than with mpirun

2013-07-24 Thread Christopher Samuel 
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On 24/07/13 09:42, Ralph Castain wrote:

> Not to 1.6 series, but it is in the about-to-be-released 1.7.3,
> and will be there from that point onwards.

Oh dear, I cannot delay this machine any more to change to 1.7.x. :-(

> Still waiting to see if it resolves the difference.

When I've got the current rush out of the way I'll try a private build
of 1.7 and see how that goes with NAMD.

cheers!
Chris
- -- 
 Christopher SamuelSenior Systems Administrator
 VLSCI - Victorian Life Sciences Computation Initiative
 Email: sam...@unimelb.edu.au Phone: +61 (0)3 903 55545
 http://www.vlsci.org.au/  http://twitter.com/vlsci

-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.11 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iEYEARECAAYFAlHvbl8ACgkQO2KABBYQAh9a6QCgi0HOHHV/opqjPq+Av+lTasaj
4OkAnA8i8ajZ9Umw7MoaH8qJbWBgFOAf
=p7Xl
-END PGP SIGNATURE-