Re: [OMPI devel] Open MPI + HWLOC + Static build issue

2011-08-03 Thread Jeff Squyres
On Aug 3, 2011, at 6:58 PM, Shamis, Pavel wrote: > 1. We do not have libnuma.a in our setup. So if you want to reproduce the > problem, I would suggest to move it to some .bk. I don't have it, either. > 2. Build open mpi > ./configure --enable-static --disable-shared > --with-wrapper-ldflag

Re: [OMPI devel] Open MPI + HWLOC + Static build issue

2011-08-03 Thread Shamis, Pavel
Jeff, 1. We do not have libnuma.a in our setup. So if you want to reproduce the problem, I would suggest to move it to some .bk. 2. Build open mpi ./configure --enable-static --disable-shared --with-wrapper-ldflags=-static --disable-dlopen --enable-contrib-no-build=vt and make -j 8 orted_L

Re: [OMPI devel] Open MPI + HWLOC + Static build issue

2011-08-03 Thread Brice Goglin
Le 03/08/2011 20:37, Jeff Squyres a écrit : > > Shouldn't you pass the same LDFLAGS to configure as to make? I'd be happy if it worked :) Actually, I'd be even more happy if Pavel didn't have to do this to build a fully-static orted. > I.e., if you tell configure "configure it way" but then yo

Re: [OMPI devel] Open MPI + HWLOC + Static build issue

2011-08-03 Thread Jeff Squyres
On Aug 3, 2011, at 12:18 PM, Brice Goglin wrote: > I reproduced here on SLES10 with >./configure --enable-static --disable-shared > --with-wrapper-ldflags=-static --disable-dlopen --enable-contrib-no-build=vt > and >make -j 8 orted_LDFLAGS=-all-static all Shouldn't you pass the same LDFLA

Re: [OMPI devel] Open MPI + HWLOC + Static build issue

2011-08-03 Thread Jeff Squyres
On Aug 3, 2011, at 12:18 PM, Brice Goglin wrote: > Sorry, I mixed LDFLAGS=-static (works in hwloc) and > --with-wrapper-ldflags=-static (don't know what it exactly does in OMPI, > but -static doesn't get passed to hwloc checks) indeed FYI -- with-wrapper-ldflags is defined here: http://www.open-

Re: [OMPI devel] Open MPI + HWLOC + Static build issue

2011-08-03 Thread Jeff Squyres
On Aug 3, 2011, at 12:59 PM, Barrett, Brian W wrote: >> Not only. We also need orted and all the friends as static binaries. > > On linux, you can not use both the memory manager hooks and -static. Add > --disable-memory-manager or remove -static and all will be well. Right -- I was just using

Re: [OMPI devel] Open MPI + HWLOC + Static build issue

2011-08-03 Thread Shamis, Pavel
> > I get static binaries on SLES11 with > ./configure --enable-static --disable-shared LDFLAGS=-static > and > make LDFLAGS=-all-static LIBS=-lpthread > > $ ldd utils/lstopo > not a dynamic executable > $ utils/lstopo > Machine (24GB) > [...] > > No problem with libnuma here, it was

Re: [OMPI devel] Open MPI + HWLOC + Static build issue

2011-08-03 Thread Barrett, Brian W
On 8/3/11 10:51 AM, "Shamis, Pavel" wrote: >> >> Err.. I don't quite understand. How exactly are you configuring? If I >>do this: >> >> ./configure --prefix=/home/jsquyres/bogus --disable-mpi-f77 >>--disable-vt -- >> disable-io-romio --disable-mpi-cxx --disable-shared --enable-static >>--enab

Re: [OMPI devel] Open MPI + HWLOC + Static build issue

2011-08-03 Thread Shamis, Pavel
> > Err.. I don't quite understand. How exactly are you configuring? If I do > this: > > ./configure --prefix=/home/jsquyres/bogus --disable-mpi-f77 --disable-vt -- > disable-io-romio --disable-mpi-cxx --disable-shared --enable-static --enable- > mpirun-prefix-by-default LDFLAGS=-static > > I

Re: [OMPI devel] Open MPI + HWLOC + Static build issue

2011-08-03 Thread Brice Goglin
Le 03/08/2011 18:24, Shamis, Pavel a écrit : > Hw-loc vanilla works, because static mode does not build the binaries > in static mode. If you would try to build build hwloc utilities in > static mode it fails , just like ompi. I get static binaries on SLES11 with ./configure --enable-static --

Re: [OMPI devel] Open MPI + HWLOC + Static build issue

2011-08-03 Thread Shamis, Pavel
Please see my comments below. > -Original Message- > From: Brice Goglin [mailto:brice.gog...@inria.fr] > Sent: Wednesday, August 03, 2011 10:29 AM > To: Shamis, Pavel > Cc: Open MPI Developers > Subject: Re: [OMPI devel] Open MPI + HWLOC + Static build issue > > I finally reproduced here.

Re: [OMPI devel] Open MPI + HWLOC + Static build issue

2011-08-03 Thread Brice Goglin
Le 03/08/2011 16:47, Jeff Squyres a écrit : > Err.. I don't quite understand. How exactly are you configuring? If I > do this: He's using contrib/platform/ornl/ornl_configure_self_contained I reproduced here on SLES10 with ./configure --enable-static --disable-shared --with-wrapper-ldflags=-s

Re: [OMPI devel] Open MPI + HWLOC + Static build issue

2011-08-03 Thread Jeff Squyres
Ah! Brice's email crossed mine in the ether... On Aug 3, 2011, at 10:29 AM, Brice Goglin wrote: > I finally reproduced here. Based on the ornl platform script, you're > configuring with LDFLAGS=-static and then building with make > LDFLAGS=-all-static. Surprisingly, this works fine when buildin

Re: [OMPI devel] Open MPI + HWLOC + Static build issue

2011-08-03 Thread Jeff Squyres
Pasha -- I'm having trouble reproducing this. My system (RHEL5) has libnuma.so and no libnuma.a, but when I configure with: ./configure --disable-shared --enable-static ... Everything works fine. hwloc doesn't specifically look for libnuma.a or libnuma.so -- it just tries to link with -l

Re: [OMPI devel] Open MPI + HWLOC + Static build issue

2011-08-03 Thread Brice Goglin
I finally reproduced here. Based on the ornl platform script, you're configuring with LDFLAGS=-static and then building with make LDFLAGS=-all-static. Surprisingly, this works fine when building vanilla hwloc, but it breaks inside OMPI. The reason is that OMPI doesn't pass LDFLAGS=-static to hwloc'

Re: [OMPI devel] MXM question

2011-08-03 Thread Jeff Squyres
On Aug 3, 2011, at 1:20 AM, Mike Dubman wrote: > yes, it is for Infiniband only > > If OMPI was compiled with mxm support - it will be always selected. (same > selection logic as for other MTL components) That's not quite right for 2 reasons: 1. The other MTL's test their underlying init funct

Re: [OMPI devel] MXM question

2011-08-03 Thread Mike Dubman
yes, it is for Infiniband only If OMPI was compiled with mxm support - it will be always selected. (same selection logic as for other MTL components) It should be explicitly disabled to fall back into PML. On Tue, Aug 2, 2011 at 10:29 PM, Jeff Squyres wrote: > Is MXM for InfiniBand only? > > E.