Re: [OMPI users] Unable to compile for libnumactl and libnumactl-devel

2015-11-03 Thread Fabian Wein
On 11/03/2015 06:13 PM, Dave Love wrote: Fabian Wein writes: There is an old OpenFOAM installation which includes and old open-mpi, this might cause the trouble. OpenFOAM should definitely be built against the system MPI (and, in general, you should avoid bundled libraries wherever possible

Re: [OMPI users] Unable to compile for libnumactl and libnumactl-devel

2015-11-02 Thread Fabian Wein
> Am 02.11.2015 um 15:58 schrieb Dave Love : > > Fabian Wein writes: > >>> Am 30.10.2015 um 21:45 schrieb Jeff Squyres (jsquyres) : >>> >>> Oh, that's an interesting idea: perhaps the "bind to numa" is >>> failing -- but perhaps &

Re: [OMPI users] Unable to compile for libnumactl and libnumactl-devel

2015-10-31 Thread Fabian Wein
_base_binding_policy=socket The deprecated forms *will* disappear in a future version of Open MPI. Please update to the new syntax. -- leo leo leo leo > > > >> On Oct 30, 2015, at 12:02 PM, Fabian Wein

Re: [OMPI users] Unable to compile for libnumactl and libnumactl-devel

2015-10-30 Thread Fabian Wein
On 10/30/2015 04:09 PM, Ralph Castain wrote: I think Dave has probably hit the problem - that node may well not have a “numa” object. You also might check that node “leo” has libnuma on it I have a shared memory system, I run on the machine I build the stuff. Fabian

Re: [OMPI users] Unable to compile for libnumactl and libnumactl-devel

2015-10-30 Thread Fabian Wein
On 10/30/2015 02:48 PM, Dave Love wrote: Fabian Wein writes: Is this a valid test? /opt/openmpi-1.10.0-gcc/bin/mpiexec -n 4 hostname leo leo leo leo So, unless you turned off the default binding -- to socket? check the mpirun man page -- it worked, but the "numa" level failed

Re: [OMPI users] Unable to compile for libnumactl and libnumactl-devel

2015-10-30 Thread Fabian Wein
On 10/30/2015 02:26 AM, Jeff Squyres (jsquyres) wrote: Your Open MPI build looks good -- it seems to have found all the right libnuma stuff during configured, etc. The error message you're seeing indicates that the embedded hwloc is telling Open MPI that it doesn't have binding support, which

Re: [OMPI users] Unable to compile for libnumactl and libnumactl-devel

2015-10-29 Thread Fabian Wein
On 10/29/2015 09:29 PM, Dave Love wrote: I guess the problem is not having hwloc/libnuma1 on the compute host, as opposed to the build host. Test like this on the host, though the component name may be different in 1.10: I Have shared-memory system (4 package opteron, 8 numa nodes, 48 cores),

Re: [OMPI users] Unable to compile for libnumactl and libnumactl-devel

2015-10-29 Thread Fabian Wein
If your hwloc was built without libnuma support, you will get the following error: $ hwloc-bind --membind node:0 -- echo foo hwloc_set_membind 0x000f failed (errno 38 Function not implemented) Some days ago I installed hwloc and observed "libnuma memory support: no". Then I installed libn

Re: [OMPI users] Unable to compile for libnumactl and libnumactl-devel

2015-10-29 Thread Fabian Wein
If you're compiling Open MPI from source, you need the -devel package so that the libnuma header files are installed (and therefore Open MPI [i.e., the hwloc embedded in Open MPI] can include those header files and then compile support for libnuma). Can I also test the numa capability via a

Re: [OMPI users] Unable to compile for libnumactl and libnumactl-devel

2015-10-29 Thread Fabian Wein
Is there any hint in the configure output? Yes. Please send all the info listed here: http://www.open-mpi.org/community/help/ I attached the files. I built it again, this time with gcc instead of intel This is how I call mpiexec to make sure I get the right one make MPIEXEC="/opt/o

Re: [OMPI users] Unable to compile for libnumactl and libnumactl-devel

2015-10-29 Thread Fabian Wein
to /home/fwein/tmp/numactl-2.0.9/numa.h Is there any hint in the configure output? Thanks! Fabian On Oct 29, 2015, at 2:01 AM, Fabian Wein wrote: Hello, I'm new to the list, maybe the issue was somewhere else already solved. I found a similar question in the mailing list archive b

[OMPI users] Unable to compile for libnumactl and libnumactl-devel

2015-10-29 Thread Fabian Wein
Hello, I'm new to the list, maybe the issue was somewhere else already solved. I found a similar question in the mailing list archive but no solution. By comparing to a similar system I found that for my 4 sockets Opteron system it is necessary to run mpi with -bind-to numa option. On my