Re: [OMPI users] What Red Hat Enterprise/CentOS NUMA libraries are recommended/required for OpenMPI?

2015-08-12 Thread Dave Love
"Jeff Squyres (jsquyres)" writes: > I think Dave's point is that numactl-devel (and numactl) is only needed for > *building* Open MPI. Users only need numactl to *run* Open MPI. Yes. However, I guess the basic problem is that the component fails to load for want of

Re: [OMPI users] What Red Hat Enterprise/CentOS NUMA libraries are recommended/required for OpenMPI?

2015-08-11 Thread Jeff Squyres (jsquyres)
I think Dave's point is that numactl-devel (and numactl) is only needed for *building* Open MPI. Users only need numactl to *run* Open MPI. Specifically, numactl-devel contains the .h files we need to compile OMPI against libnumactl: $ rpm -ql numactl-devel /usr/include/numa.h

Re: [OMPI users] What Red Hat Enterprise/CentOS NUMA libraries are recommended/required for OpenMPI?

2015-08-11 Thread Ralph Castain
Because only the devel package includes the necessary pieces to set memory affinity. On Tue, Aug 11, 2015 at 9:37 AM, Dave Love wrote: > Ralph Castain writes: > > > Hi Bill > > > > You need numactl-devel on the nodes. Not having them means we cannot

Re: [OMPI users] What Red Hat Enterprise/CentOS NUMA libraries are recommended/required for OpenMPI?

2015-08-11 Thread Dave Love
Ralph Castain writes: > Hi Bill > > You need numactl-devel on the nodes. Not having them means we cannot ensure > memory is bound local to the procs, which will hurt performance but not > much else. There is an MCA param to turn off the warnings if you choose not > to install

Re: [OMPI users] What Red Hat Enterprise/CentOS NUMA libraries are recommended/required for OpenMPI?

2015-08-05 Thread Ralph Castain
Hi Bill You need numactl-devel on the nodes. Not having them means we cannot ensure memory is bound local to the procs, which will hurt performance but not much else. There is an MCA param to turn off the warnings if you choose not to install the libs: hwloc_base_mem_bind_failure_action=silent

[OMPI users] What Red Hat Enterprise/CentOS NUMA libraries are recommended/required for OpenMPI?

2015-08-05 Thread Lane, William
I'm running OpenMPI 1.8.7 tests on a mixed bag cluster of various systems under CentOS 6.3, I've been intermittently getting warnings about not having the proper NUMA libraries installed. Which NUMA libraries should be installed for CentOS 6.3 and OpenMPI 1.8.7? Here's what I currently have