Re: [slurm-users] problems with slurm and openmpi

2019-03-16 Thread Chris Samuel
On Thursday, 14 March 2019 10:12:13 PM PDT Riccardo Veraldi wrote: > I missed this step then to build pmix separately. I thought that the built > in pmix inside openpmi could be used by slurm It would probably help to look at the documentation on getting Slurm and PMIx to work together. https:/

Re: [slurm-users] problems with slurm and openmpi

2019-03-16 Thread Riccardo Veraldi
I could fix my issue thanks for het hints given here. The solution was to first build pmix, then built openmpi with pmix support and slurm support then build slurm with pmix support too. Everything works now. Thank you very much On 3/12/19 5:19 PM, Gilles Gouaillardet wrote: Rick, The issue

Re: [slurm-users] problems with slurm and openmpi

2019-03-14 Thread Riccardo Veraldi
I missed this step then to build pmix separately. I thought that the built in pmix inside openpmi could be used by slurm > > On Mar 14, 2019 at 9:32 PM, mailto:gil...@rist.or.jp)> > wrote: > > > > Riccardo, > > > I am a bit confused by your explanation. > > >

Re: [slurm-users] problems with slurm and openmpi

2019-03-14 Thread Riccardo Veraldi
Hello, I installed openmpi from sources and all hte libraries and proper include files where installed correctly in /opt/openmpi/4.0.0 as I prefer it in a directory that can I export via NFS rather than the default /usr/local Anyway slurm's configure still complains and it is not happy ./conf

Re: [slurm-users] problems with slurm and openmpi

2019-03-14 Thread Gilles Gouaillardet
Riccardo, I am a bit confused by your explanation. Open MPI does embed PMIx, but only for itself. An other way to put it is you have to install pmix first (package or download from pmix.org) and then build SLURM on top of it. Then you can build Open MPI with the same (external) PMIx or t

Re: [slurm-users] problems with slurm and openmpi

2019-03-14 Thread Riccardo Veraldi
thanks to all. the problem is that slurm's configure is not able to find the pmix includes configure:20846: checking for pmix installation configure:21005: result: configure:21021: WARNING: unable to locate pmix installation regardless of the path I give. and the reason is that configure searche

Re: [slurm-users] problems with slurm and openmpi

2019-03-12 Thread Gilles Gouaillardet
Rick, The issue is SLURM can only provide pmi2 support, and it seems Open MPI only supports pmix One option is to rebuild SLURM with PMIx as explained by Daniel, and then srun --mpi=pmix ... If you do not want (or cannot) rebuilt SLURM, you can use the older pmi or pmi2. In that case,

Re: [slurm-users] problems with slurm and openmpi

2019-03-12 Thread Daniel Letai
Hi. On 12/03/2019 22:53:36, Riccardo Veraldi wrote: Hello, after trynig hard for over 10 days I am forced to write to the list.

Re: [slurm-users] problems with slurm and openmpi

2019-03-12 Thread Cyrus Proctor
Both your Slurm and OpenMPI config.logs would be helpful in debugging here. Throw in your slurm.conf as well for good measure. Also, what type of system are you running, what type of high speed fabric are you trying to run on, and what's your driver stack look like? I know the feeling and will

[slurm-users] problems with slurm and openmpi

2019-03-12 Thread Riccardo Veraldi
Hello, after trynig hard for over 10 days I am forced to write to the list. I am not able to have SLURM work with openmpi. Openmpi compiled binaries won't run on slurm, while all non openmpi progs run just fine under "srun". I am using SLURM 18.08.5 building the rpm from the tarball: rpmbuild -ta s