Re: [OMPI devel] OpenMPI with Slurm support

2020-08-05 Thread Ralph Castain via devel
When you launch a job with "srun", you have to include the option that specifies which MPI "glue" to use. You can find the available options with "--mpi=list" - you should see a "pmix_v3" option. Your cmd line should then be "srun --mpi=pmix_v3 ..." You can also set that to be the default in yo

Re: [OMPI devel] OpenMPI with Slurm support

2020-08-05 Thread Luis Cebamanos via devel
Hi, Just an update on this. I've managed to build OpenMPI 4.0.1 using --with-pmix=/lustre/z04/pmix --width-slurm -with-libevent=/lustre/z04/pmix/libevent/ Unfortunately I keep getting the same warning when using srun (i.e. srun my_ompi_app.x): The application appears to have been direct launche

Re: [OMPI devel] OpenMPI with Slurm support

2020-08-05 Thread Ralph Castain via devel
This looks like a bug in the OMPI glue - let OMPI use its embedded PMIx version (which is the same anyway) as you don't need it to use the same as Slurm is using. You just need the separate PMIx installation to build the Slurm support. > On Aug 5, 2020, at 8:10 AM, Luis Cebamanos via devel >

Re: [OMPI devel] OpenMPI with Slurm support

2020-08-05 Thread Luis Cebamanos via devel
Hi Ralph, Thanks for pointing me to this. I've done that and although configure does not report any errors, make won't build with following errors Making all in mca/pmix/ext3x make[2]: Entering directory '/lustre/z04/openmpi-4.0.1/opal/mca/pmix/ext3x'   CC   mca_pmix_ext3x_la-ext3x_local.lo  

Re: [OMPI devel] OpenMPI with Slurm support

2020-08-05 Thread Ralph Castain via devel
For OMPI, I would recommend installing PMIx: https://github.com/openpmix/openpmix/releases/tag/v3.1.5 > On Aug 5, 2020, at 12:40 AM, Luis Cebamanos via devel > wrote: > > Hi all, > > We are trying to install OpenMPI with Slurm support on a recently > upgraded system. Unfortunately libpmi, li

[OMPI devel] OpenMPI with Slurm support

2020-08-05 Thread Luis Cebamanos via devel
Hi all, We are trying to install OpenMPI with Slurm support on a recently upgraded system. Unfortunately libpmi, libpmi2 or limpix don't seem to be available. Could I install these libraries myself to build OpenMPI and run it with Slurm? If so, which one would be needed? I guess these libraries sh