Re: [OMPI users] OMPI was not built with SLURM's PMI support

2019-08-08 Thread Ralph Castain via users
Artem - do you have any suggestions? On Aug 8, 2019, at 12:06 PM, Jing Gong mailto:gongj...@kth.se> > wrote: Hi Ralph, $ Did you remember to add "--mpi=pmix" to your srun cmd line? On the cluster, $ srunĀ  --mpi=list srun: MPI types are... srun: none srun: openmpi srun: pmi2 srun: pmix srun: p

Re: [OMPI users] OMPI was not built with SLURM's PMI support

2019-08-08 Thread Jing Gong via users
Hi Ralph, > Remove the extra configure options from OMPI - you don't need to tell it > --with-pmix or --with-slurm. It will "do the right thing" without that stuff. Yes, "mpirun" works without these additional flags. But the the origin issue "OMPI was not built with SLURM's PMI support ..." is

Re: [OMPI users] OMPI was not built with SLURM's PMI support

2019-08-08 Thread Artem Polyakov via users
Hello, I'd suggest to run PMIx application with Slurm to differentiate between OMPI/PMIx issue versus Slurm/PMIx issue. As the PMIx application you can use pmix perf tool: https://github.com/pmix/pmix/tree/master/contrib/perf_tools The page has the building and running instructions. In the "run

Re: [OMPI users] OMPI was not built with SLURM's PMI support

2019-08-08 Thread Jing Gong via users
Hi Gilles, > You need to > configure --with-pmi ... Originally I specified the flag "--with-pmi" but looked at the output of slurm ... version 16.05 or later: you can use SLURM's PMIx support. This requires that you configure and build SLURM --with-pmix. .. I recompiled with flag --with

Re: [OMPI users] OMPI was not built with SLURM's PMI support

2019-08-08 Thread Ralph Castain via users
Did you configure Slurm to use PMIx? If so, then you simply need to set the "--mpi=pmix" or "--mpi=pmix_v2" (depending on which version of PMIx you used) flag on your srun cmd line so it knows to use it. If not (and you can't fix it), then you have to explicitly configure OMPI to use Slurm's le

Re: [OMPI users] OMPI was not built with SLURM's PMI support

2019-08-08 Thread Gilles GOUAILLARDET via users
Hi, You need to configure --with-pmi ... Cheers, Gilles On August 8, 2019, at 11:28 PM, Jing Gong via users wrote: Hi, Recently our Slurm system has been upgraded to 19.0.5. I tried to recompile openmpi v3.0 due to the bug reported in https://bugs.schedmd.com/show_bug.cgi?id=6993

[OMPI users] OMPI was not built with SLURM's PMI support

2019-08-08 Thread Jing Gong via users
Hi, Recently our Slurm system has been upgraded to 19.0.5. I tried to recompile openmpi v3.0 due to the bug reported in https://bugs.schedmd.com/show_bug.cgi?id=6993 The configure flags are: $./configure --enable-shared --enable-static --with-slurm --with-pmix and the output of ompi_info