Re: [OMPI devel] psm2 and psm2_ep_open problems

2016-04-14 Thread Howard Pritchard
Hi Matias Actually I triaged this further. Open mpi PMI subsystem is actually doing things correctly wrt env variable setting with or without mpi run. The problem has to do with a psm2 and the fact that on my cluster right now SLURM has only scheduled about 25 jobs. This results in the unique

Re: [OMPI devel] psm2 and psm2_ep_open problems

2016-04-14 Thread Cabral, Matias A
Hi Howard, I suspect this is the known issue that when using SLURM with OMPI and PSM that is discussed here: https://www.open-mpi.org/community/lists/users/2010/12/15220.php As per today, orte generates the psm_key, so when using SLURM this does not happen and is necessary to set it in the envi

[OMPI devel] psm2 and psm2_ep_open problems

2016-04-14 Thread Howard Pritchard
Hi Folks, So we have this brand-new omnipath cluster here at work, but people are having problem using it on a single node using srun as the job launcher. The customer wants to use srun to launch jobs not the open mpi mpirun. The customer installed 1.10.1, but I can reproduce the problem with v2