I would have hoped that the added protections we put into PMIx would have resolved ds12 as well as ds21, but it is possible those changes didn't get into OMPI v4.0.x. Regardless, I think you should be just fine using the gds/hash component for cygwin. I would suggest simply "locking" that param into the PMIx default param file.
On Jun 5, 2020, at 8:22 PM, Marco Atzeri via devel <devel@lists.open-mpi.org <mailto:devel@lists.open-mpi.org> > wrote: On 05.06.2020 22:29, Marco Atzeri wrote: On 01.06.2020 20:26, Geoffrey Paulsen via devel wrote: Open MPI v4.0.4rc2 is now available for download and test at: sso_last: https://www.open-mpi.org/software/ompi/v4.0/ It builds on Cygwin64 bit, and this time it runs, but the PMIX is throwing some errors: $ mpirun -n 4 ./hello_c.exe [LAPTOP-82F08ILC:02866] PMIX ERROR: INIT in file /pub/devel/openmpi/v4.0/openmpi-4.0.4-0.2.x86_64/src/openmpi-4.0.4rc2/opal/mca/pmix/pmix3x/pmix/src/mca/gds/ds12/gds_ds12_lock_pthread.c at line 138 [LAPTOP-82F08ILC:02866] PMIX ERROR: SUCCESS in file /pub/devel/openmpi/v4.0/openmpi-4.0.4-0.2.x86_64/src/openmpi-4.0.4rc2/opal/mca/pmix/pmix3x/pmix/src/mca/common/dstore/dstore_base.c at line 2450 [LAPTOP-82F08ILC:02867] PMIX ERROR: ERROR in file /pub/devel/openmpi/v4.0/openmpi-4.0.4-0.2.x86_64/src/openmpi-4.0.4rc2/opal/mca/pmix/pmix3x/pmix/src/mca/gds/ds12/gds_ds12_lock_pthread.c at line 168 [LAPTOP-82F08ILC:02868] PMIX ERROR: ERROR in file /pub/devel/openmpi/v4.0/openmpi-4.0.4-0.2.x86_64/src/openmpi-4.0.4rc2/opal/mca/pmix/pmix3x/pmix/src/mca/gds/ds12/gds_ds12_lock_pthread.c at line 168 [LAPTOP-82F08ILC:02869] PMIX ERROR: ERROR in file /pub/devel/openmpi/v4.0/openmpi-4.0.4-0.2.x86_64/src/openmpi-4.0.4rc2/opal/mca/pmix/pmix3x/pmix/src/mca/gds/ds12/gds_ds12_lock_pthread.c at line 168 [LAPTOP-82F08ILC:02870] PMIX ERROR: ERROR in file /pub/devel/openmpi/v4.0/openmpi-4.0.4-0.2.x86_64/src/openmpi-4.0.4rc2/opal/mca/pmix/pmix3x/pmix/src/mca/gds/ds12/gds_ds12_lock_pthread.c at line 168 Hello, world, I am 2 of 4, (Open MPI v4.0.4rc2, package: Open MPI Marco@LAPTOP-82F08ILC Distribution, ident: 4.0.4rc2, repo rev: v4.0.4rc2, May 29, 2020, 125) Hello, world, I am 3 of 4, (Open MPI v4.0.4rc2, package: Open MPI Marco@LAPTOP-82F08ILC Distribution, ident: 4.0.4rc2, repo rev: v4.0.4rc2, May 29, 2020, 125) Hello, world, I am 0 of 4, (Open MPI v4.0.4rc2, package: Open MPI Marco@LAPTOP-82F08ILC Distribution, ident: 4.0.4rc2, repo rev: v4.0.4rc2, May 29, 2020, 125) Hello, world, I am 1 of 4, (Open MPI v4.0.4rc2, package: Open MPI Marco@LAPTOP-82F08ILC Distribution, ident: 4.0.4rc2, repo rev: v4.0.4rc2, May 29, 2020, 125) [LAPTOP-82F08ILC:02866] [[19692,0],0] unable to open debugger attach fifo the second is a bit funny "PMIX ERROR: SUCCESS " In the past on 3.1.5 https://www.mail-archive.com/devel@lists.open-mpi.org//msg21004.html the workaround "gds = ^ds21" was used but now it seems ds12 is having problems taking the hint from https://github.com/open-mpi/ompi/issues/7516 PMIX_MCA_gds=hash $ mpirun -n 4 ./hello_c.exe Hello, world, I am 0 of 4, (Open MPI v4.0.4rc2, package: Open MPI Marco@LAPTOP-82F08ILC Distribution, ident: 4.0.4rc2, repo rev: v4.0.4rc2, May 29, 2020, 125) Hello, world, I am 1 of 4, (Open MPI v4.0.4rc2, package: Open MPI Marco@LAPTOP-82F08ILC Distribution, ident: 4.0.4rc2, repo rev: v4.0.4rc2, May 29, 2020, 125) Hello, world, I am 2 of 4, (Open MPI v4.0.4rc2, package: Open MPI Marco@LAPTOP-82F08ILC Distribution, ident: 4.0.4rc2, repo rev: v4.0.4rc2, May 29, 2020, 125) Hello, world, I am 3 of 4, (Open MPI v4.0.4rc2, package: Open MPI Marco@LAPTOP-82F08ILC Distribution, ident: 4.0.4rc2, repo rev: v4.0.4rc2, May 29, 2020, 125) [LAPTOP-82F08ILC:02913] [[19647,0],0] unable to open debugger attach fifo