[OMPI users] No network interfaces were found for out-of-band communications.

2018-09-11 Thread Greg Russell
I have a single machine w 96 cores. It runs CentOS7 and is not connected to any network as it needs to isolated for security. I attempted the standard install process and upon attempting to run ./mpirun I find the error message "No network interfaces were found for out-of-band communications

Re: [OMPI users] *** Error in `orted': double free or corruption (out): 0x00002aaab4001680 ***, in some node combos.

2018-09-11 Thread Jeff Squyres (jsquyres) via users
Thanks for reporting the issue. First, you can workaround the issue by using: mpirun --mca oob tcp ... This uses a different out-of-band plugin (TCP) instead of verbs unreliable datagrams. Second, I just filed a fix for our current release branches (v2.1.x, v3.0.x, and v3.1.x): https

Re: [OMPI users] RDMA over Ethernet in Open MPI - RoCE on AWS?

2018-09-11 Thread Jeff Hammond
Are you trying to run UPC++ over MPI in the cloud? Jeff On Tue, Sep 11, 2018 at 10:46 AM, Benjamin Brock wrote: > Thanks for your response. > > One question: why would RoCE still requiring host processing of every > packet? I thought the point was that some nice server Ethernet NICs can > handl

Re: [OMPI users] RDMA over Ethernet in Open MPI - RoCE on AWS?

2018-09-11 Thread Benjamin Brock
Thanks for your response. One question: why would RoCE still requiring host processing of every packet? I thought the point was that some nice server Ethernet NICs can handle RDMA requests directly? Or am I misunderstanding RoCE/how Open MPI's RoCE transport? Ben

Re: [OMPI users] stdout/stderr question

2018-09-11 Thread Jeff Squyres (jsquyres) via users
Gilles: Can you submit a PR to fix these 2 places? Thanks! > On Sep 11, 2018, at 9:10 AM, emre brookes wrote: > > Gilles Gouaillardet wrote: >> It seems I got it wrong :-( > Ah, you've joined the rest of us :) >> >> Can you please give the attached patch a try ? >> > Working with a git clone

Re: [OMPI users] stdout/stderr question

2018-09-11 Thread emre brookes
Gilles Gouaillardet wrote: It seems I got it wrong :-( Ah, you've joined the rest of us :) Can you please give the attached patch a try ? Working with a git clone of 3.1.x, patch applied $ /src/ompi-3.1.x/bin/mpicxx test.cpp $ /src/ompi-3.1.x/bin/mpirun a.out > stdout --