Re: [OMPI users] Open MPI over RoCE using breakout cable and switch

2017-01-20 Thread Howard Pritchard
Hi Brendan I doubt this kind of config has gotten any testing with OMPI. Could you rerun with --mca btl_base_verbose 100 added to the command line and post the output to the list? Howard Brendan Myers schrieb am Fr. 20. Jan. 2017 um 15:04: > Hello, > > I am attempting to get Open MPI to ru

[OMPI users] Open MPI over RoCE using breakout cable and switch

2017-01-20 Thread Brendan Myers
Hello, I am attempting to get Open MPI to run over 2 nodes using a switch and a single breakout cable with this design: (100GbE)QSFP <> 2x (50GbE)QSFP Hardware Layout: Breakout cable module A connects to switch (100GbE) Breakout cable module B1 connects to node 1 RoCE NIC (50GbE)

Re: [OMPI users] Startup limited to 128 remote hosts in some situations?

2017-01-20 Thread r...@open-mpi.org
Well, it appears we are already forwarding all envars, which should include PATH. Here is the qrsh command line we use: “qrsh --inherit --nostdin -V" So would you please try the following patch: diff --git a/orte/mca/plm/rsh/plm_rsh_component.c b/orte/mca/plm/rsh/plm_rsh_component.c index 0183