Hello,
I am attempting to get Open MPI to run over 2 nodes using a switch and a
single breakout cable with this design:
(100GbE)QSFP <> 2x (50GbE)QSFP
Hardware Layout:
Breakout cable module A connects to switch (100GbE)
Breakout cable module B1 connects to node 1 RoCE NIC (50GbE)
Hi Brendan
I doubt this kind of config has gotten any testing with OMPI. Could you
rerun with
--mca btl_base_verbose 100
added to the command line and post the output to the list?
Howard
Brendan Myers schrieb am Fr. 20. Jan. 2017
um 15:04:
> Hello,
>
> I am attempting to get Open MPI to ru
Subject: Re: [OMPI users] Open MPI over RoCE using breakout cable and switch
Hi Brendan
I doubt this kind of config has gotten any testing with OMPI. Could you rerun
with
--mca btl_base_verbose 100
added to the command line and post the output to the list?
Howard
Brendan
mpi.org] *On Behalf Of *Howard
> Pritchard
> *Sent:* Friday, January 20, 2017 6:35 PM
> *To:* Open MPI Users
> *Subject:* Re: [OMPI users] Open MPI over RoCE using breakout cable and
> switch
>
>
>
> Hi Brendan
>
>
>
> I doubt this kind of config has gotten
Howard
Pritchard
Sent: Tuesday, January 24, 2017 8:21 AM
To: Open MPI Users
Subject: Re: [OMPI users] Open MPI over RoCE using breakout cable and switch
Hello Brendan,
This helps some, but looks like we need more debug output.
Could you build a debug version of Open MPI by adding --enable
n MPI Users'
Subject: Re: [OMPI users] Open MPI over RoCE using breakout cable and switch
Hello Howard,
Here is the error output after building with debug enabled. These CX4 Mellanox
cards view each port as a separate device and I am using port 1 on the card
which is device mlx5_0.
;
> Brendan
>
>
>
> *From:* users [mailto:users-boun...@lists.open-mpi.org] *On Behalf Of *Brendan
> Myers
> *Sent:* Tuesday, January 24, 2017 11:11 AM
>
> *To:* 'Open MPI Users'
> *Subject:* Re: [OMPI users] Open MPI over RoCE using breakout cable and
> switch
&
hank you,
Brendan
From: users [mailto:users-boun...@lists.open-mpi.org] On Behalf Of Howard
Pritchard
Sent: Tuesday, January 24, 2017 8:21 AM
To: Open MPI Users mailto:users@lists.open-mpi.org> >
Subject: Re: [OMPI users] Open MPI over RoCE using breakout cable and switch
Hello Brendan,