Hi Elias,

Sorry, this slipped through my mind!
I do not have any Cx6 to test (I think we should receive some in CSIT at some 
point), but as it seems to complain about the QP type 8 which is supposed to be 
the ethernet queue type, can you check if your adapter supports Ethernet and if 
so, if it is set to Ethernet and not IB? You might need to use some mlx tools 
to query/change settings in the card fw.

Best
ben

> -----Original Message-----
> From: vpp-dev@lists.fd.io <vpp-dev@lists.fd.io> On Behalf Of Elias Rudberg
> Sent: Wednesday, November 16, 2022 17:10
> To: vpp-dev@lists.fd.io
> Subject: [vpp-dev] How to make VPP work with Mellanox ConnectX-6 NICs?
> 
> Hello VPP experts,
> 
> We have been using VPP with Mellanox ConnectX-5 cards for a while,
> which has been working great.
> 
> Now we have a new server where we want to run VPP in a similar way that
> we are used to, the difference is that the new server has ConnectX-6
> cards instead of ConnectX-5.
> 
> The lspci command shows each ConnectX-6 card as follows:
> 
> 51:00.0 Infiniband controller: Mellanox Technologies MT28908 Family
> [ConnectX-6]
> 
> Trying to create an interface using the following command:
> 
> create int rdma host-if ibs1f1 name if1 num-rx-queues 4
> 
> gives the following error:
> 
> DBGvpp# create int rdma host-if ibs1f1 name if1 num-rx-queues 4
> create interface rdma: Queue Pair create failed: Invalid argument
> 
> and journalctl shows the following:
> 
> Nov 16 16:06:39 [...] vnet[3147]: rdma: rdma_txq_init: Queue Pair
> create failed: Invalid argument
> Nov 16 16:06:39 [...] vnet[3147]: create interface rdma: Queue Pair
> create failed: Invalid argument
> Nov 16 16:06:39 [...] kernel: infiniband mlx5_3: create_qp:3206:(pid
> 3147): Create QP type 8 failed
> 
> We are using Ubuntu 22.04 and the VPP version tested was vpp v22.10.
> 
> Do we need to do something different when using ConnectX-6 cards
> compared to the ConnectX-5 case?
> 
> Best regards,
> Elias

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#22217): https://lists.fd.io/g/vpp-dev/message/22217
Mute This Topic: https://lists.fd.io/mt/95069595/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/leave/1480452/21656/631435203/xyzzy 
[arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Reply via email to