Hi Ben, You were right that my issue had to do with IB/ETH mode. The card was set to IB mode. After changing to ETH mode, things are now working. No change in how VPP is configured for ConnectX-6 compared to ConnectX-5, everything is the same except that the interface names are slightly different as can be seen for example using the "ip link" command.
In case it helps someone else, the command used to change mode was "mlxconfig" and the options changed were LINK_TYPE_P1 and LINK_TYPE_P2, both of those were changed from IB(1) to ETH(2). Thanks! / Elias On Tue, 2022-11-22 at 08:59 +0000, Benoit Ganne (bganne) via lists.fd.io wrote: > Hi Elias, > > Sorry, this slipped through my mind! > I do not have any Cx6 to test (I think we should receive some in CSIT > at some point), but as it seems to complain about the QP type 8 which > is supposed to be the ethernet queue type, can you check if your > adapter supports Ethernet and if so, if it is set to Ethernet and not > IB? You might need to use some mlx tools to query/change settings in > the card fw. > > Best > ben > > > -----Original Message----- > > From: vpp-dev@lists.fd.io <vpp-dev@lists.fd.io> On Behalf Of Elias > > Rudberg > > Sent: Wednesday, November 16, 2022 17:10 > > To: vpp-dev@lists.fd.io > > Subject: [vpp-dev] How to make VPP work with Mellanox ConnectX-6 > > NICs? > > > > Hello VPP experts, > > > > We have been using VPP with Mellanox ConnectX-5 cards for a while, > > which has been working great. > > > > Now we have a new server where we want to run VPP in a similar way > > that > > we are used to, the difference is that the new server has ConnectX- > > 6 > > cards instead of ConnectX-5. > > > > The lspci command shows each ConnectX-6 card as follows: > > > > 51:00.0 Infiniband controller: Mellanox Technologies MT28908 Family > > [ConnectX-6] > > > > Trying to create an interface using the following command: > > > > create int rdma host-if ibs1f1 name if1 num-rx-queues 4 > > > > gives the following error: > > > > DBGvpp# create int rdma host-if ibs1f1 name if1 num-rx-queues 4 > > create interface rdma: Queue Pair create failed: Invalid argument > > > > and journalctl shows the following: > > > > Nov 16 16:06:39 [...] vnet[3147]: rdma: rdma_txq_init: Queue Pair > > create failed: Invalid argument > > Nov 16 16:06:39 [...] vnet[3147]: create interface rdma: Queue Pair > > create failed: Invalid argument > > Nov 16 16:06:39 [...] kernel: infiniband mlx5_3: > > create_qp:3206:(pid > > 3147): Create QP type 8 failed > > > > We are using Ubuntu 22.04 and the VPP version tested was vpp > > v22.10. > > > > Do we need to do something different when using ConnectX-6 cards > > compared to the ConnectX-5 case? > > > > Best regards, > > Elias
-=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#22220): https://lists.fd.io/g/vpp-dev/message/22220 Mute This Topic: https://lists.fd.io/mt/95069595/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/leave/1480452/21656/631435203/xyzzy [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
