Hello,
I have an installation on Ubuntu 22.04.3 LTS with ovs /DPDK. With an Intel NIC,
everything works fine, but with a Broadcom NIC
Network devices using DPDK-compatible driver
============================================
0000:46:00.0 'BCM57412 NetXtreme-E 10Gb RDMA Ethernet Controller 16d6'
drv=vfio-pci unused=bnxt_en
0000:46:00.1 'BCM57412 NetXtreme-E 10Gb RDMA Ethernet Controller 16d6'
drv=vfio-pci unused=bnxt_en
in the same ovs/dpdk setup I'm always facing packet losses during a sibling VM
connects or disconnects (virsh destroy/start <VM>)
>From what I can see, packets get always lost, if the link_state of the
>dpdk_port receiving packets from the NIC toggles (the admin_state stays up)
The toggle seems to be related to the link toggle on the vhost connection (I
assume) when a VM connects or disconnects.
I already tried client and server mode for the vhost config, no changes.
I already tried to isolate the dpdk_ports from/to the NIC in an own bridge, but
it seem the link flaps get also distributed over the patch ports connecting the
bridges.
I get similar packet losses if I just change an option in the ovs config.
Logs via: ovsdb-client monitor Interface name,link_state, admin_stat
during a sibling VM start
row action name link_state admin_state
------------------------------------ ------ -------- ---------- -----------
087316c9-5c39-4f6f-b765-942343483504 old up
new dpdk_if0 down up
9a7b1b87-9a30-47c6-8bf9-127065a4b563 old up
new dpdk_if1 down up
------------------------------------ ------ -------- ---------- -----------
087316c9-5c39-4f6f-b765-942343483504 old down
new dpdk_if0 up up
9a7b1b87-9a30-47c6-8bf9-127065a4b563 old down
new dpdk_if1 up up
------------------------------------ ------ -------- ---------- -----------
087316c9-5c39-4f6f-b765-942343483504 old up
new dpdk_if0 down up
9a7b1b87-9a30-47c6-8bf9-127065a4b563 old up
new dpdk_if1 down up
------------------------------------ ------ -------- ---------- -----------
087316c9-5c39-4f6f-b765-942343483504 old down
new dpdk_if0 up up
9a7b1b87-9a30-47c6-8bf9-127065a4b563 old down
new dpdk_if1 up up
------------------------------------ ------ ------------ ---------- -----------
9a7b1b87-9a30-47c6-8bf9-127065a4b563 old up
new dpdk_if1 down up
087316c9-5c39-4f6f-b765-942343483504 old up
new dpdk_if0 down up
7d0578f5-0c07-479e-81ab-bfe2a12d107d old down
new qk00-02-eth1 up up
------------------------------------ ------ ------------ ---------- -----------
72436932-bf39-48c9-9c80-58ed62d2adb8 old down
new qk00-02-eth2 up up
------------------------------------ ------ ------------ ---------- -----------
1e5074cb-159d-4d8e-95b8-e0295574a331 old down
new qk00-02-eth3 up up
------------------------------------ ------ -------- ---------- -----------
087316c9-5c39-4f6f-b765-942343483504 old down
new dpdk_if0 up up
9a7b1b87-9a30-47c6-8bf9-127065a4b563 old down
new dpdk_if1 up up
------------------------------------ ------ -------- ---------- -----------
087316c9-5c39-4f6f-b765-942343483504 old up
new dpdk_if0 down up
9a7b1b87-9a30-47c6-8bf9-127065a4b563 old up
new dpdk_if1 down up
------------------------------------ ------ -------- ---------- -----------
087316c9-5c39-4f6f-b765-942343483504 old down
new dpdk_if0 up up
9a7b1b87-9a30-47c6-8bf9-127065a4b563 old down
new dpdk_if1 up up
So my question(s):
*
Is there a way to block the link-state changes by configuration (if this is
really the cause of my problem)
*
Or and other configuration that the NIC does not get the link-toggle (from the
vhost interface?)
*
Or is there any other idea what could cause my problems?
Regards
Robert
_______________________________________________
discuss mailing list
[email protected]
https://mail.openvswitch.org/mailman/listinfo/ovs-discuss