On Thu, Mar 3, 2022 at 3:33 AM Amir Alimohammadifar <amir.af...@gmail.com> wrote: > > Hello, > > I am having troubles with hardware vxlan offloading when the tx_checksumming > is turned on. > Here is my environment: > > GuestVM1 ---> VM1 (running in ESXi 6.7 Hypervisor1) <--VxLAN tunnel--> VM2 > (running in ESXi 6.7 Hypervisor2) ---> GuestVM2
Do you use OVS kernel datapath to create VxLAN tunnels and forward traffic? > > The VM1 and VM2 are responsible for creating openflow flows using VxLAN > tunnels to route the traffic between the GuestVMs. > > I have created all the required configurations to route the traffic and > everything works fine. However, when I try to enable VxLAN offloading, using > the parameters below: > > VM1 (transmitter): > ... > > tx-checksumming: on > > tx-checksum-ipv4: off [fixed] > > tx-checksum-ip-generic: on > > tx-checksum-ipv6: off [fixed] > > tx-checksum-fcoe-crc: off [fixed] > > tx-checksum-sctp: off [fixed] > > ... > > tx-udp_tnl-segmentation: on > > tx-udp_tnl-csum-segmentation: on > ... > > The throughput between GustVM1 ---> GuestVM2 is less than 5Mbps. > After googling around, I turned off the tx_checksumming on the transmitter > side and everything works well. (I can see 10Gbps traffic going through but > the CPU usage is terrible) Could you show the CPU stats in your host and perf results? > > VM1 (transmitter): > > ... > > tx-checksumming: off > > tx-checksum-ipv4: off [fixed] > > tx-checksum-ip-generic: off > > tx-checksum-ipv6: off [fixed] > > tx-checksum-fcoe-crc: off [fixed] > > tx-checksum-sctp: off [fixed] > > ... > > tx-udp_tnl-segmentation: on > > tx-udp_tnl-csum-segmentation: on > > ... > > > This issue doesn't exist when I use the Linux-bridge for connecting the VM1 > and VM2. > > I was wondering if there is an issue with openvswitch when I keep the > tx_checsumming on? > > And I am using the following NICs which are capable of VxLAN offloading: > Mellanox Technologies MT27710 Family [ConnectX-4 Lx] > > Driver Info: > Bus Info: 0000:3b:00:0 > Driver: nmlx5_core > Firmware Version: 14.23.1020 > Version: 4.15.10.3 > > > Thank you, > Amir > > _______________________________________________ > discuss mailing list > disc...@openvswitch.org > https://mail.openvswitch.org/mailman/listinfo/ovs-discuss _______________________________________________ discuss mailing list disc...@openvswitch.org https://mail.openvswitch.org/mailman/listinfo/ovs-discuss
