Hi,
With a dpdk based application inside GCP VM instance,
it is observed that while sending UDP packets of length 1300 at around 6
Gbps rate, tx burst starts failing frequently.
On enabling virtio pmd logs, following error is found:
PMD: virtio_xmit_pkts() tx: No free tx descriptors to transmit
*VM configuration:*
Cores: Total 12 cores, 5 cores for the application
OS: CentOS 7.2.1511
Linux kernel : 3.10.0-327.13.1.el7.x86_64
DPDK version : 17.05*
*
*Ring configuration in application:*
TX descriptor ring size: 4096
RX descriptor ring size: 1024
4 cores for rx and tx in a run to completion model.
Single port is used for Rx and Tx.
lcore to queue mapping is 1:1, i.e 1rx queue and 1tx queue per lcore
*ethtool -g eth0*
Ring parameters for eth0:
Pre-set maximums:
RX: 4096
RX Mini: 0
RX Jumbo: 0
TX: 4096
Current hardware settings:
RX: 4096
RX Mini: 0
RX Jumbo: 0
TX: 4096
*lscpu*
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
CPU(s): 12
On-line CPU(s) list: 0-11
Thread(s) per core: 2
Core(s) per socket: 6
Socket(s): 1
NUMA node(s): 1
Vendor ID: GenuineIntel
CPU family: 6
Model: 85
Model name: Intel(R) Xeon(R) CPU @ 2.00GHz
Stepping: 3
CPU MHz: 2000.168
BogoMIPS: 4000.33
Hypervisor vendor: KVM
Virtualization type: full
L1d cache: 32K
L1i cache: 32K
L2 cache: 256K
L3 cache: 56320K
NUMA node0 CPU(s): 0-11
*NIC stats is provided below:*
100330695 packets input, 141154589263 bytes
100310198 packets output, 136450396190 bytes
0 packets missed
0 erroneous packets received
0 multicast packets received
0 failed transmitted packets
0 No Mbufs
Stats reg 0 RX-packets: 23454090 RX-errors: 0 RX-bytes: 32948589715
Stats reg 1 RX-packets: 23954850 RX-errors: 0 RX-bytes: 33699067521
Stats reg 2 RX-packets: 26014919 RX-errors: 0 RX-bytes: 36614183404
Stats reg 3 RX-packets: 26906836 RX-errors: 0 RX-bytes: 37892748623
Stats reg 0 TX-packets: 23450529 TX-bytes: 31934107195
Stats reg 1 TX-packets: 23951340 TX-bytes: 32591951998
Stats reg 2 TX-packets: 26008018 TX-bytes: 35366748482
Stats reg 3 TX-packets: 26900311 TX-bytes: 36557588515
Increasing the number of cores for the application is also not helping
in this case.
Kindly suggest as what needs to be done to improve the performance and
avoid this issue.
Thanks & Regards,
Sharon T N
