Hi,
We are using VPP for one of our products where we have used below VPP and
DPDK versions for achieving packet flow between a router and this
product/Network entity.
VPP-18.07
DPDK 19.11.2
The packet flow is all fine for a few days/months and all of sudden we see
packets are unable to send out of this network element and below VPP
counter is getting incremented(full show error output is attached).
19672 EthernetSwitch2/0/0-tx Tx packet drops (dpdk tx
failure)
Could you please share some inputs on why this error can come and packet
drops in VPP? We also see that the incoming traffic to this network
entity is fine. Only outgoing is affected and it recovers only if we reboot
the system.
We are not testing any large traffic flow, but only nominal traffic of
about less than 1Gbps (supported is 10Gbps) is being tested. Please note
this issue is seen very rarely and we can't reproduce at ease or we just
have to wait for the system to come to this state.
Regards,
Girish
vppctl show node counters
Count Node Reason
1 ip4-reassembly Reassembly Timeout
1 ip4-reassembly-expire-walk Reassembly Timeout
6468 ip4-lookup ip4 enqueued pkts drop - due
to FAILED arp
955 ip4-lookup ip4 arp resolution failed -
host -> fp
72567382 dpdk-crypto-input Crypto ops dequeued
72567382 dpdk-esp-decrypt ESP pkts received
3898657381 ipsec-input-ip4 IPSEC pkts received
49 ipsec-input-ip4 IPSec policy (no match)
3826089949 ipsec-input-ip4 IPSec policy bypass
1 ipsec-input-ip4 IPSec default policy
72567431 ipsec-input-ip4 IPSec received ESP before
Decryption
28 ipsec-input-ip4 ESP Packet matching invalid
policy index
21852736 ip4-reassembly valid ip4 packets
21852725 ip4-reassembly Reassembled Succesfully
3876804672 ip4-reassembly Non Fragmented
16 ip4-classify Classify misses
1 ethernet-input subinterface down
322718 arp-input ARP replies received
171696 arp-input ARP req to host
72567382 dpdk-esp-decrypt-post ESP post pkts
384270 ipsec-output-ip4 IPSec pkts received
384270 ipsec-output-ip4 IPSec policy bypass
72567382 ipsec-input-ip4 IPSEC pkts received
72567382 ipsec-input-ip4 IPSec policy protect
383318 ip4-frag packet smaller than MTU
383318 ip4-frag number of sent fragments
72567382 ip4-reassembly Non Fragmented
952 ip4-lookup ip4 enqueued pkts till arp
resolve
1 ip4-lookup ip4 enqueued pkts drop - due
to queue full
162 ip4-lookup ip4 arp stale Entry - fp ->
host
75429233 ip4-classify Classify misses
3823228098 ip4-classify Classify hits
2836708 kni-receive Tx TCP packet
3256171078 kni-receive Tx TCP octet
70991412 kni-receive Tx SCTP packet
2950841788 kni-receive Tx SCTP octet
327044 kni-receive ARP req from Host
171695 kni-receive ARP resp from Host
70988586 dpdk-crypto-input Crypto ops dequeued
70988586 dpdk-esp-encrypt ESP pkts received
8 dpdk-input no error
3227149161 ipsec-output-ip4 IPSec pkts received
2 ipsec-output-ip4 IPSec policy (no match)
70988586 ipsec-output-ip4 IPSec policy protect
3156157747 ipsec-output-ip4 IPSec policy bypass
2826 ipsec-output-ip4 IPSec Failed SAE
3298128872 ip4-frag packet smaller than MTU
3298128910 ip4-frag number of sent fragments
6115 ip4-lookup ip4 enqueued pkts till arp
resolve
70 ip4-lookup ip4 dequeued pkts after arp
resolve
518 ip4-lookup ip4 enqueued pkts drop - due
to queue full
3 ip4-lookup ip4 arp Resolved - host -> fp
326942 ip4-lookup ip4 arp stale Entry - fp ->
host
19672 EthernetSwitch2/0/0-tx Tx packet drops (dpdk tx
failure)
vppctl show interface
Name Idx State MTU (L3/IP4/IP6/MPLS)
Counter Count
EthernetSwitch1/0/6 1 up 10000/0/0/0 rx packets
37515381297
rx bytes
11589070399930
tx packets
46773499196
tx bytes
20695997472608
drops
3760080
EthernetSwitch2/0/0 2 up 1560/1560/1560/0 rx packets
46870677504
rx bytes
19405277934804
tx packets
37587760749
tx bytes
10559772160412
drops
21953041
rx-miss
2
tx-error
19672
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#20894): https://lists.fd.io/g/vpp-dev/message/20894
Mute This Topic: https://lists.fd.io/mt/89341261/21656
Group Owner: [email protected]
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [[email protected]]
-=-=-=-=-=-=-=-=-=-=-=-