Hi Mathis,

thanks for that. I see you are using CX6-LX and it is not the 1st time I see 
some weird latency/buffers starvation with those. I see you also have CX5 on 
this box, any chance you could give them a try instead of the CX6?

best
ben

________________________________________
From: [email protected] <[email protected]> on behalf of mjoffre via 
lists.fd.io <[email protected]>
Sent: Tuesday, December 9, 2025 11:56
To: [email protected]
Subject: Re: [vpp-dev] Severe Latency on NAT64 (IPv6→IPv4) with VPP v25.10 
#ipv6 #nat

Hi Ben,

Thanks for the pointers.

I’ve already rerun everything with a single worker and captured all the 
requested outputs. I didn’t see any improvement by moving to a single thread.

You’ll find the full results below:

# vppctl clear run && vppctl show run
Time 2.0, 10 sec internal node vector rate 1.03 loops/sec 8241806.23
  vector rates in 1.4784e2, out 2.2028e2, drop 1.4884e0, punt 9.9231e-1
             Name                 State         Calls          Vectors        
Suspends         Clocks       Vectors/Call
TwentyFiveGigabitEthernet81/0/   active                173             173      
         0          2.30e2            1.00
TwentyFiveGigabitEthernet81/0/   active                173             153      
         0          1.30e3             .88
VirtualEthernet0/0/0-output      active                110             120      
         0          4.90e2            1.09
VirtualEthernet0/0/0-tx          active                110             120      
         0          2.34e3            1.09
arp-input                        active                  2               2      
         0          8.37e2            1.00
arp-reply                        active                  2               2      
         0          1.07e4            1.00
dpdk-input                       polling          17285600             125      
         0          1.87e7            0.00
dpdk-process                   "any wait"                0               0      
         2          1.05e6            0.00
drop                             active                  3               3      
         0          2.52e3            1.00
error-drop                       active                  3               3      
         0          1.80e3            1.00
error-punt                       active                  2               2      
         0          5.81e3            1.00
ethernet-input                   active                459             469      
         0          9.76e2            1.02
fib-walk                       "any wait"                0               0      
         1          6.63e3            0.00
ip4-full-reassembly-expire-wal "any wait"                0               0      
        41          3.38e3            0.00
ip4-input-no-checksum            active                109             119      
         0          1.05e3            1.09
ip4-lookup                       active                171             171      
         0          7.11e2            1.00
ip4-rewrite                      active                171             171      
         0          7.17e2            1.00
ip4-sv-reassembly-feature        active                109             119      
         0          1.02e3            1.09
ip6-full-reassembly-expire-wal "any wait"                0               0      
        41          1.87e3            0.00
ip6-input                        active                346             346      
         0          4.20e2            1.00
ip6-lookup                       active                283             293      
         0          5.43e2            1.04
ip6-mld-process                "any wait"                0               0      
         2          3.02e3            0.00
ip6-ra-process                 "any wait"                0               0      
         2          2.85e3            0.00
ip6-rewrite                      active                283             293      
         0          3.90e2            1.04
ip6-sv-reassembly-feature        active                171             171      
         0          5.40e2            1.00
loop0-output                     active                171             171      
         0          8.48e2            1.00
loop0-tx                         active                171             171      
         0          8.07e2            1.00
nat64-in2out                     active                171             171      
         0          9.17e2            1.00
nat64-out2in                     active                109             119      
         0          1.22e3            1.09
punt                             active                  2               2      
         0          4.71e3            1.00
sflow-process-samples          "any wait"                0               0      
         2          2.52e3            0.00
unix-cli-new-session           "any wait"                0               0      
         5          3.63e3            0.00
unix-cli-process-0              "running"                2               0      
         4          2.66e5            0.00
vhost-user-input                 polling          17285600             173      
         0          6.14e6            0.00

# vppctl clear err && vppctl show err
   Count                  Node                              Reason              
 Severity
         2             dpdk-input                          no error             
   error
        20 TwentyFiveGigabitEthernet81/0/0-tx Tx packet drops (dpdk tx failure) 
   error

# vppctl clear hard && vppctl show hard
              Name                Idx   Link  Hardware
TwentyFiveGigabitEthernet81/0/0    1     up   TwentyFiveGigabitEthernet81/0/0
  Link speed: 25 Gbps
  RX Queues:
    queue thread         mode
    0     main (0)       polling
  TX Queues:
    TX Hash: [name: hash-eth-l34 priority: 50 description: Hash ethernet L34 
headers]
    queue shared thread(s)
    0     no     0
  Ethernet address XX:XX:XX:XX:XX:XX
  Mellanox ConnectX-4/5/6 Family
    carrier up full duplex max-frame-size 9022
    flags: admin-up maybe-multiseg tx-offload intel-phdr-cksum rx-ip4-cksum
    Devargs:
    rx: queues 1 (max 1024), desc 1024 (min 0 max 32768 align 1)
    tx: queues 1 (max 1024), desc 1024 (min 0 max 32768 align 1)
    pci: device 15b3:101f subsystem 15b3:0005 address 0000:81:00.00 numa 0
    switch info: name 0000:81:00.0 domain id 0 port id 65535
    max rx packet len: 65536
    promiscuous: unicast off all-multicast on
    vlan offload: strip off filter off qinq off
    rx offload avail:  vlan-strip ipv4-cksum udp-cksum tcp-cksum tcp-lro
                       vlan-filter scatter timestamp rss-hash buffer-split
    rx offload active: ipv4-cksum scatter
    tx offload avail:  vlan-insert ipv4-cksum udp-cksum tcp-cksum tcp-tso
                       outer-ipv4-cksum vxlan-tnl-tso gre-tnl-tso geneve-tnl-tso
                       multi-segs mbuf-fast-free udp-tnl-tso ip-tnl-tso
    tx offload active: ipv4-cksum udp-cksum tcp-cksum outer-ipv4-cksum 
multi-segs
    rss avail:         ipv4-frag ipv4-tcp ipv4-udp ipv4-other ipv4 ipv6-tcp-ex
                       ipv6-udp-ex ipv6-frag ipv6-tcp ipv6-udp ipv6-other
                       ipv6-ex ipv6 esp l4-dst-only l4-src-only l3-dst-only
                       l3-src-only
    rss active:        none
    tx burst mode: Enhanced MPW + MULTI + TSO + SWP  + CSUM + METADATA
    tx burst function: (not available)
    rx burst mode: Scalar
    rx burst function: (not available)

    tx frames ok                                         147
    tx bytes ok                                       182559
    tx errors                                             18
    rx frames ok                                         121
    rx bytes ok                                         8410
    extended stats:
      rx_good_packets                                    121
      tx_good_packets                                    147
      rx_good_bytes                                     8410
      tx_good_bytes                                   182559
      tx_errors                                           18
      rx_q0_packets                                      121
      rx_q0_bytes                                       8410
      tx_q0_packets                                      147
      tx_q0_bytes                                     182559
      rx_unicast_bytes                                  8656
      rx_multicast_bytes                                 256
      rx_broadcast_bytes                                  64
      rx_unicast_packets                                 119
      rx_multicast_packets                                 2
      rx_broadcast_packets                                 1
      tx_unicast_bytes                                182559
      tx_unicast_packets                                 147
      tx_phy_packets                                     147
      rx_phy_packets                                     122
      tx_phy_bytes                                    183147
      rx_phy_bytes                                      8976
VirtualEthernet0/0/0               3     up   VirtualEthernet0/0/0
  Link speed: unknown
  RX Queues:
    queue thread         mode
    0     main (0)       polling
  TX Queues:
    TX Hash: [name: hash-eth-l34 priority: 50 description: Hash ethernet L34 
headers]
    queue shared thread(s)
    0     no     0
  Ethernet address XX:XX:XX:XX:XX:XX
local0                             0    down  local0
  Link speed: unknown
  local
loop0                              2     up   loop0
  Link speed: unknown
  Ethernet address XX:XX:XX:XX:XX:XX

# vppctl show log
2025/12/09 10:37:50:212 notice     plugin/load    Loaded plugin: abf_plugin.so 
(Access Control List (ACL) Based Forwarding)
2025/12/09 10:37:50:212 notice     plugin/load    Loaded plugin: acl_plugin.so 
(Access Control Lists (ACL))
2025/12/09 10:37:50:212 notice     plugin/load    Loaded plugin: adl_plugin.so 
(Allow/deny list plugin)
2025/12/09 10:37:50:212 notice     plugin/load    Loaded plugin: 
af_packet_plugin.so (af-packet)
2025/12/09 10:37:50:213 notice     plugin/load    Loaded plugin: 
af_xdp_plugin.so (AF_XDP Device Plugin)
2025/12/09 10:37:50:213 notice     plugin/load    Loaded plugin: 
arping_plugin.so (Arping (arping))
2025/12/09 10:37:50:213 notice     plugin/load    Loaded plugin: 
auto_sdl_plugin.so (Auto SDL)
2025/12/09 10:37:50:213 notice     plugin/load    Plugin disabled (default): 
auto_sdl_unittest_plugin.so
2025/12/09 10:37:50:213 notice     plugin/load    Loaded plugin: avf_plugin.so 
(Intel Adaptive Virtual Function (AVF) Device Driver)
2025/12/09 10:37:50:214 notice     plugin/load    Loaded plugin: 
bpf_trace_filter_plugin.so (BPF Trace Filter Plugin)
2025/12/09 10:37:50:214 notice     plugin/load    Plugin disabled: cdp_plugin.so
2025/12/09 10:37:50:214 notice     plugin/load    Loaded plugin: cnat_plugin.so 
(CNat Translate)
2025/12/09 10:37:50:214 notice     plugin/load    Loaded plugin: 
crypto_sw_scheduler_plugin.so (SW Scheduler Crypto Async Engine plugin)
2025/12/09 10:37:50:214 notice     plugin/load    Loaded plugin: ct6_plugin.so 
(IPv6 Connection Tracker)
2025/12/09 10:37:50:214 notice     plugin/load    Loaded plugin: 
det44_plugin.so (Deterministic NAT (CGN))
2025/12/09 10:37:50:214 notice     plugin/load    Loaded plugin: 
dev_ena_plugin.so (dev_ena)
2025/12/09 10:37:50:215 notice     plugin/load    Loaded plugin: 
dev_iavf_plugin.so (dev_iavf)
2025/12/09 10:37:50:215 notice     plugin/load    Loaded plugin: dhcp_plugin.so 
(Dynamic Host Configuration Protocol (DHCP))
2025/12/09 10:37:50:215 notice     plugin/load    Loaded plugin: 
dma_intel_plugin.so (Intel DSA Backend)
2025/12/09 10:37:50:215 notice     plugin/load    Loaded plugin: dns_plugin.so 
(Simple DNS name resolver)
2025/12/09 10:37:50:222 notice     plugin/load    Loaded plugin: dpdk_plugin.so 
(Data Plane Development Kit (DPDK))
2025/12/09 10:37:50:222 notice     plugin/load    Loaded plugin: 
dslite_plugin.so (Dual-Stack Lite)
2025/12/09 10:37:50:222 notice     plugin/load    Plugin disabled (default): 
fateshare_plugin.so
2025/12/09 10:37:50:222 notice     plugin/load    Loaded plugin: 
flowprobe_plugin.so (Flow per Packet)
2025/12/09 10:37:50:222 notice     plugin/load    Loaded plugin: 
geneve_plugin.so (GENEVE Tunnels)
2025/12/09 10:37:50:222 notice     plugin/load    Loaded plugin: gre_plugin.so 
(Generic Routing Encapsulation (GRE) plugin)
2025/12/09 10:37:50:222 notice     plugin/load    Plugin disabled: 
gtpu_plugin.so
2025/12/09 10:37:50:222 notice     plugin/load    Loaded plugin: 
hs_apps_plugin.so (Host Stack Applications)
2025/12/09 10:37:50:222 notice     plugin/load    Loaded plugin: hsi_plugin.so 
(Host Stack Intercept (HSI))
2025/12/09 10:37:50:222 notice     plugin/load    Loaded plugin: http_plugin.so 
(Hypertext Transfer Protocol (HTTP))
2025/12/09 10:37:50:222 notice     plugin/load    Loaded plugin: 
http_static_plugin.so (HTTP Static Server)
2025/12/09 10:37:50:222 notice     plugin/load    Plugin disabled (default): 
http_unittest_plugin.so
2025/12/09 10:37:50:222 notice     plugin/load    Plugin disabled (default): 
idpf_plugin.so
2025/12/09 10:37:50:223 notice     plugin/load    Plugin disabled: 
igmp_plugin.so
2025/12/09 10:37:50:223 notice     plugin/load    Loaded plugin: 
ikev2_plugin.so (Internet Key Exchange (IKEv2) Protocol)
2025/12/09 10:37:50:223 notice     plugin/load    Loaded plugin: ila_plugin.so 
(Identifier Locator Addressing (ILA) for IPv6)
2025/12/09 10:37:50:223 notice     plugin/load    Loaded plugin: ioam_plugin.so 
(Inbound Operations, Administration, and Maintenance (OAM))
2025/12/09 10:37:50:223 notice     plugin/load    Loaded plugin: 
ip_session_redirect_plugin.so (IP session redirect)
2025/12/09 10:37:50:223 notice     plugin/load    Loaded plugin: l2tp_plugin.so 
(Layer 2 Tunneling Protocol v3 (L2TP))
2025/12/09 10:37:50:223 notice     plugin/load    Loaded plugin: l3xc_plugin.so 
(L3 Cross-Connect (L3XC))
2025/12/09 10:37:50:223 notice     plugin/load    Loaded plugin: lacp_plugin.so 
(Link Aggregation Control Protocol (LACP))
2025/12/09 10:37:50:223 notice     plugin/load    Loaded plugin: lb_plugin.so 
(Load Balancer (LB))
2025/12/09 10:37:50:223 notice     plugin/load    Plugin disabled (default): 
linux_cp_plugin.so
2025/12/09 10:37:50:223 notice     plugin/load    Plugin disabled (default): 
linux_cp_unittest_plugin.so
2025/12/09 10:37:50:223 notice     plugin/load    Plugin disabled (default): 
linux_nl_plugin.so
2025/12/09 10:37:50:224 notice     plugin/load    Loaded plugin: lisp_plugin.so 
(Locator ID Separation Protocol (LISP))
2025/12/09 10:37:50:224 notice     plugin/load    Plugin disabled (default): 
lisp_unittest_plugin.so
2025/12/09 10:37:50:224 notice     plugin/load    Loaded plugin: lldp_plugin.so 
(Link Layer Discovery Protocol (LLDP))
2025/12/09 10:37:50:224 notice     plugin/load    Loaded plugin: 
mactime_plugin.so (Time-based MAC Source Address Filter)
2025/12/09 10:37:50:224 notice     plugin/load    Loaded plugin: map_plugin.so 
(Mapping of Address and Port (MAP))
2025/12/09 10:37:50:224 notice     plugin/load    Loaded plugin: 
mdata_plugin.so (Buffer metadata change tracker.)
2025/12/09 10:37:50:224 notice     plugin/load    Loaded plugin: 
memif_plugin.so (Packet Memory Interface (memif) -- Experimental)
2025/12/09 10:37:50:224 notice     plugin/load    Loaded plugin: 
mss_clamp_plugin.so (TCP MSS clamping plugin)
2025/12/09 10:37:50:224 notice     plugin/load    Loaded plugin: 
nat44_ei_plugin.so (IPv4 Endpoint-Independent NAT (NAT44 EI))
2025/12/09 10:37:50:225 notice     plugin/load    Loaded plugin: 
nat64_plugin.so (NAT64)
2025/12/09 10:37:50:225 notice     plugin/load    Loaded plugin: 
nat66_plugin.so (NAT66)
2025/12/09 10:37:50:225 notice     plugin/load    Loaded plugin: nat_plugin.so 
(Network Address Translation (NAT))
2025/12/09 10:37:50:225 notice     plugin/load    Plugin disabled (default): 
npt66_plugin.so
2025/12/09 10:37:50:225 notice     plugin/load    Loaded plugin: nsh_plugin.so 
(Network Service Header (NSH))
2025/12/09 10:37:50:225 notice     plugin/load    Loaded plugin: nsim_plugin.so 
(Network Delay Simulator)
2025/12/09 10:37:50:225 notice     plugin/load    Loaded plugin: osi_plugin.so 
(OSI plugin)
2025/12/09 10:37:50:225 notice     plugin/load    Loaded plugin: ping_plugin.so 
(Ping (ping))
2025/12/09 10:37:50:225 notice     plugin/load    Loaded plugin: pnat_plugin.so 
(Policy 1:1 NAT)
2025/12/09 10:37:50:225 notice     plugin/load    Loaded plugin: ppp_plugin.so 
(Point-to-Point Protocol (PPP) plugin)
2025/12/09 10:37:50:226 notice     plugin/load    Loaded plugin: 
pppoe_plugin.so (PPP over Ethernet (PPPoE))
2025/12/09 10:37:50:226 notice     plugin/load    Loaded plugin: prom_plugin.so 
(Prometheus Stats Exporter)
2025/12/09 10:37:50:226 notice     plugin/load    Loaded plugin: pvti_plugin.so 
(Packet Vector Tunnel Interface plugin)
2025/12/09 10:37:50:226 notice     plugin/load    Loaded plugin: quic_plugin.so 
(Quic transport protocol)
2025/12/09 10:37:50:226 notice     plugin/load    Loaded plugin: 
quic_quicly_plugin.so (Quicly QUIC Engine)
2025/12/09 10:37:50:227 notice     plugin/load    Loaded plugin: rdma_plugin.so 
(RDMA IBverbs Device Driver)
2025/12/09 10:37:50:227 notice     plugin/load    Loaded plugin: 
sflow_plugin.so (sFlow random packet sampling)
2025/12/09 10:37:50:227 notice     plugin/load    Loaded plugin: 
srmpls_plugin.so (Segment Routing for MPLS plugin)
2025/12/09 10:37:50:227 notice     plugin/load    Loaded plugin: 
srv6ad_plugin.so (Dynamic Segment Routing for IPv6 (SRv6) Proxy)
2025/12/09 10:37:50:227 notice     plugin/load    Loaded plugin: 
srv6adflow_plugin.so (Dynamic Segment Routing for IPv6 (SRv6) Proxy)
2025/12/09 10:37:50:227 notice     plugin/load    Loaded plugin: 
srv6am_plugin.so (Masquerading Segment Routing for IPv6 (SRv6) Proxy)
2025/12/09 10:37:50:227 notice     plugin/load    Loaded plugin: 
srv6as_plugin.so (Static Segment Routing for IPv6 (SRv6) Proxy)
2025/12/09 10:37:50:227 notice     plugin/load    Loaded plugin: 
srv6mobile_plugin.so (SRv6 GTP Endpoint Functions)
2025/12/09 10:37:50:227 notice     plugin/load    Plugin disabled: stn_plugin.so
2025/12/09 10:37:50:227 notice     plugin/load    Loaded plugin: svs_plugin.so 
(Source Virtual Routing and Forwarding (VRF) Select)
2025/12/09 10:37:50:228 notice     plugin/load    Loaded plugin: 
tlsopenssl_plugin.so (Transport Layer Security (TLS) Engine, OpenSSL Based)
2025/12/09 10:37:50:228 notice     plugin/load    Loaded plugin: 
tlspicotls_plugin.so (Transport Layer Security (TLS) Engine, Picotls Based)
2025/12/09 10:37:50:228 notice     plugin/load    Loaded plugin: urpf_plugin.so 
(Unicast Reverse Path Forwarding (uRPF))
2025/12/09 10:37:50:228 notice     plugin/load    Loaded plugin: 
vhost_plugin.so (Vhost-User)
2025/12/09 10:37:50:228 notice     plugin/load    Loaded plugin: 
vmxnet3_plugin.so (VMWare Vmxnet3 Device Driver)
2025/12/09 10:37:50:228 notice     plugin/load    Loaded plugin: vrrp_plugin.so 
(VRRP v3 (RFC 5798))
2025/12/09 10:37:50:228 notice     plugin/load    Loaded plugin: 
vxlan-gpe_plugin.so (VxLan GPE Tunnels)
2025/12/09 10:37:50:229 notice     plugin/load    Loaded plugin: 
vxlan_plugin.so (VxLan Tunnels)
2025/12/09 10:37:50:229 notice     plugin/load    Loaded plugin: 
wireguard_plugin.so (Wireguard Protocol)
2025/12/09 10:37:50:404 notice     sflow/all      linux-cp not found - using 
VPP sw_if_index
2025/12/09 10:37:50:449 notice     dpdk           EAL init args: --no-hpet 
--log-level notice --in-memory --no-telemetry --file-prefix vpp -a 0000:81:00.0
2025/12/09 10:37:51:263 info       dma            vlib_dma_register_backend: 
backend 'Intel DSA' registered
2025/12/09 10:37:51:267 notice     vat-plug/load  Loaded plugin: 
l2tp_test_plugin.so
2025/12/09 10:37:51:267 notice     vat-plug/load  Loaded plugin: 
vnet_session_test_plugin.so
2025/12/09 10:37:51:267 notice     vat-plug/load  Loaded plugin: 
lldp_test_plugin.so
2025/12/09 10:37:51:267 notice     vat-plug/load  Loaded plugin: 
vnet_interface_test_plugin.so
2025/12/09 10:37:51:267 notice     vat-plug/load  Loaded plugin: 
rdma_test_plugin.so
2025/12/09 10:37:51:267 error      vat-plug/load  vat_plugin_register: gtpu 
plugin not loaded...
2025/12/09 10:37:51:267 notice     vat-plug/load  Loaded plugin: 
adl_test_plugin.so
2025/12/09 10:37:51:267 notice     vat-plug/load  Loaded plugin: 
mdata_test_plugin.so
2025/12/09 10:37:51:268 notice     vat-plug/load  Loaded plugin: 
lisp_test_plugin.so
2025/12/09 10:37:51:268 notice     vat-plug/load  Loaded plugin: 
ikev2_test_plugin.so
2025/12/09 10:37:51:268 notice     vat-plug/load  Loaded plugin: 
pppoe_test_plugin.so
2025/12/09 10:37:51:268 notice     vat-plug/load  Loaded plugin: 
tlsopenssl_test_plugin.so
2025/12/09 10:37:51:268 notice     vat-plug/load  Loaded plugin: 
nsh_test_plugin.so
2025/12/09 10:37:51:268 error      vat-plug/load  vat_plugin_register: stn 
plugin not loaded...
2025/12/09 10:37:51:268 notice     vat-plug/load  Loaded plugin: 
srmpls_test_plugin.so
2025/12/09 10:37:51:268 notice     vat-plug/load  Loaded plugin: 
vlib_vlibapi_test_plugin.so
2025/12/09 10:37:51:268 notice     vat-plug/load  Loaded plugin: 
ip_session_redirect_test_plugin.so
2025/12/09 10:37:51:268 notice     vat-plug/load  Loaded plugin: 
af_xdp_test_plugin.so
2025/12/09 10:37:51:268 notice     vat-plug/load  Loaded plugin: 
vnet_ipsec_test_plugin.so
2025/12/09 10:37:51:268 notice     vat-plug/load  Loaded plugin: 
mactime_test_plugin.so
2025/12/09 10:37:51:268 notice     vat-plug/load  Loaded plugin: 
vnet_ip6_nd_test_plugin.so
2025/12/09 10:37:51:268 notice     vat-plug/load  Loaded plugin: 
ct6_test_plugin.so
2025/12/09 10:37:51:268 notice     vat-plug/load  Loaded plugin: 
nsim_test_plugin.so
2025/12/09 10:37:51:268 notice     vat-plug/load  Loaded plugin: 
lb_test_plugin.so
2025/12/09 10:37:51:268 notice     vat-plug/load  Loaded plugin: 
lacp_test_plugin.so
2025/12/09 10:37:51:268 error      vat-plug/load  vat_plugin_register: idpf 
plugin not loaded...
2025/12/09 10:37:51:268 notice     vat-plug/load  Loaded plugin: 
dns_test_plugin.so
2025/12/09 10:37:51:268 notice     vat-plug/load  Loaded plugin: 
vnet_ip_test_plugin.so
2025/12/09 10:37:51:268 notice     vat-plug/load  Loaded plugin: 
memif_test_plugin.so
2025/12/09 10:37:51:269 notice     vat-plug/load  Loaded plugin: 
vrrp_test_plugin.so
2025/12/09 10:37:51:269 notice     vat-plug/load  Loaded plugin: 
dhcp_test_plugin.so
2025/12/09 10:37:51:269 notice     vat-plug/load  Loaded plugin: 
vmxnet3_test_plugin.so
2025/12/09 10:37:51:269 notice     vat-plug/load  Loaded plugin: 
arping_test_plugin.so
2025/12/09 10:37:51:269 notice     vat-plug/load  Loaded plugin: 
flowprobe_test_plugin.so
2025/12/09 10:37:51:269 notice     vat-plug/load  Loaded plugin: 
vpp_api_test_plugin.so
2025/12/09 10:37:51:269 notice     vat-plug/load  Loaded plugin: 
vnet_l2_test_plugin.so
2025/12/09 10:37:51:269 notice     vat-plug/load  Loaded plugin: 
sflow_test_plugin.so
2025/12/09 10:37:51:269 notice     vat-plug/load  Loaded plugin: 
ioam_test_plugin.so
2025/12/09 10:37:51:269 notice     vat-plug/load  Loaded plugin: 
avf_test_plugin.so
2025/12/09 10:37:51:269 error      vat-plug/load  vat_plugin_register: cdp 
plugin not loaded...
2025/12/09 10:37:51:269 notice     vat-plug/load  Loaded plugin: 
geneve_test_plugin.so
2025/12/09 10:37:51:269 notice     vat-plug/load  Loaded plugin: 
vnet_arp_test_plugin.so
2025/12/09 10:37:51:269 notice     vat-plug/load  Loaded plugin: 
http_static_test_plugin.so
2025/12/09 10:37:51:269 notice     vat-plug/load  Loaded plugin: 
acl_test_plugin.so
2025/12/09 10:37:51:272 notice     dpdk           EAL: 24 hugepages of size 
2097152 reserved, but no mounted hugetlbfs found for that size
2025/12/09 10:37:51:272 notice     dpdk           EAL: No free 2048 kB 
hugepages reported on node 1
2025/12/09 10:37:51:272 notice     dpdk           EAL: VFIO support not 
initialized
2025/12/09 10:37:51:272 notice     dpdk           EAL: Couldn't map new region 
for DMA
2025/12/09 10:37:51:272 notice     dpdk           EAL: VFIO support not 
initialized
2025/12/09 10:37:51:272 notice     dpdk           EAL: Couldn't map new region 
for DMA
2025/12/09 10:37:53:353 warn       dpdk           rte_eth_xstats_get(0) 
returned 70/22 stats. Resetting counters.
2025/12/09 10:37:53:353 notice     ip6/link       enable: 
TwentyFiveGigabitEthernet81/0/0
2025/12/09 10:37:53:355 error      interface      hw_add_del_mac_address: 
dpdk_add_del_mac_address: mac address add/del failed: -98
2025/12/09 10:37:53:356 notice     ip6/link       addr-add: 
TwentyFiveGigabitEthernet81/0/0 -> 2604:2dc0:XXXX:XXXX:10::
2025/12/09 10:37:53:356 notice     ip6/link       addr-add: 
TwentyFiveGigabitEthernet81/0/0 -> 2604:2dc0:XXXX:XXXX::
2025/12/09 10:37:53:356 error      interface      hw_add_del_mac_address: 
dpdk_add_del_mac_address: mac address add/del failed: -98
2025/12/09 10:37:53:358 notice     ip/neighbor    add: 
TwentyFiveGigabitEthernet81/0/0, 15.XXX.XXX.46
2025/12/09 10:37:53:358 notice     ip/neighbor    add: 
TwentyFiveGigabitEthernet81/0/0, 2604:2dc0:XXXX:XXXX::1
2025/12/09 10:38:06:122 notice     ip/neighbor    delete: VirtualEthernet0/0/0, 
2604:2dc0:XXXX:XXXX:0:1::
2025/12/09 10:38:06:122 info       acl_plugin     
ACL_FA_CLEANER_DELETE_BY_SW_IF_INDEX bitmap: 0, clear_all: 0
2025/12/09 10:38:06:122 info       acl_plugin     ACL_FA_CLEANER: thread 0, 
pending clear bitmap: 0
2025/12/09 10:38:06:122 info       acl_plugin     CLEANER mains len: 1 
per-worker len: 1
2025/12/09 10:38:06:122 info       acl_plugin     ACL_FA_NODE_CLEAN: cleaning 
done
2025/12/09 10:38:27:777 notice     ip6/link       enable: loop0
2025/12/09 10:38:27:777 notice     ip6/link       addr-add: loop0 -> 
2001:db8::2:0:1
2025/12/09 10:38:27:777 notice     ip/neighbor    add: loop0, 2001:db8::2:0:1
2025/12/09 10:38:27:778 notice     ip6/link       enable: VirtualEthernet0/0/0
2025/12/09 10:38:27:778 notice     ip6/link       set-ll: VirtualEthernet0/0/0 
-> fe80::1
2025/12/09 10:38:27:778 notice     ip/neighbor    add: VirtualEthernet0/0/0, 
2604:2dc0:XXXX:XXXX:0:1::
2025/12/09 10:38:27:780 info       acl_plugin     
ACL_FA_CLEANER_DELETE_BY_SW_IF_INDEX bitmap: 8, clear_all: 0
2025/12/09 10:38:27:780 info       acl_plugin     ACL_FA_CLEANER: thread 0, 
pending clear bitmap: 8
2025/12/09 10:38:27:780 info       acl_plugin     CLEANER mains len: 1 
per-worker len: 1
2025/12/09 10:38:27:780 info       acl_plugin     ACL_FA_NODE_CLEAN: cleaning 
done
2025/12/09 10:39:10:503 info       acl_plugin     
ACL_FA_CLEANER_DELETE_BY_SW_IF_INDEX bitmap: 8, clear_all: 0
2025/12/09 10:39:10:503 info       acl_plugin     ACL_FA_CLEANER: thread 0, 
pending clear bitmap: 8
2025/12/09 10:39:10:503 info       acl_plugin     CLEANER mains len: 1 
per-worker len: 1
2025/12/09 10:39:10:503 info       acl_plugin     ACL_FA_NODE_CLEAN: cleaning 
done

# vppctl show pci
Address      Sock VID:PID     Link Speed    Driver          Product Name        
            Vital Product Data
0000:81:00.0   0  15b3:101f   unknown       mlx5_core       ConnectX-6 Lx EN 
adapter card, 2 PN: MCX631432AC-ADAB
                                                                                
            EC: AB
                                                                                
            V2: 0x 4d 43 58 36 33 31 34 33 ...
                                                                                
            SN: MT2427J00GPV
                                                                                
            V3: 0x 61 65 37 64 35 66 32 65 ...
                                                                                
            VA: 0x 4d 4c 58 3a 4d 4e 3d 4d ...
                                                                                
            V0: 0x 50 43 49 65 47 65 6e 34 ...
                                                                                
            RV: 0x c2 00
0000:81:00.1   0  15b3:101f   unknown       mlx5_core       ConnectX-6 Lx EN 
adapter card, 2 PN: MCX631432AC-ADAB
                                                                                
            EC: AB
                                                                                
            V2: 0x 4d 43 58 36 33 31 34 33 ...
                                                                                
            SN: MT2427J00GPV
                                                                                
            V3: 0x 61 65 37 64 35 66 32 65 ...
                                                                                
            VA: 0x 4d 4c 58 3a 4d 4e 3d 4d ...
                                                                                
            V0: 0x 50 43 49 65 47 65 6e 34 ...
                                                                                
            RV: 0x c2 00
0000:c1:00.0   0  15b3:1017   unknown       mlx5_core       CX512A - ConnectX-5 
SFP28        PN: MCX512A-ACUT
                                                                                
            EC: B7
                                                                                
            V2: 0x 4d 43 58 35 31 32 41 2d ...
                                                                                
            SN: MT2234411193
                                                                                
            V3: 0x 30 65 63 36 66 30 65 64 ...
                                                                                
            VA: 0x 4d 4c 58 3a 4d 4f 44 4c ...
                                                                                
            V0: 0x 50 43 49 65 47 65 6e 33 ...
                                                                                
            VU: 0x 4d 54 32 32 33 34 34 31 ...
                                                                                
            RV: 0x 71
0000:c1:00.1   0  15b3:1017   unknown       mlx5_core       CX512A - ConnectX-5 
SFP28        PN: MCX512A-ACUT
                                                                                
            EC: B7
                                                                                
            V2: 0x 4d 43 58 35 31 32 41 2d ...
                                                                                
            SN: MT2234411193
                                                                                
            V3: 0x 30 65 63 36 66 30 65 64 ...
                                                                                
            VA: 0x 4d 4c 58 3a 4d 4f 44 4c ...
                                                                                
            V0: 0x 50 43 49 65 47 65 6e 33 ...
                                                                                
            VU: 0x 4d 54 32 32 33 34 34 31 ...
                                                                                
            RV: 0x 70

# vppctl show thread
ID     Name                Type        LWP     Sched Policy (Priority)  lcore  
Core   Socket State
0      vpp_main                        3665092 other (0)                4      
4      0



Let me know if you'd like me to collect additional traces or run further tests.

Best,

Mathis
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#26645): https://lists.fd.io/g/vpp-dev/message/26645
Mute This Topic: https://lists.fd.io/mt/116590423/21656
Mute #ipv6:https://lists.fd.io/g/vpp-dev/mutehashtag/ipv6
Mute #nat:https://lists.fd.io/g/vpp-dev/mutehashtag/nat
Group Owner: [email protected]
Unsubscribe: https://lists.fd.io/g/vpp-dev/leave/14379924/21656/631435203/xyzzy 
[[email protected]]
-=-=-=-=-=-=-=-=-=-=-=-

Reply via email to