From: Damjan Marion (damarion) <damar...@cisco.com>
Sent: 2020年12月17日 23:44
To: Lijian Zhang <lijian.zh...@arm.com>
Cc: vpp-dev <vpp-dev@lists.fd.io>; nd <n...@arm.com>
Subject: Re: [vpp-dev] AVF TX bandwidth less than RX




On 17.12.2020., at 14:43, Lijian Zhang 
<lijian.zh...@arm.com<mailto:lijian.zh...@arm.com>> wrote:



From: vpp-dev@lists.fd.io<mailto:vpp-dev@lists.fd.io> 
<vpp-dev@lists.fd.io<mailto:vpp-dev@lists.fd.io>> On Behalf Of Damjan Marion 
via lists.fd.io<http://lists.fd.io/>
Sent: 2020年12月17日 16:22
To: Lijian Zhang <lijian.zh...@arm.com<mailto:lijian.zh...@arm.com>>
Cc: vpp-dev <vpp-dev@lists.fd.io<mailto:vpp-dev@lists.fd.io>>; nd 
<n...@arm.com<mailto:n...@arm.com>>
Subject: Re: [vpp-dev] AVF TX bandwidth less than RX





On 17.12.2020., at 09:16, Lijian Zhang 
<lijian.zh...@arm.com<mailto:lijian.zh...@arm.com>> wrote:

Hi Damjan,
When I was benchmarking AVF PMD driver with L3fwd and L2-xconnect cases, not 
all packets received via AVF input node ‘avf-input’ are transmitted out via AVF 
output node ‘eth1-tx’.
I have tried to increase the tx-queue-size of avf interface, but it does not 
help. Have checked VNET_DEVICE_CLASS_TX_FN (avf_device_class) (), but didn’t 
find software bottle-neck there.
Is this a normal behavior for XL710 VF interface, and does it mean VF PCIe DMA 
bandwidth in RX direction is higher than that in TX direction?

------L3fwd-------
avf-input                        polling           2369637       606626968      
         0          1.30e1          255.99
eth1-output                      active            2369637       606626968      
         0          5.56e0          255.99
eth1-tx                          active            2369637       442718040      
         0          2.02e1          186.83
ethernet-input                   active            2369637       606626968      
         0          1.26e1          255.99
ip4-input-no-checksum            active            2369637       606626968      
         0          1.91e1          255.99
ip4-lookup                       active            2369637       606626968      
         0          2.06e1          255.99
ip4-rewrite                      active            2369637       606626968      
         0          1.85e1          255.99

------L2-xconnect -------
avf-input                        polling           7342184       779122436      
         0          2.39e1          106.12
eth1-output                      active            7342123       779122436      
         0          6.67e0          106.12
eth1-tx                          active            7342123       429393137      
         0          3.23e1           58.48
ethernet-input                   active            7342123       779122436      
         0          1.37e1          106.12
l2-input                         active            7342123       779122436      
         0          1.14e1          106.12
l2-output                        active            7342123       779122436      
         0          6.19e0          106.12

What "show error" says?

If VPP was not able to enqueue packet to tx queue, it will bunp ‘no free slots’ 
counter.

[Lijian] Yes, it reports “no free tx slots”
vpp# clear errors
vpp# show errors
   Count                  Node                              Reason              
 Severity
   2539792              eth1-tx                        no free tx slots         
   error
vpp# show errors
   Count                  Node                              Reason              
 Severity
   5547120              eth1-tx                        no free tx slots         
   error

Yes, so looks like software is faster than hardware…. What is your Mpps rate?

[Lijian] 20.18Mpps for “l3fwd xl710 on x86 8268 turbo-off 2.9GHz”, and 
20.10Mpps for “l2-xconnect xl710 on x86 8268 turbo-off 2.9GHz”
----------------l3fwd xl710 on x86 8268 turbo-off ---------------------------
// 20.18Mpps
avf-input                        polling            557467       142711552      
         0          1.29e1          256.00
eth1-output                      active             557467       142711552      
         0          6.99e0          256.00
eth1-tx                          active             557467       124816512      
         0          1.95e1          223.89
ethernet-input                   active             557467       142711552      
         0          1.53e1          256.00
ip4-input-no-checksum            active             557467       142711552      
         0          2.41e1          256.00
ip4-lookup                       active             557467       142711552      
         0          2.55e1          256.00
ip4-rewrite                      active             557467       142711552      
         0          2.29e1          256.00
----------------cross-connect xl710 on x86 8268 turbo-off 
---------------------------
// 20.10Mpps
avf-input                        polling           1092996       160940736      
         0          2.00e1          147.25
eth1-output                      active            1092996       160940736      
         0          7.46e0          147.25
eth1-tx                          active            1092996        89367811      
         0          3.18e1           81.76
ethernet-input                   active            1092996       160940736      
         0          1.46e1          147.25
l2-input                         active            1092996       160940736      
         0          1.29e1          147.25
l2-output                        active            1092996       160940736      
         0          6.88e0          147.25
—
Damjan



-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#18398): https://lists.fd.io/g/vpp-dev/message/18398
Mute This Topic: https://lists.fd.io/mt/79032447/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Reply via email to