// resending without attachment, as lists.fd.io<http://lists.fd.io> don’t like .jpeg cargo..
John, This is indeed a correct observation. On the first look it does look a bit weird. Maybe cause CSIT NDR and PDR discovery tests run with 10sec trials. And VM tests were the lucky ones, and we need more samples (more test executions) to get it right. But I’m guessing here, need more data.. In the soak tests I’ve been running, I noticed that some 60sec runs at 17.04 NDR (2x 4.6Mpps) are completing without a single frame loss. Some are completing at ~5% frame loss. But running the NIC-to-NIC soak test now for >43hrs, we do see pkt loss averaging at 0.001%. See attached screenshots from ixia. We would need to understand more about the nature of your code fixes (and added functionality), in order to explain this counterintuitive trend and adjust test case design to catch the results representative to expected and required behaviour. -Maciek On 13 Sep 2017, at 16:26, John Lo (loj) <l...@cisco.com<mailto:l...@cisco.com>> wrote: Looking at the new result, it appears that PNIC to PNIC performance mostly degrade slightly while PNIC to VM to PNIC performance mostly improved slightly or same from 17.04 to master. Does that seem right to you, Maciek? The L2FIB scale fix has been merged to both master and 17.07 already. These are the patches: 17.07 – https://gerrit.fd.io/r/#/c/8243/ Master – https://gerrit.fd.io/r/#/c/8289/ I will go ahead and close Jira ticket VPP-963. Regards, John From: vpp-dev-boun...@lists.fd.io<mailto:vpp-dev-boun...@lists.fd.io> [mailto:vpp-dev-boun...@lists.fd.io] On Behalf Of Maciek Konstantynowicz (mkonstan) Sent: Wednesday, September 13, 2017 10:28 AM To: Billy McFall <bmcf...@redhat.com<mailto:bmcf...@redhat.com>>; csit-...@lists.fd.io<mailto:csit-...@lists.fd.io>; vpp-dev <vpp-dev@lists.fd.io<mailto:vpp-dev@lists.fd.io>> Subject: Re: [vpp-dev] VPP Performance drop from 17.04 to 17.07 Hello, RECOMMENDATION After reviewing the results, CSIT team recommends to apply the l2fib MAC scale fix to vpp17.07 ASAP, as the fix greatly improves the NDR and PDR performance for all tested L2BD MAC scale scenarios. However, CSIT team wants to note that the VPP performance after the fix still shows a small regression compared to vpp17.04. Detail below.. FURTHER DETAIL Here the final update on CSIT verifying the code fix to correct VPP frame throughput for L2 bridging with higher scale MAC tables (bigger L2FIBs). Following number of CSIT jenkins jobs have been executed, each execution yielding one complete set of data, referred below as a sample. vpp master (with fix) tests - 10 samples vpp 17.04 tests - 6 samples The tests have been executed across all three physical testbeds present in FD.io<http://fd.io/> CSIT labs operated by LF IT and CSIT project team. Testbeds selection was pseudo-random based on testbed availability during jjb testbed allocation request. Breakdown of test results is included in updated .xlsx attachments to CSIT jira ticket CSIT-794 [5]. All other references for breakdown data stay unchanged [1]..[8]. In summary we report following relative FPS/PPS throughput change between vpp17.04 and vpp-master after the fix: 1,000,000 MAC entries in L2FIB up to 5% relative throughput drop 100,000 MAC entries in L2FIB up to 3% relative throughput drop 10,000 MAC entries in L2FIB up to 5% relative throughput drop In addition we have performed IXIA based soak tests over a period of over 36hrs (it's still running), with IXIA running at NDR rate (testcase: l2bdscale1mmaclrn-ndrdisc), with IXIA reporting 0.001% frame loss over the current duration of the test. Regards, -Maciek [1] CSIT-786 L2FIB scale testing [https://gerrit.fd.io/r/#/c/8145/ ge8145] [https://jira.fd.io/browse/CSIT-786 CSIT-786]; L2FIB scale testing for 10k, 100k, 1M FIB entries ./l2: 10ge2p1x520-eth-l2bdscale10kmaclrn-ndrpdrdisc.robot 10ge2p1x520-eth-l2bdscale100kmaclrn-ndrpdrdisc.robot 10ge2p1x520-eth-l2bdscale1mmaclrn-ndrpdrdisc.robot 10ge2p1x520-eth-l2bdscale10kmaclrn-eth-2vhostvr1024-1vm-cfsrr1-ndrpdrdisc 10ge2p1x520-eth-l2bdscale100kmaclrn-eth-2vhostvr1024-1vm-cfsrr1-ndrpdrdisc 10ge2p1x520-eth-l2bdscale1mmaclrn-eth-2vhostvr1024-1vm-cfsrr1-ndrpdrdisc [2] VPP master branch [https://gerrit.fd.io/r/#/c/8173/ ge8173]; [3] VPP stable/1707 [https://gerrit.fd.io/r/#/c/8167/ ge8167<https://gerrit.fd.io/r/#/c/8167/%20ge8167>]; [4] VPP stable/1704 [https://gerrit.fd.io/r/#/c/8172/ ge8172<https://gerrit.fd.io/r/#/c/8172/%20ge8172>]; [5] CSIT-794 VPP v17.07 L2BD yields lower NDR and PDR performance vs. v17.04, 20170825_l2fib_regression_10k_100k_1M.xlsx, [https://jira.fd.io/browse/CSIT-794 CSIT-794<https://jira.fd.io/browse/CSIT-794%20CSIT-794>]; [6] TRex v2.28 Ethernet FCS mis-calculation issue [https://jira.fd.io/browse/CSIT-793 CSIT-793<https://jira.fd.io/browse/CSIT-793%20CSIT-793>]; [7] commit 25ff2ea3a31e422094f6d91eab46222a29a77c4b; [8] VPP v17.07 L2BD NDR and PDR multi-thread performance broken [https://jira.fd.io/browse/VPP-963 VPP-963<https://jira.fd.io/browse/VPP-963%20VPP-963>];
_______________________________________________ vpp-dev mailing list vpp-dev@lists.fd.io https://lists.fd.io/mailman/listinfo/vpp-dev
