Thanks Ray, and well spotted re regressions..
We were still collecting data on those, as they have been masked before
by another issue related to VPP plugins (jira CSIT-925) that confused
CSIT performance trending machinery, and it was unclear if it was CSIT
environment or VPP code.
We made progress there, Jira tickets tracking identified four performance
regression issues status and the resolution plan:
1. CSIT-925 rls1801 plugin related performance regression
2. CSIT-926 rls1801 generic small performance regression ip4base, l2xcbase,
l2bdbase
3. CSIT-927 rls1801 substantial NDR performance regression for vhost-user
vring size of 1024
4. CSIT-928 rls1801 substantial NDR/PDR regression for IPSec tunnel scale
with HW QAT crypto-dev
Known issues updated in rls1801 report:
https://git.fd.io/csit/tree/docs/report/vpp_performance_tests/csit_release_notes.rst?h=rls1801
The html report will be updated once csit-report-merge-1801 job is done:
https://jenkins.fd.io/view/csit/job/csit-report-merge-1801/7/
https://docs.fd.io/csit/rls1801/report/vpp_performance_tests/csit_release_notes.html#known-issues
Need few hands from vpp-dev to get the issues resolved :)
I can provide update on VPP call later today..
Cheers,
-Maciek
> On 20 Feb 2018, at 09:16, Ray Kinsella <m...@ashroe.eu> wrote:
>
>
> w00t, much kudos, always hugely valuable.
>
> There are some pretty significant regression on both xl710 and x520 for vhost
> and ipsec use cases at the bottom of the table. The most of significant of
> these is a 42% drop in the performance of
> 10ge2p1x520-64b-1t1c-eth-l2xcbase-eth-2vhostvr1024-1vm for instance.
>
> https://docs.fd.io/csit/rls1801/report/_static/vpp/performance-changes-ndr-1t1c-full.txt
>
> I don't see any 'Known Issues' covering these?
>
> Ray K
>
> On 19/02/2018 17:06, Maciek Konstantynowicz (mkonstan) wrote:
>> Dear FD.io <http://FD.io> community,
>> *The CSIT rls1801 report is now published on FD.io <http://FD.io> docs site:*
>> *html: *https://docs.fd.io/csit/rls1801/report/
>> *pdf:*
>> https://docs.fd.io/csit/rls1801/report/_static/archive/csit_rls1801.pdf
>> *Many Thanks to All CSIT Contributors and Committers that made CSIT rls1801*
>> *happen !*
>> *
>> *
>> *Many Thanks also to Everyone who collaborated with CSIT project including*
>> *VPP of course, HoneyComb, goVPP, TRex and other FD.io <http://FD.io>
>> sub-projects.*
>> Linked report includes results of i) VPP performance and functional
>> tests for VPP v18.01.1, ii) Testpmd performance tests for DPDK v17.11,
>> iii) Honeycomb functional tests and iv) reference to VPP unit tests.
>> *Points of note in rls1801 report:*
>> * - CSIT infrastructure changes and added tests for VPP and HoneyComb:*
>> -
>> https://docs.fd.io/csit/rls1801/report/vpp_performance_tests/csit_release_notes.html#changes-in-csit-release
>> -
>> https://docs.fd.io/csit/rls1801/report/honeycomb_functional_tests/csit_release_notes.html#changes-in-csit-release
>> * - Measured VPP performance changes vs. rls1710 - now reported for ALL*
>> * CSIT performance tests:*
>> -
>> https://docs.fd.io/csit/rls1801/report/vpp_performance_tests/csit_release_notes.html#performance-changes
>> * - Performance graphs - packet throughput, throughput speedup multi-core*
>> * and latency for VPP and DPDK-Testpmd:*
>> -
>> https://docs.fd.io/csit/rls1801/report/vpp_performance_tests/packet_throughput_graphs/
>> -
>> https://docs.fd.io/csit/rls1801/report/vpp_performance_tests/throughput_speedup_multi_core/
>> -
>> https://docs.fd.io/csit/rls1801/report/vpp_performance_tests/packet_latency_graphs/
>> -
>> https://docs.fd.io/csit/rls1801/report/dpdk_performance_tests/packet_throughput_graphs/
>> -
>> https://docs.fd.io/csit/rls1801/report/dpdk_performance_tests/packet_latency_graphs/
>> * - VPP configurations used per test case:*
>> -
>> https://docs.fd.io/csit/rls1801/report/test_configuration/vpp_performance_configuration/
>> -
>> https://docs.fd.io/csit/rls1801/report/test_configuration/vpp_functional_configuration/
>> * - VPP operational data - "show runtime” outputs at NDR rate with CPU
>> core*
>> * clock cycles spent per worker node per packet:*
>> -
>> https://docs.fd.io/csit/rls1801/report/test_operational_data/vpp_performance_operational_data/
>> * - CSIT Framework - updated Presentation and Analytics Layer to enable*
>> * continuous performance regression tracking:*
>> -
>> https://docs.fd.io/csit/rls1801/report/csit_framework_documentation/pal_lld.html#data-analytics
>> We hope you find this report useful and applicable.
>> Please send your feedback and comments by email to csit-...@lists.fd.io
>> <mailto:csit-...@lists.fd.io>.
>> Cheers,
>> -Maciek
>> On behalf of FD.io <http://FD.io> CSIT project.
>
>
>
-=-=-=-=-=-=-=-=-=-=-=-
Links:
You receive all messages sent to this group.
View/Reply Online (#8283): https://lists.fd.io/g/vpp-dev/message/8283
View All Messages In Topic (4): https://lists.fd.io/g/vpp-dev/topic/12126069
Mute This Topic: https://lists.fd.io/mt/12126069/21656
New Topic: https://lists.fd.io/g/vpp-dev/post
Change Your Subscription: https://lists.fd.io/g/vpp-dev/editsub/21656
Group Home: https://lists.fd.io/g/vpp-dev
Contact Group Owner: vpp-dev+ow...@lists.fd.io
Terms of Service: https://lists.fd.io/static/tos
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub
-=-=-=-=-=-=-=-=-=-=-=-
