Hi Community, As discussed, Biterg will arrange a training session of OPNFV statistics dashboard for the community in test working group meeting. Basically, it will last about 1 hour as the usual first training covering the needs of navigating through panels, filtering the relevant results, sharing and exporting capabilities, etc. Before this wonderful thing could happen, it would better if you look at the dashboard first and feedback questions regarding the operations, visualizations, settings, statistics results and etc. as input for the training. So that the training session could meet your needs in more efficient manner.
During last Testperf meeting, we have already discussed some needs and questions which are listed below. Please post your questions/needs behind. 1. How the commit number is calculated? What are involved in this metric? Including review? 2. When searching commit number for a specific person, there will be other persons involved in the results page. Are these persons for the calculation of reviews? 3. How should I search for the statistics results (commits, code line, patchsets, etc., ) of a project with aggregation results of companies, persons involved in this project 4. Needs for comprehensive introduction of the dashboard including every operations, filtering relevant information, where the dashboard retrieve datas, etc.? Thanks, Gabriel From: Yuyang (Gabriel) Sent: Thursday, January 04, 2018 9:43 AM To: 'Alberto Pérez García-Plaza' <alpgar...@bitergia.com> Cc: 'Alvaro del Castillo' <a...@bitergia.com>; 'Raymond Paik' <rp...@linuxfoundation.org>; 'mark.bei...@emc.com' <mark.bei...@emc.com>; 'Brandon Wick' <bw...@linuxfoundation.org>; 'jalaus...@suse.com' <jalaus...@suse.com>; 'Rao, Sridhar' <sridhar....@spirent.com>; 'Jesus M. Gonzalez-Barahona' <j...@bitergia.com>; 'cedric.olliv...@orange.com' <cedric.olliv...@orange.com>; 'Brattain, Ross B' <ross.b.bratt...@intel.com>; 'Cooper, Trevor' <trevor.coo...@intel.com>; 'test...@lists.opnfv.org' <test...@lists.opnfv.org>; 'opnfv-tech-discuss@lists.opnfv.org' <opnfv-tech-discuss@lists.opnfv.org> Subject: RE: Issues/Needs/requirements for Biterg dashboard Hi Alberto, Do not know if you are back from holiday yet. Just want to check-in for the proposal and training session. Do you have some basic ideas now? Thanks, Gabriel From: Yuyang (Gabriel) Sent: Thursday, December 14, 2017 11:33 AM To: 'Alberto Pérez García-Plaza' <alpgar...@bitergia.com<mailto:alpgar...@bitergia.com>> Cc: Alvaro del Castillo <a...@bitergia.com<mailto:a...@bitergia.com>>; Raymond Paik <rp...@linuxfoundation.org<mailto:rp...@linuxfoundation.org>>; mark.bei...@emc.com<mailto:mark.bei...@emc.com>; Brandon Wick <bw...@linuxfoundation.org<mailto:bw...@linuxfoundation.org>>; jalaus...@suse.com<mailto:jalaus...@suse.com>; Rao, Sridhar <sridhar....@spirent.com<mailto:sridhar....@spirent.com>>; Jesus M. Gonzalez-Barahona <j...@bitergia.com<mailto:j...@bitergia.com>>; cedric.olliv...@orange.com<mailto:cedric.olliv...@orange.com>; 'Brattain, Ross B' <ross.b.bratt...@intel.com<mailto:ross.b.bratt...@intel.com>>; Cooper, Trevor <trevor.coo...@intel.com<mailto:trevor.coo...@intel.com>>; test...@lists.opnfv.org<mailto:test...@lists.opnfv.org>; 'opnfv-tech-discuss@lists.opnfv.org' <opnfv-tech-discuss@lists.opnfv.org<mailto:opnfv-tech-discuss@lists.opnfv.org>> Subject: RE: Issues/Needs/requirements for Biterg dashboard Hi Alberto, During plugfest, we had some discussion about the Biterg dashboard regarding the strange values, subpages and the training session. 1. As to the strange values, it’d be better we leave them to corresponding testing projects to decide whether or not to correct. 2. I have found Morgan’s slides on the subpages for testing projects: https://wiki.opnfv.org/download/attachments/2926539/Sync%20Bitergia%20092017.pptx?version=1&modificationDate=1505987158000&api=v2 where we have the visualizations of testing results. However, as I mentioned before, in my mind the dashboard could automatically generate search results page for different project/keyword. Project that has special needs could sent out requirements for its subpage. Before that, please refer to the slides for the testing results of test cases for your proposal 3. As to the Biterg dashboard training session, it is suggested that we have it in Testperf Meeting and be recorded. My guess is that 30-40 mins is enough to show operations and customizations. What your opinion? Thanks a lot! Gabriel From: Alberto Pérez García-Plaza [mailto:alpgar...@bitergia.com] Sent: Monday, November 20, 2017 11:53 PM To: Yuyang (Gabriel) <gabriel.yuy...@huawei.com<mailto:gabriel.yuy...@huawei.com>> Cc: Alvaro del Castillo <a...@bitergia.com<mailto:a...@bitergia.com>>; Raymond Paik <rp...@linuxfoundation.org<mailto:rp...@linuxfoundation.org>>; mark.bei...@emc.com<mailto:mark.bei...@emc.com>; Brandon Wick <bw...@linuxfoundation.org<mailto:bw...@linuxfoundation.org>>; jalaus...@suse.com<mailto:jalaus...@suse.com>; Rao, Sridhar <sridhar....@spirent.com<mailto:sridhar....@spirent.com>>; Jesus M. Gonzalez-Barahona <j...@bitergia.com<mailto:j...@bitergia.com>>; cedric.olliv...@orange.com<mailto:cedric.olliv...@orange.com>; 'Brattain, Ross B' <ross.b.bratt...@intel.com<mailto:ross.b.bratt...@intel.com>>; Cooper, Trevor <trevor.coo...@intel.com<mailto:trevor.coo...@intel.com>>; test...@lists.opnfv.org<mailto:test...@lists.opnfv.org>; 'opnfv-tech-discuss@lists.opnfv.org' <opnfv-tech-discuss@lists.opnfv.org<mailto:opnfv-tech-discuss@lists.opnfv.org>> Subject: Re: Issues/Needs/requirements for Biterg dashboard Hi Gabriel, thanks so much. I'll prepare the proposal asap. Hope to do it during the next couple of weeks as I am a bit busy. Regarding 1, let me know as soon as you decide how to proceed to schedule the actions needed on our side. Cheers, Alberto. El 17/11/17 a las 04:34, Yuyang (Gabriel) escribió: Hi, As discussed yesterday, Alberto will provide a proposal for the dashboarding of testing projects together with a training for the community regarding the customization of the ELK dashboard. Before that, there are still several issues we need to resolve. 1. Strange values for version, criteria and scenario. We need to decide how we deal with these values. During the discussion we have 3 options here: a) We can make the dashboard not show the results from these values, i.e., screening the results from these values b) Each project to correct the values in TestDB to compliant with our Naming Conventions c) We correct as many as we can and leave the ones for project-wise purposes. Project Version Criteria Scenario Bottlenecks stable/Euphrates None None QTIP None 1640, 1777, 1785, 1562, 1734, 1662, 1669, 1636 generic VSPERF OVScc3a32f3b6891168cee98812e8f5e3d8a5a52c98 DPDK v17.02 OVScc3a32f3b6891168cee98812e8f5e3d8a5a52c98 OVScc3a32f3b6891168cee98812e8f5e3d8a5a52c98 DPDK not used OVSed26e3ea9995ba632e681d5990af5ee9814f650e DPDK v16.07 None vsperf 2. Needs/requirements/necessity for generating subpages for testing projects. There has been a long discussion about the subpages for testing projects in Biterg dashboard. Since the dashboard could automatically generate search results page for different project/keyword, we need to collect special needs for projects if the they are planning to show a subpage under the testing tab. There is a table below made by Morgan summarizing the needs/issues for this purpose. If you are planning to create a subpage, please make sure that the testing results of your test cases are pushed to TestDB and send the example graphs to Biterg team. Alberto will make a proposal based on the needs (for the projects that need a subpage) Project Subpage Status OPNFV contacts Customized expected graph(s) Comments Functest created<https://opnfv.biterg.io/goto/141bf895a14364f7408d0a77ac16e4bc> cedric.olliv...@orange.com<mailto:cedric.olliv...@orange.com> jalaus...@suse.com<mailto:jalaus...@suse.com> 1 graph : - (Runs, Failures, Cases) = f(time) display error on the test run/fail/skip graphs – only Sum of Failures displayed Graphs can be used for tempest/refstack/snaps_smoke storperf not created mark.bei...@emc.com<mailto:mark.bei...@emc.com> 1 graph - Bandwidth(bandwidth, average bandwidth, 110 % average, 90 % average, slope) = f(time) storperf created a docker for reporting http://docs.opnfv.org/en/latest/submodules/storperf/docs/testing/user/storperf-reporting.html VSPERF not created sridhar....@spirent.com<mailto:sridhar....@spirent.com> 2 graphs - Frames(64,128,512,1024,1518) = f(time) - Fps(64,128,512,1024,1518) = f(time) https://wiki.opnfv.org/display/vsperf/VSPERF+CI+Results bottlenecks not created gabriel.yuy...@huawei.com<mailto:gabriel.yuy...@huawei.com> Example done on local Kibana by Bottleneck team problem as 1 graph = 1 result ( no time based) : which result shall be represented / not matching usual filtering models qtip not created zhangyujun+...@gmail.com<mailto:zhangyujun+...@gmail.com> ?? yardstick not created ross.b.bratt...@intel.com<mailto:ross.b.bratt...@intel.com> jean.gaoli...@huawei.com<mailto:jean.gaoli...@huawei.com> None ? yardstick has already a complete dashboarding solution based on grafana – no need for subpages in bitergia ? Best, Gabriel
_______________________________________________ opnfv-tech-discuss mailing list opnfv-tech-discuss@lists.opnfv.org https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss
