Hello, folks. This is the test results dashboard, not analytics on git/wiki/mailing list, etc, usage. Bitergia has a second contract with LF to provide visualizations for the various test projects output. Hope that clears things up :)
Regards, Mark Mark Beierl SW System Sr Principal Engineer Dell EMC | Cloud & Communication Service Provider Solution mobile +1 613 314 8106<tel:1-613-314-8106> mark.bei...@dell.com<mailto:mark.bei...@dell.com> On Jan 11, 2018, at 11:12, SULLIVAN, BRYAN L (BRYAN L) <bryan.sulli...@research.att.com<mailto:bryan.sulli...@research.att.com>> wrote: If it results in some gaps being better socialized and prioritized, it's a good idea to meet. E.g. I sent a request back in Nov and got no response... it was: I’d like the ability to view/download the full set of data for a particular query, e.g. as you have from stackalytics (setting for “Show <n> entries”). Thanks, Bryan Sullivan | AT&T -----Original Message----- From: opnfv-tech-discuss-boun...@lists.opnfv.org<mailto:opnfv-tech-discuss-boun...@lists.opnfv.org> [mailto:opnfv-tech-discuss-boun...@lists.opnfv.org] On Behalf Of Dave Neary Sent: Thursday, January 11, 2018 6:50 AM To: Yuyang (Gabriel) <gabriel.yuy...@huawei.com<mailto:gabriel.yuy...@huawei.com>>; 'opnfv-tech-discuss@lists.opnfv.org<mailto:opnfv-tech-discuss@lists.opnfv.org>' <opnfv-tech-discuss@lists.opnfv.org<mailto:opnfv-tech-discuss@lists.opnfv.org>>; test...@lists.opnfv.org<mailto:test...@lists.opnfv.org> Cc: Alberto Pérez García-Plaza <alpgar...@bitergia.com<mailto:alpgar...@bitergia.com>>; Alvaro del Castillo <a...@bitergia.com<mailto:a...@bitergia.com>>; Jesus M. Gonzalez-Barahona <j...@bitergia.com<mailto:j...@bitergia.com>> Subject: Re: [opnfv-tech-discuss] Collecting questions for the Biterg Dashboard Training //RE: Issues/Needs/requirements for Biterg dashboard Hi, Is the goal to get a better idea of how we can use the dashboard ("How can I tell how many companies were active in a project between date 1 and date 2, excluding LF employees? What data sources are available for query?" type questions), or is it to identify qualitative questions we would like to answer with data ("Are we keeping participants over time? Are there projects for which timely patch review/acknowledgement of issues is a challenge?") - understanding the goal of the tutorial would help with identifying the right questions to ask. Thanks, Dave. On 01/11/2018 04:40 AM, Yuyang (Gabriel) wrote: Hi Community, As discussed, Biterg will arrange a training session of OPNFV statistics dashboard for the community in test working group meeting. Basically, it will last about 1 hour as the usual first training covering the needs of navigating through panels, filtering the relevant results, sharing and exporting capabilities, etc. Before this wonderful thing could happen, it would better if you look at the dashboard first and feedback questions regarding the operations, visualizations, settings, statistics results and etc. as input for the training. So that the training session could meet your needs in more efficient manner. During last Testperf meeting, we have already discussed some needs and questions which are listed below. Please post your questions/needs behind. 1. How the commit number is calculated? What are involved in this metric? Including review? 2. When searching commit number for a specific person, there will be other persons involved in the results page. Are these persons for the calculation of reviews? 3. How should I search for the statistics results (commits, code line, patchsets, etc., ) of a project with aggregation results of companies, persons involved in this project 4. Needs for comprehensive introduction of the dashboard including every operations, filtering relevant information, where the dashboard retrieve datas, etc.? Thanks, Gabriel *From:*Yuyang (Gabriel) *Sent:* Thursday, January 04, 2018 9:43 AM *To:* 'Alberto Pérez García-Plaza' <alpgar...@bitergia.com<mailto:alpgar...@bitergia.com>> *Cc:* 'Alvaro del Castillo' <a...@bitergia.com<mailto:a...@bitergia.com>>; 'Raymond Paik' <rp...@linuxfoundation.org<mailto:rp...@linuxfoundation.org>>; 'mark.bei...@emc.com<mailto:mark.bei...@emc.com>' <mark.bei...@emc.com<mailto:mark.bei...@emc.com>>; 'Brandon Wick' <bw...@linuxfoundation.org<mailto:bw...@linuxfoundation.org>>; 'jalaus...@suse.com<mailto:jalaus...@suse.com>' <jalaus...@suse.com<mailto:jalaus...@suse.com>>; 'Rao, Sridhar' <sridhar....@spirent.com<mailto:sridhar....@spirent.com>>; 'Jesus M. Gonzalez-Barahona' <j...@bitergia.com<mailto:j...@bitergia.com>>; 'cedric.olliv...@orange.com<mailto:cedric.olliv...@orange.com>' <cedric.olliv...@orange.com<mailto:cedric.olliv...@orange.com>>; 'Brattain, Ross B' <ross.b.bratt...@intel.com<mailto:ross.b.bratt...@intel.com>>; 'Cooper, Trevor' <trevor.coo...@intel.com<mailto:trevor.coo...@intel.com>>; 'test...@lists.opnfv.org<mailto:test...@lists.opnfv.org>' <test...@lists.opnfv.org<mailto:test...@lists.opnfv.org>>; 'opnfv-tech-discuss@lists.opnfv.org<mailto:opnfv-tech-discuss@lists.opnfv.org>' <opnfv-tech-discuss@lists.opnfv.org<mailto:opnfv-tech-discuss@lists.opnfv.org>> *Subject:* RE: Issues/Needs/requirements for Biterg dashboard Hi Alberto, Do not know if you are back from holiday yet. Just want to check-in for the proposal and training session. Do you have some basic ideas now? Thanks, Gabriel *From:*Yuyang (Gabriel) *Sent:* Thursday, December 14, 2017 11:33 AM *To:* 'Alberto Pérez García-Plaza' <alpgar...@bitergia.com<mailto:alpgar...@bitergia.com> <mailto:alpgar...@bitergia.com>> *Cc:* Alvaro del Castillo <a...@bitergia.com<mailto:a...@bitergia.com> <mailto:a...@bitergia.com>>; Raymond Paik <rp...@linuxfoundation.org<mailto:rp...@linuxfoundation.org> <mailto:rp...@linuxfoundation.org>>; mark.bei...@emc.com<mailto:mark.bei...@emc.com> <mailto:mark.bei...@emc.com>; Brandon Wick <bw...@linuxfoundation.org<mailto:bw...@linuxfoundation.org> <mailto:bw...@linuxfoundation.org>>; jalaus...@suse.com<mailto:jalaus...@suse.com> <mailto:jalaus...@suse.com>; Rao, Sridhar <sridhar....@spirent.com<mailto:sridhar....@spirent.com> <mailto:sridhar....@spirent.com>>; Jesus M. Gonzalez-Barahona <j...@bitergia.com<mailto:j...@bitergia.com> <mailto:j...@bitergia.com>>; cedric.olliv...@orange.com<mailto:cedric.olliv...@orange.com> <mailto:cedric.olliv...@orange.com>; 'Brattain, Ross B' <ross.b.bratt...@intel.com<mailto:ross.b.bratt...@intel.com> <mailto:ross.b.bratt...@intel.com>>; Cooper, Trevor <trevor.coo...@intel.com<mailto:trevor.coo...@intel.com> <mailto:trevor.coo...@intel.com>>; test...@lists.opnfv.org<mailto:test...@lists.opnfv.org> <mailto:test...@lists.opnfv.org>; 'opnfv-tech-discuss@lists.opnfv.org<mailto:opnfv-tech-discuss@lists.opnfv.org>' <opnfv-tech-discuss@lists.opnfv.org<mailto:opnfv-tech-discuss@lists.opnfv.org> <mailto:opnfv-tech-discuss@lists.opnfv.org>> *Subject:* RE: Issues/Needs/requirements for Biterg dashboard Hi Alberto, During plugfest, we had some discussion about the Biterg dashboard regarding the strange values, subpages and the training session. 1. As to the strange values, it’d be better we leave them to corresponding testing projects to decide whether or not to correct. 2. I have found Morgan’s slides on the subpages for testing projects: https://urldefense.proofpoint.com/v2/url?u=https-3A__wiki.opnfv.org_download_attachments_2926539_Sync-2520Bitergia-2520092017.pptx-3Fversion-3D1-26modificationDate-3D1505987158000-26api-3Dv2&d=DwIGaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=ML-JPRZQOfToJjMwlJLPlcWimAEwMA5DZGNIrk-cgy0&m=M4WyxD79MdKiV1ur-V2JqPcZ9LzaQGyxQCnCSYMbxaY&s=9L15BSrM_I20f-id5aqsoPuJfwcm1qGclcTM33p_LrE&e= where we have the visualizations of testing results. However, as I mentioned before, in my mind the dashboard could automatically generate search results page for different project/keyword. Project that has special needs could sent out requirements for its subpage. Before that, please refer to the slides for the testing results of test cases for your proposal 3. As to the Biterg dashboard training session, it is suggested that we have it in Testperf Meeting and be recorded. My guess is that 30-40 mins is enough to show operations and customizations. What your opinion? Thanks a lot! Gabriel *From:*Alberto Pérez García-Plaza [mailto:alpgar...@bitergia.com] *Sent:* Monday, November 20, 2017 11:53 PM *To:* Yuyang (Gabriel) <gabriel.yuy...@huawei.com<mailto:gabriel.yuy...@huawei.com> <mailto:gabriel.yuy...@huawei.com>> *Cc:* Alvaro del Castillo <a...@bitergia.com<mailto:a...@bitergia.com> <mailto:a...@bitergia.com>>; Raymond Paik <rp...@linuxfoundation.org<mailto:rp...@linuxfoundation.org> <mailto:rp...@linuxfoundation.org>>; mark.bei...@emc.com<mailto:mark.bei...@emc.com> <mailto:mark.bei...@emc.com>; Brandon Wick <bw...@linuxfoundation.org<mailto:bw...@linuxfoundation.org> <mailto:bw...@linuxfoundation.org>>; jalaus...@suse.com<mailto:jalaus...@suse.com> <mailto:jalaus...@suse.com>; Rao, Sridhar <sridhar....@spirent.com<mailto:sridhar....@spirent.com> <mailto:sridhar....@spirent.com>>; Jesus M. Gonzalez-Barahona <j...@bitergia.com<mailto:j...@bitergia.com> <mailto:j...@bitergia.com>>; cedric.olliv...@orange.com<mailto:cedric.olliv...@orange.com> <mailto:cedric.olliv...@orange.com>; 'Brattain, Ross B' <ross.b.bratt...@intel.com<mailto:ross.b.bratt...@intel.com> <mailto:ross.b.bratt...@intel.com>>; Cooper, Trevor <trevor.coo...@intel.com<mailto:trevor.coo...@intel.com> <mailto:trevor.coo...@intel.com>>; test...@lists.opnfv.org<mailto:test...@lists.opnfv.org> <mailto:test...@lists.opnfv.org>; 'opnfv-tech-discuss@lists.opnfv.org<mailto:opnfv-tech-discuss@lists.opnfv.org>' <opnfv-tech-discuss@lists.opnfv.org<mailto:opnfv-tech-discuss@lists.opnfv.org> <mailto:opnfv-tech-discuss@lists.opnfv.org>> *Subject:* Re: Issues/Needs/requirements for Biterg dashboard Hi Gabriel, thanks so much. I'll prepare the proposal asap. Hope to do it during the next couple of weeks as I am a bit busy. Regarding 1, let me know as soon as you decide how to proceed to schedule the actions needed on our side. Cheers, Alberto. El 17/11/17 a las 04:34, Yuyang (Gabriel) escribió: Hi, As discussed yesterday, Alberto will provide *a proposal *for the dashboarding of testing projects together with*a training *for the community regarding the customization of the ELK dashboard. Before that, there are still several issues we need to resolve. 1. Strange values for version, criteria and scenario. We need to decide how we deal with these values. During the discussion we have 3 options here: a) We can make the dashboard not show the results from these values, i.e., screening the results from these values b) Each project to correct the values in TestDB to compliant with our Naming Conventions c) We correct as many as we can and leave the ones for project-wise purposes. Project Version Criteria Scenario Bottlenecks stable/Euphrates None None QTIP None 1640, 1777, 1785, 1562, 1734, 1662, 1669, 1636 generic VSPERF OVScc3a32f3b6891168cee98812e8f5e3d8a5a52c98 DPDK v17.02 OVScc3a32f3b6891168cee98812e8f5e3d8a5a52c98 OVScc3a32f3b6891168cee98812e8f5e3d8a5a52c98 DPDK not used OVSed26e3ea9995ba632e681d5990af5ee9814f650e DPDK v16.07 None vsperf 2. Needs/requirements/necessity for generating subpages for testing projects. There has been a long discussion about the subpages for testing projects in Biterg dashboard. Since the dashboard could automatically generate search results page for different project/keyword, we need to collect special needs for projects if the they are planning to show a subpage under the testing tab. There is a table below made by Morgan summarizing the needs/issues for this purpose. If you are planning to create a subpage, please make sure that the testing results of your test cases are pushed to TestDB and send the example graphs to Biterg team. Alberto will make a proposal based on the needs (for the projects that need a subpage) *Project* *Subpage Status* *OPNFV contacts* *Customized expected * *graph(s) * *Comments* Functest created <https://urldefense.proofpoint.com/v2/url?u=https-3A__opnfv.biterg.io_goto_141bf895a14364f7408d0a77ac16e4bc&d=DwIGaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=ML-JPRZQOfToJjMwlJLPlcWimAEwMA5DZGNIrk-cgy0&m=M4WyxD79MdKiV1ur-V2JqPcZ9LzaQGyxQCnCSYMbxaY&s=sjCf-tjny39FL3L9o6XaSyf8I1bLAweESWC4w1QesSU&e= > cedric.olliv...@orange.com<mailto:cedric.olliv...@orange.com> <mailto:cedric.olliv...@orange.com> jalaus...@suse.com<mailto:jalaus...@suse.com> <mailto:jalaus...@suse.com> 1 graph : - (Runs, Failures, Cases) = f(time) display error on the test run/fail/skip graphs –only Sum of Failures displayed Graphs can be used for tempest/refstack/snaps_smoke storperf not created mark.bei...@emc.com<mailto:mark.bei...@emc.com> <mailto:mark.bei...@emc.com> 1 graph - Bandwidth(bandwidth, average bandwidth, 110 % average, 90 % average, slope) = f(time) storperf created a docker for reporting https://urldefense.proofpoint.com/v2/url?u=http-3A__docs.opnfv.org_en_latest_submodules_storperf_docs_testing_user_storperf-2Dreporting.html&d=DwIGaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=ML-JPRZQOfToJjMwlJLPlcWimAEwMA5DZGNIrk-cgy0&m=M4WyxD79MdKiV1ur-V2JqPcZ9LzaQGyxQCnCSYMbxaY&s=VyVBXkGMtDj1tDMlO-SCfjjE5xef4l5NCvUwC5lGtqc&e= VSPERF not created sridhar....@spirent.com<mailto:sridhar....@spirent.com> <mailto:sridhar....@spirent.com> 2 graphs - Frames(64,128,512,1024,1518) = f(time) - Fps(64,128,512,1024,1518) = f(time) https://urldefense.proofpoint.com/v2/url?u=https-3A__wiki.opnfv.org_display_vsperf_VSPERF-2BCI-2BResults&d=DwIGaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=ML-JPRZQOfToJjMwlJLPlcWimAEwMA5DZGNIrk-cgy0&m=M4WyxD79MdKiV1ur-V2JqPcZ9LzaQGyxQCnCSYMbxaY&s=a1LA6vJbVG9EDQ-ytRztlipw5qOohp90B8zLUzTGCP4&e= bottlenecks not created gabriel.yuy...@huawei.com<mailto:gabriel.yuy...@huawei.com> <mailto:gabriel.yuy...@huawei.com> Example done on local Kibana by Bottleneck team problem as 1 graph = 1 result ( no time based) : which result shall be represented / not matching usual filtering models qtip not created zhangyujun+...@gmail.com<mailto:zhangyujun+...@gmail.com> <mailto:zhangyujun+...@gmail.com> ?? yardstick not created ross.b.bratt...@intel.com<mailto:ross.b.bratt...@intel.com> <mailto:ross.b.bratt...@intel.com> jean.gaoli...@huawei.com<mailto:jean.gaoli...@huawei.com> <mailto:jean.gaoli...@huawei.com> None ? yardstick has already a complete dashboarding solution based on grafana –no need for subpages in bitergia ? Best, Gabriel _______________________________________________ opnfv-tech-discuss mailing list opnfv-tech-discuss@lists.opnfv.org<mailto:opnfv-tech-discuss@lists.opnfv.org> https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.opnfv.org_mailman_listinfo_opnfv-2Dtech-2Ddiscuss&d=DwIGaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=ML-JPRZQOfToJjMwlJLPlcWimAEwMA5DZGNIrk-cgy0&m=M4WyxD79MdKiV1ur-V2JqPcZ9LzaQGyxQCnCSYMbxaY&s=Q_Aj1s4x0QGlUyklGcnLeZwl6UbHxeq10SYK65SUKtY&e= -- Dave Neary - NFV/SDN Community Strategy Open Source and Standards, Red Hat - https://urldefense.proofpoint.com/v2/url?u=http-3A__community.redhat.com&d=DwIGaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=ML-JPRZQOfToJjMwlJLPlcWimAEwMA5DZGNIrk-cgy0&m=M4WyxD79MdKiV1ur-V2JqPcZ9LzaQGyxQCnCSYMbxaY&s=2afDDqVn0trDSSLpWj4Lw_0irCGvnCgFTVdrrFADRUQ&e= Ph: +1-978-399-2182 / Cell: +1-978-799-3338 _______________________________________________ opnfv-tech-discuss mailing list opnfv-tech-discuss@lists.opnfv.org<mailto:opnfv-tech-discuss@lists.opnfv.org> https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.opnfv.org_mailman_listinfo_opnfv-2Dtech-2Ddiscuss&d=DwIGaQ&c=LFYZ-o9_HUMeMTSQicvjIg&r=ML-JPRZQOfToJjMwlJLPlcWimAEwMA5DZGNIrk-cgy0&m=M4WyxD79MdKiV1ur-V2JqPcZ9LzaQGyxQCnCSYMbxaY&s=Q_Aj1s4x0QGlUyklGcnLeZwl6UbHxeq10SYK65SUKtY&e= _______________________________________________ opnfv-tech-discuss mailing list opnfv-tech-discuss@lists.opnfv.org https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss
_______________________________________________ opnfv-tech-discuss mailing list opnfv-tech-discuss@lists.opnfv.org https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss
