+Serena, Julien Thanks, Jack.
1. Data reported per scenario (i.e., jenkins job, deployment, functest, yardstick, etc. displayed together for each scenario) instead of separate test silos. 2. Include deployment results 3. Include all Jenkins job results (failure to start, failure to complete, etc.) 4. Clear date/time stamps for every data point 5. Display the data above for the last x data points (e.g., 4, 5, 10 ?) 6. Use an easy-to-understand, unified scoring method for all test frameworks. As I mentioned, yesterday, Julien and Serena have been working on this, as well. Julien has developed a macro <https://gerrit.opnfv.org/gerrit/#/c/48515/> to enable consolidation of all results per scenario. He is intending to use the Daisy installer as a platform to verify the macro, which then can be adapted to other installers. In addition, Serena has agreed to help manage an intern who can assist with the project. I have an action to create an intern proposal for that purpose. David On Fri, Jan 19, 2018 at 1:23 AM, chenjiankun <chenjiank...@huawei.com> wrote: > Hi, > > > > As we discussed last test working group weekly meeting, we want to do test > resources aggregation. > > We plan to offer a new friendly web portal which contain all existing test > resource and more functions. > > > > I have a broad classification as bellow: > > 1. Data analysis > > a) Reporting(existing, For release) > > b) Bitergia(existing) > > c) Grafana(existing, For detailed test results) > > d) ……(maybe we can develop more tools to show our detailed test > results) > > 2. Test working group information(What information you want to see > from test working group? Test working group event? Event of each project?) > > 3. Tools of each project(Need each project member to complete) > > 4. ……(waiting for you to improve) > > > > > > This email is aim at collecting requirements for test resources, so if you > have any idea about classification, existing tools(such as reporting), new > functions you want, please do not hesitate to comment here. > > As Gabriel said, he will create a new wiki page for test resources > collection, so you can also comment there. > > > > @David, @Tim, can you repeat your advice about reporting here? I will try > my best to implement it. > > @All, all requirements, advice, comment are welcome~J > > > > BRs, > > Jack Chan > -- *David McBride* Release Manager, OPNFV Mobile: +1.805.276.8018 Email/Google Talk: dmcbr...@linuxfoundation.org Skype: davidjmcbride1 IRC: dmcbride
_______________________________________________ opnfv-tech-discuss mailing list opnfv-tech-discuss@lists.opnfv.org https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss