Re: [onap-discuss][integration] TestVNF demo and discussion
Hi, Its great that I think everybody is actually thinking along the same lines and I think we just have to figure out how to combine efforts and ideas in the best way. I think what we are proposing would be to extent the “basic_vm” in a flexible way that would allow for the first level of ONAP functional and scale testing. Hopefully we can get a path forward between Monday and the integration meeting on Wednesday. /Andrew From: morgan.richo...@orange.com Sent: 04 October 2018 14:18 To: Ajith Sreekumar ; Andrew Fenner ; onap-discuss@lists.onap.org Cc: helen.c...@huawei.com; OLLIVIER Cédric IMT/OLN Subject: Re: [onap-discuss][integration] TestVNF demo and discussion Hi Andrew during the ONS summit in Amsterdam last week we made a similar demo based on the automated tests we introduced in our CI/CD chains for the Orange Openlab: https://events.linuxfoundation.org/wp-content/uploads/2017/12/Orange-Openlab-A-Full-Automated-Telco-Stack-for-the-Community-David-Blaisonneau-Nicolas-Edel-Orange.pdf Basically we thought that the healthcheck were not enough for our CI/CD chains, that is why we integrated these simple end to end tests based on Open Source VNFs. This topic was introduced during Los Angeles ONS one year ago, we asked for a repository at that time from integration project but did not get it so we pushed our code on gitlab.com. https://gitlab.com/Orange-OpenSource/onap-tests The idea for us was to be able to run basic end to end ONAP test. Robot is already providing a complete vFW case and could be reused for such needs. We were not so familiar with Robot and wanted something simple, generic and usable as a lib to be included in other portal such as the one for teh TMF API (https://events.linuxfoundation.org/wp-content/uploads/2017/12/SDO-Open-Source-When-TMF-APIs-Meet-ONAP-Ren%C3%A9-Robert-Matthieu-Geerebaert-Orange.pdf => https://gitlab.com/Orange-OpenSource/onap_new_portal For the moment we integrated 3 test cases - basic_vm: deploy a simple Ubuntu VM through ONAP: really basic but it helps us to identify issues regularly (even the helathcheck claims everything is OK) - last one was a disk full in SO, all pods/supervizion were happy and running but an exception occured in BPMN module of SO - freeradius_nbi: very basic one as well, a freeradius server installed at VM boot. But we instantiate the VM through the NBI module => allows to see if NBI is still OK - clearwater_ims: this VNF is already onboarded in OPNFV functest with several orchestrators: heat, cloudify (and previously openBaton, open-O). I need to complete the ONAP case by adding all the default signaling tests already integrated in OPNFV for the other orchestrators. and for each VNF, the test case performs the following actions - onboarding of the solution based on a template heat. it performs all the SDC operations and generates the tosca files - instantiation of the VNFn concretely chaining of actions done manually through the VID including the SDNC preload - clean of the VNF (delete the VF module, VNF, service + delete the associated preload) All these test cases are integrated in xtesting framework a lightweight framework developped in OPNFV (https://events.linuxfoundation.org/wp-content/uploads/2017/12/LFN-Xcommunities-Testing-Morgan-Richomme-Cedric-Ollivier-Orange.pdf). so we are consistant in the way to launch all our tests: the infrastructure tests on OpenStack, then on Kubernetes and the Onap tests (healthhcheck tests embedded in xtesting + end 2 end VNFs) concretely we run a docker or a kubernetes job I added the logs associated with such tests in copy If needed and if some space in the agenda we can plan a demo during the next integration meeting on Wednesday. Regards Morgan Le mercredi 03 octobre 2018 à 18:59 +, Andrew Fenner a écrit : [onap-discuss][integration] TestVNF demo and discussion Lieu : zoom call https://zoom.us/j/44 Heure de début : lundi 17:00 Heure de fin : lundi 18:00 Hi, A discussion on the need for a TestVNF with a demonstration of a prototype of a possible approach to the solution. Can you please look at the Jira https://jira.onap.org/browse/INT-355<https://urldefense.proofpoint.com/v2/url?u=https-3A__jira.onap.org_browse_INT-2D355=DwMGaQ=LFYZ-o9_HUMeMTSQicvjIg=KgFIQiUJzSC0gUhJaQxg8eC3w16GC3sKgWIcs4iIee0=kG12w7U2YM6hhEUwEZyHPSVusPMPWJNSYMD-oCm2LeE=ibOFZltoPF0bkEA9xNBD7bKypd1rrFSPF5varoQJ5Xg=<https://jira.onap.org/browse/INT-355%3chttps:/urldefense.proofpoint.com/v2/url?u=https-3A__jira.onap.org_browse_INT-2D355=DwMGaQ=LFYZ-o9_HUMeMTSQicvjIg=KgFIQiUJzSC0gUhJaQxg8eC3w16GC3sKgWIcs4iIee0=kG12w7U2YM6hhEUwEZyHPSVusPMPWJNSYMD-oCm2LeE=ibOFZltoPF0bkEA9xNBD7bKypd1rrFSPF5varoQJ5Xg=>> for my initial thinking and look at https://wiki.onap.org/download/attachments/16002054/BeijingDevForum2017-Dec-13-main-0.mp4?version=1=1513294598000=v2<https://urldefense.proofpoint.com/v2/url?u=https-3A__wiki.onap.org_download_attachments_1600205
Re: [onap-discuss][integration] TestVNF demo and discussion
I have added it to the next week’s Integration meeting agenda. As we have discussed at Amsterdam, the checking of infrastructure part is also very helpful as well. We have experienced so many infra issues. If we could add the “cloud” check before our other health check flow, that would be great. In addition, as Brian mentioned, I like those extra automated use cases as well. Regards, Helen Chen From: onap-discuss on behalf of Morgan Richomme Reply-To: onap-discuss , Morgan Richomme Date: Thursday, October 4, 2018 at 6:17 AM To: "ajith.sreeku...@ericsson.com" , "andrew.fen...@ericsson.com" , onap-discuss Cc: Helen Chen 00725961 , OLLIVIER Cédric IMT/OLN Subject: Re: [onap-discuss][integration] TestVNF demo and discussion Hi Andrew during the ONS summit in Amsterdam last week we made a similar demo based on the automated tests we introduced in our CI/CD chains for the Orange Openlab: https://events.linuxfoundation.org/wp-content/uploads/2017/12/Orange-Openlab-A-Full-Automated-Telco-Stack-for-the-Community-David-Blaisonneau-Nicolas-Edel-Orange.pdf Basically we thought that the healthcheck were not enough for our CI/CD chains, that is why we integrated these simple end to end tests based on Open Source VNFs. This topic was introduced during Los Angeles ONS one year ago, we asked for a repository at that time from integration project but did not get it so we pushed our code on gitlab.com. https://gitlab.com/Orange-OpenSource/onap-tests The idea for us was to be able to run basic end to end ONAP test. Robot is already providing a complete vFW case and could be reused for such needs. We were not so familiar with Robot and wanted something simple, generic and usable as a lib to be included in other portal such as the one for teh TMF API (https://events.linuxfoundation.org/wp-content/uploads/2017/12/SDO-Open-Source-When-TMF-APIs-Meet-ONAP-Ren%C3%A9-Robert-Matthieu-Geerebaert-Orange.pdf => https://gitlab.com/Orange-OpenSource/onap_new_portal For the moment we integrated 3 test cases - basic_vm: deploy a simple Ubuntu VM through ONAP: really basic but it helps us to identify issues regularly (even the helathcheck claims everything is OK) - last one was a disk full in SO, all pods/supervizion were happy and running but an exception occured in BPMN module of SO - freeradius_nbi: very basic one as well, a freeradius server installed at VM boot. But we instantiate the VM through the NBI module => allows to see if NBI is still OK - clearwater_ims: this VNF is already onboarded in OPNFV functest with several orchestrators: heat, cloudify (and previously openBaton, open-O). I need to complete the ONAP case by adding all the default signaling tests already integrated in OPNFV for the other orchestrators. and for each VNF, the test case performs the following actions - onboarding of the solution based on a template heat. it performs all the SDC operations and generates the tosca files - instantiation of the VNFn concretely chaining of actions done manually through the VID including the SDNC preload - clean of the VNF (delete the VF module, VNF, service + delete the associated preload) All these test cases are integrated in xtesting framework a lightweight framework developped in OPNFV (https://events.linuxfoundation.org/wp-content/uploads/2017/12/LFN-Xcommunities-Testing-Morgan-Richomme-Cedric-Ollivier-Orange.pdf). so we are consistant in the way to launch all our tests: the infrastructure tests on OpenStack, then on Kubernetes and the Onap tests (healthhcheck tests embedded in xtesting + end 2 end VNFs) concretely we run a docker or a kubernetes job I added the logs associated with such tests in copy If needed and if some space in the agenda we can plan a demo during the next integration meeting on Wednesday. Regards Morgan Le mercredi 03 octobre 2018 à 18:59 +, Andrew Fenner a écrit : [onap-discuss][integration] TestVNF demo and discussion Lieu : zoom call https://zoom.us/j/44 Heure de début : lundi 17:00 Heure de fin : lundi 18:00 Hi, A discussion on the need for a TestVNF with a demonstration of a prototype of a possible approach to the solution. Can you please look at the Jira https://jira.onap.org/browse/INT-355<https://urldefense.proofpoint.com/v2/url?u=https-3A__jira.onap.org_browse_INT-2D355=DwMGaQ=LFYZ-o9_HUMeMTSQicvjIg=KgFIQiUJzSC0gUhJaQxg8eC3w16GC3sKgWIcs4iIee0=kG12w7U2YM6hhEUwEZyHPSVusPMPWJNSYMD-oCm2LeE=ibOFZltoPF0bkEA9xNBD7bKypd1rrFSPF5varoQJ5Xg=<https://jira.onap.org/browse/INT-355%3chttps:/urldefense.proofpoint.com/v2/url?u=https-3A__jira.onap.org_browse_INT-2D355=DwMGaQ=LFYZ-o9_HUMeMTSQicvjIg=KgFIQiUJzSC0gUhJaQxg8eC3w16GC3sKgWIcs4iIee0=kG12w7U2YM6hhEUwEZyHPSVusPMPWJNSYMD-oCm2LeE=ibOFZltoPF0bkEA9xNBD7bKypd1rrFSPF5varoQJ5Xg=>> for my initial thinking and look at https://wiki.onap.org/download/attachments/16002054/BeijingDevForum2017-Dec-13-main-0.mp4?version=1=1513294598000=v2<https:/
