Hi, I will modify our CI chains in order to alternate check with fraser / master and keep on providing feedback. We may change the config to make the dashboard publically available After one week of perfect runs (last week), we started getting some errors.. api_check / refstack / tempest / rally / patrole (not always the same tests) but all the errors were linked to volume management Lots of old test volumes got stuck and it was not possible to delete them. All the problems were due to cinder operations launched on 1 of the 3 controllers (HA mode), it explains the random effect (sometimes patrole was OK when cinder operations were done on controler 1 or 2 and fails when done on controler 3) It was impossible to delete them properly. There was probably a loss of synchronization on this controler. The decision was taken to reboot this controller
After the reboot, fraser tests are back to nominal this morning. +----------------------------+------------------+---------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +----------------------------+------------------+---------------------+------------------+----------------+ | connection_check | functest | healthcheck | 00:07 | PASS | | api_check | functest | healthcheck | 09:53 | PASS | | snaps_health_check | functest | healthcheck | 00:53 | PASS | +------------------------------+------------------+---------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +------------------------------+------------------+---------------+------------------+----------------+ | vping_ssh | functest | smoke | 00:56 | PASS | | vping_userdata | functest | smoke | 00:41 | PASS | | tempest_smoke_serial | functest | smoke | 18:43 | PASS | | rally_sanity | functest | smoke | 27:11 | PASS | | refstack_defcore | functest | smoke | 08:11 | PASS | | patrole | functest | smoke | 04:57 | PASS | | snaps_smoke | functest | smoke | 58:07 | PASS | | odl | functest | smoke | 00:00 | SKIP | | odl_netvirt | functest | smoke | 00:00 | SKIP | | neutron_trunk | functest | smoke | 00:00 | SKIP | +------------------------------+------------------+---------------+------------------+----------------+ vnf tests in progress it is interesting and shows clearly the need for long duration tests :) OK for xtesting update. I am currently trying to finalize some VNF testing that I planned to integrated in an xtesting/onap-vnf, I will share with the integration team when it will be more mature Meanwhile our xtesting/onap-robot is run daily on our Open Lab /Morgan Le jeudi 12 avril 2018 à 14:16 +0200, OLLIVIER Cédric IMT/OLN a écrit : Hello Morgan, Thank you very much for your help. All tests done via ONAP OpenLab has been very helpful throughout the F-release by providing the quickest feedbacks. We are checking if Functest testcases have to complete Snaps’ garbage collectors for floating ips. That would explain this remaining resources. Yes, we will target live testing for the next release. http://testresults.opnfv.org/functest/gambiachallenges/ About the reuse of OPNFV in ONAP, Xtesting has been synchronized to Queens this morning (opnfv/xtesting:latest). Onap Healthcheck container could inherit from opnfv/xtesting:fraser if it needs requirements synchronized with OpenStack Pike. Functest (master) could switch to Queens as well in order to get first feedbacks before next MS0. https://gerrit.opnfv.org/gerrit/#/c/55553/ Cédric De : RICHOMME Morgan IMT/OLN Envoyé : mardi 10 avril 2018 09:52 À : dmcbr...@linuxfoundation.org; opnfv-tech-discuss@lists.opnfv.org; OLLIVIER Cédric IMT/OLN Cc : helen.c...@huawei.com; DEBEAU Eric IMT/OLN; gabriel.yuy...@huawei.com Objet : [OPNFV] [Fraser] Fraser Functest run on Orange ONAP Open lab Hi for information, we switched to the fraser version for our daily test on our ONAP OpenLab, a communit lab for ONAP users. Even if the lab is used by ONAP contributors for ONAP testing, we are reusing Functest test suites to be sure that the infrastructure supporting ONAP is still properly working. We were using latest tag so far and decided to go to fraser to provide some feedback for the OPNFV forthcoming release. The infrastructure has been deployed using XCI/bifrost scripts + Kolla installer (currently under integration in XCI) on bare metal. The scenario corresponds to a basic os-nosdn-nofeature-ha scenario. the results are perfect :) +----------------------------+------------------+---------------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +----------------------------+------------------+---------------------+------------------+----------------+ | connection_check | functest | healthcheck | 00:07 | PASS | | api_check | functest | healthcheck | 08:26 | PASS | | snaps_health_check | functest | healthcheck | 00:49 | PASS | +----------------------------+------------------+---------------------+------------------+----------------+ +------------------------------+------------------+---------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +------------------------------+------------------+---------------+------------------+----------------+ | vping_ssh | functest | smoke | 00:42 | PASS | | vping_userdata | functest | smoke | 00:35 | PASS | | tempest_smoke_serial | functest | smoke | 12:23 | PASS | | rally_sanity | functest | smoke | 20:46 | PASS | | refstack_defcore | functest | smoke | 06:53 | PASS | | patrole | functest | smoke | 04:29 | PASS | | snaps_smoke | functest | smoke | 50:18 | PASS | | odl | functest | smoke | 00:00 | SKIP | | odl_netvirt | functest | smoke | 00:00 | SKIP | | neutron_trunk | functest | smoke | 00:00 | SKIP | +------------------------------+------------------+---------------+------------------+----------------+ +----------------------+------------------+--------------+------------------+----------------+ | TEST CASE | PROJECT | TIER | DURATION | RESULT | +----------------------+------------------+--------------+------------------+----------------+ | cloudify_ims | functest | vnf | 27:40 | PASS | | vyos_vrouter | functest | vnf | 18:23 | PASS | | juju_epc | functest | vnf | 51:17 | PASS | +----------------------+------------------+--------------+------------------+----------------+ Thanks to the functest and XCI team! Tests will be run daily so we would report any issue if we are facing some but it looks pretty stable. Unlike the traditionnal approach, we are running daily tests on a up&running infrastructure (we do not reinstall it systematically before launching the tests) so it is connected somehow to the long duration test acctivities coordinated by Gabriel The only issues we faced so far with latest version were due to the cleaning of the resources (shortages of floatting IPs) This issue has been identified and will be addressed as far as I understood in Gambia release. we run now a cleaning script after the tests to free some resources As a conclusion, the Orange Onap OpenLab validates the Fraser scenario os-nosdn-nofeature-ha for XCI/Kolla with functest healthcheck/smoke/vnf (duration 3h and 20 minutes) It could be interesting for us to add Yardstick daily tests...it is in the todo list... Morgan _________________________________________________________________________________________________________________________ Ce message et ses pieces jointes peuvent contenir des informations confidentielles ou privilegiees et ne doivent donc pas etre diffuses, exploites ou copies sans autorisation. Si vous avez recu ce message par erreur, veuillez le signaler a l'expediteur et le detruire ainsi que les pieces jointes. Les messages electroniques etant susceptibles d'alteration, Orange decline toute responsabilite si ce message a ete altere, deforme ou falsifie. Merci. This message and its attachments may contain confidential or privileged information that may be protected by law; they should not be distributed, used or copied without authorisation. If you have received this email in error, please notify the sender and delete this message and its attachments. As emails may be altered, Orange is not liable for messages that have been modified, changed or falsified. Thank you.
_______________________________________________ opnfv-tech-discuss mailing list opnfv-tech-discuss@lists.opnfv.org https://lists.opnfv.org/mailman/listinfo/opnfv-tech-discuss