Re: [openstack-dev] [qa][neutron] Moving network api test development to Neutron repo
On Tue, Mar 17, 2015 at 10:22:50PM +0100, Salvatore Orlando wrote: With the API tests being now available in the neutron repository - and being actively developed, I would also mandate in reviews that API tests are provided in lieu of the usual unit tests which at the end of the day do what the API tests are supposed to do. ++ This will provide better validation, and perhaps might finally allow us to tear down the unit test non-sense we had so far. yay! It's with great shame that I must admit I introduce it as a quick way to test all plugins in Folsom. But I never expected that contributors would start building on that. Hopefullly we could start having unit tests which do what unit tests are supposed to do - white-box testing methods to provide maximum coverage and validate their behaviour with different input values. Big ++ from me. We need to make similar changes in Nova-land. Best, -jay __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [qa][neutron] Moving network api test development to Neutron repo
With the API tests being now available in the neutron repository - and being actively developed, I would also mandate in reviews that API tests are provided in lieu of the usual unit tests which at the end of the day do what the API tests are supposed to do. This will provide better validation, and perhaps might finally allow us to tear down the unit test non-sense we had so far. It's with great shame that I must admit I introduce it as a quick way to test all plugins in Folsom. But I never expected that contributors would start building on that. Hopefullly we could start having unit tests which do what unit tests are supposed to do - white-box testing methods to provide maximum coverage and validate their behaviour with different input values. Salvatore On 17 March 2015 at 22:04, Maru Newby ma...@redhat.com wrote: tl;dr; As per a discussion in Paris [1], development of Neutron's API tests is moving from the Tempest repo to the Neutron repo. If you are developing API tests for Neutron in Tempest, please be advised that, effective immediately, your efforts should be directed towards the Neutron repo. The current set of Neutron API tests in Tempest has been copied (along with supporting infrastructure) to neutron/tests/tempest [1]. Tests in this path are run as part of the neutron-dsvm-api job, which will shortly be gating [2]. Test changes that previously targeted the tempest/api/network path in the Tempest repo should target neutron/tests/tempest/network/api in the Neutron repo until further notice. Automatic conversion from a Tempest change to a Neutron change is possible: - cd [path to neutron repo] - ./tools/copy_api_tests_from_tempest.sh [path to tempest working directory] As per the Tempest guidelines for test removal [3], the tests currently in Tempest will remain in Tempest and continue to run as part of the existing jobs until we can target tests in the Neutron repo against stable branches and enable the use of the in-repo tests by defcore/refstack. Finally, guidelines for API test development in the Neutron repo are in the works and will be proposed shortly. The guidelines will define policy intended to protect against backwards compatible changes to our API. Thanks, Maru 1: https://etherpad.openstack.org/p/kilo-crossproject-move-func-tests-to-projects 2: https://github.com/openstack/neutron/tree/master/neutron/tests/tempest 3: https://review.openstack.org/#/c/164886 4: https://wiki.openstack.org/wiki/QA/Tempest-test-removal __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
[openstack-dev] [qa][neutron] Moving network api test development to Neutron repo
tl;dr; As per a discussion in Paris [1], development of Neutron's API tests is moving from the Tempest repo to the Neutron repo. If you are developing API tests for Neutron in Tempest, please be advised that, effective immediately, your efforts should be directed towards the Neutron repo. The current set of Neutron API tests in Tempest has been copied (along with supporting infrastructure) to neutron/tests/tempest [1]. Tests in this path are run as part of the neutron-dsvm-api job, which will shortly be gating [2]. Test changes that previously targeted the tempest/api/network path in the Tempest repo should target neutron/tests/tempest/network/api in the Neutron repo until further notice. Automatic conversion from a Tempest change to a Neutron change is possible: - cd [path to neutron repo] - ./tools/copy_api_tests_from_tempest.sh [path to tempest working directory] As per the Tempest guidelines for test removal [3], the tests currently in Tempest will remain in Tempest and continue to run as part of the existing jobs until we can target tests in the Neutron repo against stable branches and enable the use of the in-repo tests by defcore/refstack. Finally, guidelines for API test development in the Neutron repo are in the works and will be proposed shortly. The guidelines will define policy intended to protect against backwards compatible changes to our API. Thanks, Maru 1: https://etherpad.openstack.org/p/kilo-crossproject-move-func-tests-to-projects 2: https://github.com/openstack/neutron/tree/master/neutron/tests/tempest 3: https://review.openstack.org/#/c/164886 4: https://wiki.openstack.org/wiki/QA/Tempest-test-removal __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
