Public bug reported: LBaaS API v2 tests don't add cleanup right after resources are created they attempt to remove them at the end of the tests. In light of heavy usage of class-level resources failure of any test leads to an avalanche.
For example, breaking test_create_listener in test_listeners_non_admin, which is the first one to be executed, makes all subsequent tests to fail with assertion errors: Traceback (most recent call last): File "neutron_lbaas/tests/tempest/v2/api/test_listeners_non_admin.py", line 462, in test_update_listener_missing_name listener_ids=[self.listener_id]) File "neutron_lbaas/tests/tempest/v2/api/base.py", line 299, in _check_status_tree load_balancer['listeners']) File "neutron_lbaas/tests/tempest/v2/api/base.py", line 317, in _check_status_tree_thing assert len(actual_thing_ids) == len(status_tree_things) AssertionError It makes analyzing test failures more complicated. ** Affects: neutron Importance: Undecided Assignee: Elena Ezhova (eezhova) Status: New ** Tags: lbaas ** Changed in: neutron Assignee: (unassigned) => Elena Ezhova (eezhova) ** Tags added: lbaas ** Summary changed: - [LBaaS v2] Improve resource cleanup in API tests + [LBaaS v2] Lacking resource cleanup in API tests -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to neutron. https://bugs.launchpad.net/bugs/1498447 Title: [LBaaS v2] Lacking resource cleanup in API tests Status in neutron: New Bug description: LBaaS API v2 tests don't add cleanup right after resources are created they attempt to remove them at the end of the tests. In light of heavy usage of class-level resources failure of any test leads to an avalanche. For example, breaking test_create_listener in test_listeners_non_admin, which is the first one to be executed, makes all subsequent tests to fail with assertion errors: Traceback (most recent call last): File "neutron_lbaas/tests/tempest/v2/api/test_listeners_non_admin.py", line 462, in test_update_listener_missing_name listener_ids=[self.listener_id]) File "neutron_lbaas/tests/tempest/v2/api/base.py", line 299, in _check_status_tree load_balancer['listeners']) File "neutron_lbaas/tests/tempest/v2/api/base.py", line 317, in _check_status_tree_thing assert len(actual_thing_ids) == len(status_tree_things) AssertionError It makes analyzing test failures more complicated. To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/1498447/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : yahoo-eng-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp