Public bug reported: I noticed such warnings in neutron-server logs in CI jobs. Example of stacktrace:
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: WARNING neutron.plugins.ml2.ovo_rpc [None req-8e39b39c-bbd4-4a17-84e8-f376b4857023 tempest-L3AgentSchedulerTestJSON-1326864497 tempest-L3AgentSchedulerTestJSON-1326864497-project] This handler is supposed to handle AFTER events, as in 'AFTER it's committed', not BEFORE. Offending resource event: port, after_delete. Location: Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/eventlet/greenthread.py", line 221, in main Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: result = function(*args, **kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/eventlet/wsgi.py", line 837, in process_request Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: proto.__init__(conn_state, self) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/eventlet/wsgi.py", line 350, in __init__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: self.handle() Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/eventlet/wsgi.py", line 383, in handle Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: self.handle_one_request() Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/eventlet/wsgi.py", line 459, in handle_one_request Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: self.handle_one_response() Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/eventlet/wsgi.py", line 569, in handle_one_response Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: result = self.application(self.environ, start_response) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/paste/urlmap.py", line 216, in __call__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return app(environ, start_response) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 129, in __call__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: resp = self.call_func(req, *args, **kw) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 193, in call_func Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return self.func(req, *args, **kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/oslo_middleware/base.py", line 124, in __call__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: response = req.get_response(self.application) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1313, in send Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: status, headers, app_iter = self.call_application( Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1278, in call_application Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: app_iter = application(self.environ, start_response) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 129, in __call__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: resp = self.call_func(req, *args, **kw) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 193, in call_func Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return self.func(req, *args, **kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/oslo_middleware/base.py", line 124, in __call__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: response = req.get_response(self.application) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1313, in send Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: status, headers, app_iter = self.call_application( Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1278, in call_application Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: app_iter = application(self.environ, start_response) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 129, in __call__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: resp = self.call_func(req, *args, **kw) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 193, in call_func Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return self.func(req, *args, **kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/oslo_middleware/request_id.py", line 58, in __call__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: response = req.get_response(self.application) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1313, in send Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: status, headers, app_iter = self.call_application( Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1278, in call_application Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: app_iter = application(self.environ, start_response) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 129, in __call__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: resp = self.call_func(req, *args, **kw) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 193, in call_func Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return self.func(req, *args, **kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/oslo_middleware/catch_errors.py", line 40, in __call__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: response = req.get_response(self.application) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1313, in send Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: status, headers, app_iter = self.call_application( Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1278, in call_application Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: app_iter = application(self.environ, start_response) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 129, in __call__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: resp = self.call_func(req, *args, **kw) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 193, in call_func Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return self.func(req, *args, **kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/osprofiler/web.py", line 111, in __call__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return request.get_response(self.application) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1313, in send Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: status, headers, app_iter = self.call_application( Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1278, in call_application Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: app_iter = application(self.environ, start_response) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 129, in __call__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: resp = self.call_func(req, *args, **kw) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 193, in call_func Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return self.func(req, *args, **kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/keystonemiddleware/auth_token/__init__.py", line 341, in __call__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: response = req.get_response(self._app) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1313, in send Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: status, headers, app_iter = self.call_application( Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1278, in call_application Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: app_iter = application(self.environ, start_response) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 143, in __call__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return resp(environ, start_response) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 143, in __call__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return resp(environ, start_response) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/routes/middleware.py", line 153, in __call__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: response = self.app(environ, start_response) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 143, in __call__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return resp(environ, start_response) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 129, in __call__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: resp = self.call_func(req, *args, **kw) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 193, in call_func Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return self.func(req, *args, **kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/opt/stack/neutron/neutron/api/v2/resource.py", line 98, in resource Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: result = method(request=request, **args) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/opt/stack/neutron/neutron/api/v2/base.py", line 575, in delete Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return self._delete(request, id, **kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/neutron_lib/db/api.py", line 138, in wrapped Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return f(*args, **kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return f(*args, **kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/neutron_lib/db/api.py", line 184, in wrapped Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return f(*dup_args, **dup_kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/opt/stack/neutron/neutron/api/v2/base.py", line 603, in _delete Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: obj_deleter(request.context, id, **kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/opt/stack/neutron/neutron/db/l3_db.py", line 2187, in delete_router Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: super(L3_NAT_db_mixin, self).delete_router(context, id) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/neutron_lib/db/api.py", line 226, in wrapped Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return f_with_retry(*args, **kwargs, Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/neutron_lib/db/api.py", line 138, in wrapped Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return f(*args, **kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return f(*args, **kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/neutron_lib/db/api.py", line 184, in wrapped Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return f(*dup_args, **dup_kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/opt/stack/neutron/neutron/db/l3_db.py", line 623, in delete_router Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: self._core_plugin.delete_port(context.elevated(), rp_id, Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/opt/stack/neutron/neutron/common/utils.py", line 707, in inner Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return f(*args, **kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/neutron_lib/db/api.py", line 224, in wrapped Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return f(*args, **kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 2158, in delete_port Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: self._post_delete_port( Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 2163, in _post_delete_port Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: registry.publish(resources.PORT, events.AFTER_DELETE, self, Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/neutron_lib/callbacks/registry.py", line 54, in publish Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: _get_callback_manager().publish(resource, event, trigger, payload=payload) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/neutron_lib/db/utils.py", line 104, in _wrapped Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return function(*args, **kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/neutron_lib/callbacks/manager.py", line 150, in publish Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: errors = self._notify_loop(resource, event, trigger, payload) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: callback(resource, event, trigger, payload=payload) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py", line 100, in handle_event Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: if self._is_session_semantic_violated( Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py", line 84, in _is_session_semantic_violated Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: stack = traceback.extract_stack() Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: Link: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_d8f/860270/8/check/neutron-tempest-plugin-openvswitch/d8f61ec/controller/logs/screen-q-svc.txt But it happens in many CI jobs really. Fortunately it don't cause CI failures but we should fix it. ** Affects: neutron Importance: Medium Assignee: Rodolfo Alonso (rodolfo-alonso-hernandez) Status: Confirmed ** Tags: db -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to neutron. https://bugs.launchpad.net/bugs/1999392 Title: Some events which are supposed to be run AFTER changes are commited are performed BEFORE commit Status in neutron: Confirmed Bug description: I noticed such warnings in neutron-server logs in CI jobs. Example of stacktrace: Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: WARNING neutron.plugins.ml2.ovo_rpc [None req-8e39b39c-bbd4-4a17-84e8-f376b4857023 tempest-L3AgentSchedulerTestJSON-1326864497 tempest-L3AgentSchedulerTestJSON-1326864497-project] This handler is supposed to handle AFTER events, as in 'AFTER it's committed', not BEFORE. Offending resource event: port, after_delete. Location: Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/eventlet/greenthread.py", line 221, in main Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: result = function(*args, **kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/eventlet/wsgi.py", line 837, in process_request Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: proto.__init__(conn_state, self) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/eventlet/wsgi.py", line 350, in __init__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: self.handle() Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/eventlet/wsgi.py", line 383, in handle Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: self.handle_one_request() Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/eventlet/wsgi.py", line 459, in handle_one_request Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: self.handle_one_response() Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/eventlet/wsgi.py", line 569, in handle_one_response Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: result = self.application(self.environ, start_response) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/paste/urlmap.py", line 216, in __call__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return app(environ, start_response) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 129, in __call__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: resp = self.call_func(req, *args, **kw) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 193, in call_func Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return self.func(req, *args, **kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/oslo_middleware/base.py", line 124, in __call__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: response = req.get_response(self.application) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1313, in send Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: status, headers, app_iter = self.call_application( Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1278, in call_application Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: app_iter = application(self.environ, start_response) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 129, in __call__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: resp = self.call_func(req, *args, **kw) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 193, in call_func Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return self.func(req, *args, **kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/oslo_middleware/base.py", line 124, in __call__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: response = req.get_response(self.application) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1313, in send Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: status, headers, app_iter = self.call_application( Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1278, in call_application Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: app_iter = application(self.environ, start_response) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 129, in __call__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: resp = self.call_func(req, *args, **kw) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 193, in call_func Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return self.func(req, *args, **kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/oslo_middleware/request_id.py", line 58, in __call__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: response = req.get_response(self.application) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1313, in send Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: status, headers, app_iter = self.call_application( Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1278, in call_application Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: app_iter = application(self.environ, start_response) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 129, in __call__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: resp = self.call_func(req, *args, **kw) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 193, in call_func Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return self.func(req, *args, **kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/oslo_middleware/catch_errors.py", line 40, in __call__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: response = req.get_response(self.application) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1313, in send Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: status, headers, app_iter = self.call_application( Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1278, in call_application Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: app_iter = application(self.environ, start_response) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 129, in __call__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: resp = self.call_func(req, *args, **kw) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 193, in call_func Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return self.func(req, *args, **kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/osprofiler/web.py", line 111, in __call__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return request.get_response(self.application) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1313, in send Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: status, headers, app_iter = self.call_application( Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1278, in call_application Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: app_iter = application(self.environ, start_response) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 129, in __call__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: resp = self.call_func(req, *args, **kw) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 193, in call_func Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return self.func(req, *args, **kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/keystonemiddleware/auth_token/__init__.py", line 341, in __call__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: response = req.get_response(self._app) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1313, in send Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: status, headers, app_iter = self.call_application( Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1278, in call_application Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: app_iter = application(self.environ, start_response) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 143, in __call__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return resp(environ, start_response) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 143, in __call__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return resp(environ, start_response) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/routes/middleware.py", line 153, in __call__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: response = self.app(environ, start_response) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 143, in __call__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return resp(environ, start_response) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 129, in __call__ Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: resp = self.call_func(req, *args, **kw) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 193, in call_func Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return self.func(req, *args, **kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/opt/stack/neutron/neutron/api/v2/resource.py", line 98, in resource Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: result = method(request=request, **args) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/opt/stack/neutron/neutron/api/v2/base.py", line 575, in delete Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return self._delete(request, id, **kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/neutron_lib/db/api.py", line 138, in wrapped Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return f(*args, **kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return f(*args, **kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/neutron_lib/db/api.py", line 184, in wrapped Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return f(*dup_args, **dup_kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/opt/stack/neutron/neutron/api/v2/base.py", line 603, in _delete Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: obj_deleter(request.context, id, **kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/opt/stack/neutron/neutron/db/l3_db.py", line 2187, in delete_router Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: super(L3_NAT_db_mixin, self).delete_router(context, id) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/neutron_lib/db/api.py", line 226, in wrapped Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return f_with_retry(*args, **kwargs, Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/neutron_lib/db/api.py", line 138, in wrapped Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return f(*args, **kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/oslo_db/api.py", line 142, in wrapper Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return f(*args, **kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/neutron_lib/db/api.py", line 184, in wrapped Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return f(*dup_args, **dup_kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/opt/stack/neutron/neutron/db/l3_db.py", line 623, in delete_router Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: self._core_plugin.delete_port(context.elevated(), rp_id, Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/opt/stack/neutron/neutron/common/utils.py", line 707, in inner Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return f(*args, **kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/neutron_lib/db/api.py", line 224, in wrapped Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return f(*args, **kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 2158, in delete_port Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: self._post_delete_port( Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 2163, in _post_delete_port Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: registry.publish(resources.PORT, events.AFTER_DELETE, self, Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/neutron_lib/callbacks/registry.py", line 54, in publish Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: _get_callback_manager().publish(resource, event, trigger, payload=payload) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/neutron_lib/db/utils.py", line 104, in _wrapped Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: return function(*args, **kwargs) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/neutron_lib/callbacks/manager.py", line 150, in publish Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: errors = self._notify_loop(resource, event, trigger, payload) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/usr/local/lib/python3.10/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: callback(resource, event, trigger, payload=payload) Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py", line 100, in handle_event Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: if self._is_session_semantic_violated( Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: File "/opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py", line 84, in _is_session_semantic_violated Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: stack = traceback.extract_stack() Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: Link: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_d8f/860270/8/check/neutron-tempest-plugin-openvswitch/d8f61ec/controller/logs/screen-q-svc.txt But it happens in many CI jobs really. Fortunately it don't cause CI failures but we should fix it. To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/1999392/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : yahoo-eng-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp