[Yahoo-eng-team] [Bug 2006953] Re: [stable/wallaby] test_established_tcp_session_after_re_attachinging_sg is unstable on ML2/OVS iptables_hybrid job
Reviewed: https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/873708 Committed: https://opendev.org/openstack/neutron-tempest-plugin/commit/28337975b76fce8e575a12576563428ce4cef6cd Submitter: "Zuul (22348)" Branch:master commit 28337975b76fce8e575a12576563428ce4cef6cd Author: yatinkarel Date: Tue Feb 14 19:19:50 2023 +0530 [Wallaby] Fix tempest_exclude for ovs iptables_hybrid It was missed in [1] while pinning neutron-tempest-plugin to 1.8.0 where test name is different. The test is required to be exluded as per [2] in iptables hybrid ovs job, this patch fixes it for wallaby job. [1] https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/871793 [2] https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/793196 Closes-Bug: #2006953 Change-Id: I6a50611ea828223510dfef8290458c19a65f3048 ** Changed in: neutron Status: In Progress => Fix Released -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to neutron. https://bugs.launchpad.net/bugs/2006953 Title: [stable/wallaby] test_established_tcp_session_after_re_attachinging_sg is unstable on ML2/OVS iptables_hybrid job Status in neutron: Fix Released Bug description: In recent weeks this job started to fail regularly on stable/wallaby (not 100% some backports are passing) neutron_tempest_plugin.scenario.test_security_groups.NetworkSecGroupTest.test_established_tcp_session_after_re_attachinging_sg Most of the time this was seen in neutron-tempest-plugin-scenario- openvswitch-iptables_hybrid-wallaby job Two recent backports affected by issue: https://review.opendev.org/c/openstack/neutron/+/871759 https://review.opendev.org/c/openstack/neutron/+/868087 And some sample logs: https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_26b/871759/2/check/neutron-tempest-plugin-scenario-openvswitch-iptables_hybrid-wallaby/26b64ec/testr_results.html https://f450bef156b424c8c132-a0541882d2023eca9a1cc07087449de0.ssl.cf1.rackcdn.com/868087/3/check/neutron-tempest-plugin-scenario-openvswitch-iptables_hybrid-wallaby/55a6ead/testr_results.html Traceback (most recent call last): File "/opt/stack/tempest/.tox/tempest/lib/python3.8/site-packages/neutron_tempest_plugin/common/utils.py", line 80, in wait_until_true eventlet.sleep(sleep) File "/opt/stack/tempest/.tox/tempest/lib/python3.8/site-packages/eventlet/greenthread.py", line 36, in sleep hub.switch() File "/opt/stack/tempest/.tox/tempest/lib/python3.8/site-packages/eventlet/hubs/hub.py", line 313, in switch return self.greenlet.switch() eventlet.timeout.Timeout: 10 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/opt/stack/tempest/.tox/tempest/lib/python3.8/site-packages/neutron_tempest_plugin/scenario/test_security_groups.py", line 320, in test_established_tcp_session_after_re_attachinging_sg con.test_connection(should_pass=False) File "/opt/stack/tempest/.tox/tempest/lib/python3.8/site-packages/neutron_tempest_plugin/common/utils.py", line 202, in test_connection wait_until_true( File "/opt/stack/tempest/.tox/tempest/lib/python3.8/site-packages/neutron_tempest_plugin/common/utils.py", line 85, in wait_until_true raise WaitTimeout("Timed out after %d seconds" % timeout) neutron_tempest_plugin.common.utils.WaitTimeout: Timed out after 10 seconds I wonder if this is similar to https://bugs.launchpad.net/neutron/+bug/1936911 where the test was unstable on linuxbridge backend To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/2006953/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : yahoo-eng-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp
[Yahoo-eng-team] [Bug 2007327] [NEW] Don't send rpc messages about security groups
Public bug reported: When we use the ovn driver, the security group is implemented by the ACL of ovn. There is no need to send rpc messages. If do not send rpc messages, create ports and update ports, they will not be affected by message queue status. ** Affects: neutron Importance: Undecided Status: New -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to neutron. https://bugs.launchpad.net/bugs/2007327 Title: Don't send rpc messages about security groups Status in neutron: New Bug description: When we use the ovn driver, the security group is implemented by the ACL of ovn. There is no need to send rpc messages. If do not send rpc messages, create ports and update ports, they will not be affected by message queue status. To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/2007327/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : yahoo-eng-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp
[Yahoo-eng-team] [Bug 2007295] [NEW] [UT] "test_floating_forward_rules" failing randomly
Public bug reported: Logs: https://0f8a12cbec2bd8d21e16-d96abe6ffb08aeb45c2339fc58b8ec8a.ssl.cf5.rackcdn.com/873628/1/check/openstack- tox-py38/8f14ad9/testr_results.html Error: https://paste.opendev.org/show/bMPw8axXUCbrzaWTfcJO/ ** Affects: neutron Importance: Undecided Assignee: Rodolfo Alonso (rodolfo-alonso-hernandez) Status: New ** Changed in: neutron Assignee: (unassigned) => Rodolfo Alonso (rodolfo-alonso-hernandez) -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to neutron. https://bugs.launchpad.net/bugs/2007295 Title: [UT] "test_floating_forward_rules" failing randomly Status in neutron: New Bug description: Logs: https://0f8a12cbec2bd8d21e16-d96abe6ffb08aeb45c2339fc58b8ec8a.ssl.cf5.rackcdn.com/873628/1/check/openstack- tox-py38/8f14ad9/testr_results.html Error: https://paste.opendev.org/show/bMPw8axXUCbrzaWTfcJO/ To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/2007295/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : yahoo-eng-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp
[Yahoo-eng-team] [Bug 1964940] Re: Compute tests are failing with failed to reach ACTIVE status and task state "None" within the required time.
closing old promotion-blocker fixed in Neutron ** Changed in: tripleo Status: In Progress => Invalid -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to neutron. https://bugs.launchpad.net/bugs/1964940 Title: Compute tests are failing with failed to reach ACTIVE status and task state "None" within the required time. Status in neutron: Fix Released Status in tripleo: Invalid Bug description: On Fs001 CentOS Stream 9 wallaby, Multiple compute server tempest tests are failing with following error [1][2]: ``` {1} tempest.api.compute.images.test_images.ImagesTestJSON.test_create_image_from_paused_server [335.060967s] ... FAILED Captured traceback: ~~~ Traceback (most recent call last): File "/usr/lib/python3.9/site-packages/tempest/api/compute/images/test_images.py", line 99, in test_create_image_from_paused_server server = self.create_test_server(wait_until='ACTIVE') File "/usr/lib/python3.9/site-packages/tempest/api/compute/base.py", line 270, in create_test_server body, servers = compute.create_test_server( File "/usr/lib/python3.9/site-packages/tempest/common/compute.py", line 267, in create_test_server LOG.exception('Server %s failed to delete in time', File "/usr/lib/python3.9/site-packages/oslo_utils/excutils.py", line 227, in __exit__ self.force_reraise() File "/usr/lib/python3.9/site-packages/oslo_utils/excutils.py", line 200, in force_reraise raise self.value File "/usr/lib/python3.9/site-packages/tempest/common/compute.py", line 237, in create_test_server waiters.wait_for_server_status( File "/usr/lib/python3.9/site-packages/tempest/common/waiters.py", line 100, in wait_for_server_status raise lib_exc.TimeoutException(message) tempest.lib.exceptions.TimeoutException: Request timed out Details: (ImagesTestJSON:test_create_image_from_paused_server) Server 6d1d8906-46fd-42ad-8b4e-0f89adb25ed1 failed to reach ACTIVE status and task state "None" within the required time (300 s). Server boot request ID: req-4930f047-7f5f-4d08-9ebb-8ac99b29ad7b. Current status: BUILD. Current task state: spawning. ``` Below is the list of other tempest tests failing on the same job.[2] ``` tempest.api.compute.images.test_images.ImagesTestJSON.test_create_image_from_paused_server[id-71bcb732-0261-11e7-9086-fa163e4fa634] tempest.api.compute.admin.test_volume.AttachSCSIVolumeTestJSON.test_attach_scsi_disk_with_config_drive[id-777e468f-17ca-4da4-b93d-b7dbf56c0494] tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_server_while_in_attached_volume[id-d0f3f0d6-d9b6-4a32-8da4-23015dcab23c,volume] tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesV270Test.test_create_get_list_interfaces[id-2853f095-8277-4067-92bd-9f10bd4f8e0c,network] tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_server_while_in_shelved_state[id-bb0cb402-09dd-4947-b6e5-5e7e1cfa61ad] setUpClass (tempest.api.compute.images.test_images_oneserver_negative.ImagesOneServerNegativeTestJSON) tempest.api.compute.servers.test_device_tagging.TaggedBootDevicesTest_v242.test_tagged_boot_devices[id-a2e65a6c-66f1-4442-aaa8-498c31778d96,image,network,slow,volume] tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_server_while_in_suspended_state[id-1f82ebd3-8253-4f4e-b93f-de9b7df56d8b] tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_create_list_show_delete_interfaces_by_network_port[id-73fe8f02-590d-4bf1-b184-e9ca81065051,network] setUpClass (tempest.api.compute.servers.test_server_rescue.ServerRescueTestJSONUnderV235) ``` Here is the traceback from nova-compute logs [3], ``` 2022-03-15 09:05:39.011 2 ERROR nova.compute.manager [req-4930f047-7f5f-4d08-9ebb-8ac99b29ad7b d5ea6c724785473b8ea1104d70fb0d14 64c7d31d84284a28bc9aaa4eaad2b9fb - default default] [instance: 6d1d8906-46fd-42ad-8b4e-0f89adb25ed1] Instance failed to spawn: nova.exception.VirtualInterfaceCreateException: Virtual Interface creation failed 2022-03-15 09:05:39.011 2 ERROR nova.compute.manager [instance: 6d1d8906-46fd-42ad-8b4e-0f89adb25ed1] Traceback (most recent call last): 2022-03-15 09:05:39.011 2 ERROR nova.compute.manager [instance: 6d1d8906-46fd-42ad-8b4e-0f89adb25ed1] File "/usr/lib/python3.9/site-packages/nova/virt/libvirt/driver.py", line 7231, in _create_guest_with_network 2022-03-15 09:05:39.011 2 ERROR nova.compute.manager [instance: 6d1d8906-46fd-42ad-8b4e-0f89adb25ed1] guest = self._create_guest( 2022-03-15 09:05:39.011 2 ERROR nova.compute.manager [instance: 6d1d8906-46fd-42ad-8b4e-0f89adb25ed1] File "/usr/lib64/python3.9/contextlib.py", line 126, in __exit__ 2022-03-15 09:05:39.011 2 ERROR nova.compute.manager [instance
[Yahoo-eng-team] [Bug 2007254] [NEW] [UT] "test_create_ndp_proxy_with_duplicated" fail
Public bug reported: Logs: https://ed80b810bea8807f20d5-7fb466319126c0ae420f0e283e1354c1.ssl.cf2.rackcdn.com/873619/1/check/openstack- tox-py39/fe30f88/testr_results.html Error: https://paste.opendev.org/show/b1NJ60MNYab8AtEtVIaM/ ** Affects: neutron Importance: Undecided Status: New -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to neutron. https://bugs.launchpad.net/bugs/2007254 Title: [UT] "test_create_ndp_proxy_with_duplicated" fail Status in neutron: New Bug description: Logs: https://ed80b810bea8807f20d5-7fb466319126c0ae420f0e283e1354c1.ssl.cf2.rackcdn.com/873619/1/check/openstack- tox-py39/fe30f88/testr_results.html Error: https://paste.opendev.org/show/b1NJ60MNYab8AtEtVIaM/ To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/2007254/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : yahoo-eng-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp