[Yahoo-eng-team] [Bug 2006953] Re: [stable/wallaby] test_established_tcp_session_after_re_attachinging_sg is unstable on ML2/OVS iptables_hybrid job
Reviewed:
https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/873708
Committed:
https://opendev.org/openstack/neutron-tempest-plugin/commit/28337975b76fce8e575a12576563428ce4cef6cd
Submitter: "Zuul (22348)"
Branch:master
commit 28337975b76fce8e575a12576563428ce4cef6cd
Author: yatinkarel
Date: Tue Feb 14 19:19:50 2023 +0530
[Wallaby] Fix tempest_exclude for ovs iptables_hybrid
It was missed in [1] while pinning neutron-tempest-plugin
to 1.8.0 where test name is different.
The test is required to be exluded as per [2] in
iptables hybrid ovs job, this patch fixes it for
wallaby job.
[1] https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/871793
[2] https://review.opendev.org/c/openstack/neutron-tempest-plugin/+/793196
Closes-Bug: #2006953
Change-Id: I6a50611ea828223510dfef8290458c19a65f3048
** Changed in: neutron
Status: In Progress => Fix Released
--
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/2006953
Title:
[stable/wallaby] test_established_tcp_session_after_re_attachinging_sg
is unstable on ML2/OVS iptables_hybrid job
Status in neutron:
Fix Released
Bug description:
In recent weeks this job started to fail regularly on stable/wallaby (not
100% some backports are passing)
neutron_tempest_plugin.scenario.test_security_groups.NetworkSecGroupTest.test_established_tcp_session_after_re_attachinging_sg
Most of the time this was seen in neutron-tempest-plugin-scenario-
openvswitch-iptables_hybrid-wallaby job
Two recent backports affected by issue:
https://review.opendev.org/c/openstack/neutron/+/871759
https://review.opendev.org/c/openstack/neutron/+/868087
And some sample logs:
https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_26b/871759/2/check/neutron-tempest-plugin-scenario-openvswitch-iptables_hybrid-wallaby/26b64ec/testr_results.html
https://f450bef156b424c8c132-a0541882d2023eca9a1cc07087449de0.ssl.cf1.rackcdn.com/868087/3/check/neutron-tempest-plugin-scenario-openvswitch-iptables_hybrid-wallaby/55a6ead/testr_results.html
Traceback (most recent call last):
File
"/opt/stack/tempest/.tox/tempest/lib/python3.8/site-packages/neutron_tempest_plugin/common/utils.py",
line 80, in wait_until_true
eventlet.sleep(sleep)
File
"/opt/stack/tempest/.tox/tempest/lib/python3.8/site-packages/eventlet/greenthread.py",
line 36, in sleep
hub.switch()
File
"/opt/stack/tempest/.tox/tempest/lib/python3.8/site-packages/eventlet/hubs/hub.py",
line 313, in switch
return self.greenlet.switch()
eventlet.timeout.Timeout: 10 seconds
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File
"/opt/stack/tempest/.tox/tempest/lib/python3.8/site-packages/neutron_tempest_plugin/scenario/test_security_groups.py",
line 320, in test_established_tcp_session_after_re_attachinging_sg
con.test_connection(should_pass=False)
File
"/opt/stack/tempest/.tox/tempest/lib/python3.8/site-packages/neutron_tempest_plugin/common/utils.py",
line 202, in test_connection
wait_until_true(
File
"/opt/stack/tempest/.tox/tempest/lib/python3.8/site-packages/neutron_tempest_plugin/common/utils.py",
line 85, in wait_until_true
raise WaitTimeout("Timed out after %d seconds" % timeout)
neutron_tempest_plugin.common.utils.WaitTimeout: Timed out after 10 seconds
I wonder if this is similar to
https://bugs.launchpad.net/neutron/+bug/1936911 where the test was
unstable on linuxbridge backend
To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/2006953/+subscriptions
--
Mailing list: https://launchpad.net/~yahoo-eng-team
Post to : yahoo-eng-team@lists.launchpad.net
Unsubscribe : https://launchpad.net/~yahoo-eng-team
More help : https://help.launchpad.net/ListHelp
[Yahoo-eng-team] [Bug 2007327] [NEW] Don't send rpc messages about security groups
Public bug reported: When we use the ovn driver, the security group is implemented by the ACL of ovn. There is no need to send rpc messages. If do not send rpc messages, create ports and update ports, they will not be affected by message queue status. ** Affects: neutron Importance: Undecided Status: New -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to neutron. https://bugs.launchpad.net/bugs/2007327 Title: Don't send rpc messages about security groups Status in neutron: New Bug description: When we use the ovn driver, the security group is implemented by the ACL of ovn. There is no need to send rpc messages. If do not send rpc messages, create ports and update ports, they will not be affected by message queue status. To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/2007327/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : yahoo-eng-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp
[Yahoo-eng-team] [Bug 2007295] [NEW] [UT] "test_floating_forward_rules" failing randomly
Public bug reported: Logs: https://0f8a12cbec2bd8d21e16-d96abe6ffb08aeb45c2339fc58b8ec8a.ssl.cf5.rackcdn.com/873628/1/check/openstack- tox-py38/8f14ad9/testr_results.html Error: https://paste.opendev.org/show/bMPw8axXUCbrzaWTfcJO/ ** Affects: neutron Importance: Undecided Assignee: Rodolfo Alonso (rodolfo-alonso-hernandez) Status: New ** Changed in: neutron Assignee: (unassigned) => Rodolfo Alonso (rodolfo-alonso-hernandez) -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to neutron. https://bugs.launchpad.net/bugs/2007295 Title: [UT] "test_floating_forward_rules" failing randomly Status in neutron: New Bug description: Logs: https://0f8a12cbec2bd8d21e16-d96abe6ffb08aeb45c2339fc58b8ec8a.ssl.cf5.rackcdn.com/873628/1/check/openstack- tox-py38/8f14ad9/testr_results.html Error: https://paste.opendev.org/show/bMPw8axXUCbrzaWTfcJO/ To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/2007295/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : yahoo-eng-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp
[Yahoo-eng-team] [Bug 1964940] Re: Compute tests are failing with failed to reach ACTIVE status and task state "None" within the required time.
closing old promotion-blocker
fixed in Neutron
** Changed in: tripleo
Status: In Progress => Invalid
--
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1964940
Title:
Compute tests are failing with failed to reach ACTIVE status and task
state "None" within the required time.
Status in neutron:
Fix Released
Status in tripleo:
Invalid
Bug description:
On Fs001 CentOS Stream 9 wallaby, Multiple compute server tempest tests are
failing with following error [1][2]:
```
{1}
tempest.api.compute.images.test_images.ImagesTestJSON.test_create_image_from_paused_server
[335.060967s] ... FAILED
Captured traceback:
~~~
Traceback (most recent call last):
File
"/usr/lib/python3.9/site-packages/tempest/api/compute/images/test_images.py",
line 99, in test_create_image_from_paused_server
server = self.create_test_server(wait_until='ACTIVE')
File "/usr/lib/python3.9/site-packages/tempest/api/compute/base.py",
line 270, in create_test_server
body, servers = compute.create_test_server(
File "/usr/lib/python3.9/site-packages/tempest/common/compute.py", line
267, in create_test_server
LOG.exception('Server %s failed to delete in time',
File "/usr/lib/python3.9/site-packages/oslo_utils/excutils.py", line
227, in __exit__
self.force_reraise()
File "/usr/lib/python3.9/site-packages/oslo_utils/excutils.py", line
200, in force_reraise
raise self.value
File "/usr/lib/python3.9/site-packages/tempest/common/compute.py", line
237, in create_test_server
waiters.wait_for_server_status(
File "/usr/lib/python3.9/site-packages/tempest/common/waiters.py", line
100, in wait_for_server_status
raise lib_exc.TimeoutException(message)
tempest.lib.exceptions.TimeoutException: Request timed out
Details: (ImagesTestJSON:test_create_image_from_paused_server) Server
6d1d8906-46fd-42ad-8b4e-0f89adb25ed1 failed to reach ACTIVE status and task
state "None" within the required time (300 s). Server boot request ID:
req-4930f047-7f5f-4d08-9ebb-8ac99b29ad7b. Current status: BUILD. Current task
state: spawning.
```
Below is the list of other tempest tests failing on the same job.[2]
```
tempest.api.compute.images.test_images.ImagesTestJSON.test_create_image_from_paused_server[id-71bcb732-0261-11e7-9086-fa163e4fa634]
tempest.api.compute.admin.test_volume.AttachSCSIVolumeTestJSON.test_attach_scsi_disk_with_config_drive[id-777e468f-17ca-4da4-b93d-b7dbf56c0494]
tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_server_while_in_attached_volume[id-d0f3f0d6-d9b6-4a32-8da4-23015dcab23c,volume]
tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesV270Test.test_create_get_list_interfaces[id-2853f095-8277-4067-92bd-9f10bd4f8e0c,network]
tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_server_while_in_shelved_state[id-bb0cb402-09dd-4947-b6e5-5e7e1cfa61ad]
setUpClass
(tempest.api.compute.images.test_images_oneserver_negative.ImagesOneServerNegativeTestJSON)
tempest.api.compute.servers.test_device_tagging.TaggedBootDevicesTest_v242.test_tagged_boot_devices[id-a2e65a6c-66f1-4442-aaa8-498c31778d96,image,network,slow,volume]
tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_server_while_in_suspended_state[id-1f82ebd3-8253-4f4e-b93f-de9b7df56d8b]
tempest.api.compute.servers.test_attach_interfaces.AttachInterfacesTestJSON.test_create_list_show_delete_interfaces_by_network_port[id-73fe8f02-590d-4bf1-b184-e9ca81065051,network]
setUpClass
(tempest.api.compute.servers.test_server_rescue.ServerRescueTestJSONUnderV235)
```
Here is the traceback from nova-compute logs [3],
```
2022-03-15 09:05:39.011 2 ERROR nova.compute.manager
[req-4930f047-7f5f-4d08-9ebb-8ac99b29ad7b d5ea6c724785473b8ea1104d70fb0d14
64c7d31d84284a28bc9aaa4eaad2b9fb - default default] [instance:
6d1d8906-46fd-42ad-8b4e-0f89adb25ed1] Instance failed to spawn:
nova.exception.VirtualInterfaceCreateException: Virtual Interface creation
failed
2022-03-15 09:05:39.011 2 ERROR nova.compute.manager [instance:
6d1d8906-46fd-42ad-8b4e-0f89adb25ed1] Traceback (most recent call last):
2022-03-15 09:05:39.011 2 ERROR nova.compute.manager [instance:
6d1d8906-46fd-42ad-8b4e-0f89adb25ed1] File
"/usr/lib/python3.9/site-packages/nova/virt/libvirt/driver.py", line 7231, in
_create_guest_with_network
2022-03-15 09:05:39.011 2 ERROR nova.compute.manager [instance:
6d1d8906-46fd-42ad-8b4e-0f89adb25ed1] guest = self._create_guest(
2022-03-15 09:05:39.011 2 ERROR nova.compute.manager [instance:
6d1d8906-46fd-42ad-8b4e-0f89adb25ed1] File
"/usr/lib64/python3.9/contextlib.py", line 126, in __exit__
2022-03-15 09:05:39.011 2 ERROR nova.compute.manager
[Yahoo-eng-team] [Bug 2007254] [NEW] [UT] "test_create_ndp_proxy_with_duplicated" fail
Public bug reported: Logs: https://ed80b810bea8807f20d5-7fb466319126c0ae420f0e283e1354c1.ssl.cf2.rackcdn.com/873619/1/check/openstack- tox-py39/fe30f88/testr_results.html Error: https://paste.opendev.org/show/b1NJ60MNYab8AtEtVIaM/ ** Affects: neutron Importance: Undecided Status: New -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to neutron. https://bugs.launchpad.net/bugs/2007254 Title: [UT] "test_create_ndp_proxy_with_duplicated" fail Status in neutron: New Bug description: Logs: https://ed80b810bea8807f20d5-7fb466319126c0ae420f0e283e1354c1.ssl.cf2.rackcdn.com/873619/1/check/openstack- tox-py39/fe30f88/testr_results.html Error: https://paste.opendev.org/show/b1NJ60MNYab8AtEtVIaM/ To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/2007254/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : yahoo-eng-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp
