I've added upstream oslo.privsep to this bug. It seems that minimally an
except block with a log message would be useful in the send_recv()
method from oslo_privsep/comm.py.
** Also affects: oslo.privsep
Importance: Undecided
Status: New
--
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1927868
Title:
vRouter not working after update to 16.3.1
Status in Ubuntu Cloud Archive:
Fix Committed
Status in Ubuntu Cloud Archive train series:
Fix Committed
Status in Ubuntu Cloud Archive ussuri series:
Fix Committed
Status in Ubuntu Cloud Archive victoria series:
Fix Committed
Status in Ubuntu Cloud Archive wallaby series:
Fix Committed
Status in Ubuntu Cloud Archive xena series:
Fix Committed
Status in neutron:
New
Status in oslo.privsep:
New
Status in neutron package in Ubuntu:
Fix Released
Status in neutron source package in Focal:
Fix Committed
Status in neutron source package in Hirsute:
Fix Committed
Status in neutron source package in Impish:
Fix Released
Bug description:
We run a juju managed Openstack Ussuri on Bionic. After updating
neutron packages from 16.3.0 to 16.3.1 all virtual routers stopped
working. It seems that most (not all) namespaces are created but have
only the lo interface and sometime the ha-XYZ interface in DOWN state.
The underlying tap interfaces are also in down.
neutron-l3-agent has many logs similar to the following:
2021-05-08 15:01:45.286 39411 ERROR neutron.agent.l3.ha_router [-] Gateway
interface for router 02945b59-639b-41be-8237-3b7933b4e32d was not set up;
router will not work properly
and journal logs report at around the same time
May 08 15:01:40 lar1615.srv-louros.grnet.gr
neutron-keepalived-state-change[18596]: 2021-05-08 15:01:40.765 18596 INFO
neutron.agent.linux.ip_lib [-] Failed sending gratuitous ARP to 62.62.62.62 on
qg-5a6efe8c-6b in namespace qrouter-02945b59-639b-41be-8237-3b7933b4e32d: Exit
code: 2; Stdin: ; Stdout: Interface "qg-5a6efe8c-6b" is down
May 08 15:01:40 lar1615.srv-louros.grnet.gr
neutron-keepalived-state-change[18596]: 2021-05-08 15:01:40.767 18596 INFO
neutron.agent.linux.ip_lib [-] Interface qg-5a6efe8c-6b or address 62.62.62.62
in namespace qrouter-02945b59-639b-41be-8237-3b7933b4e32d was deleted
concurrently
The neutron packages installed are:
ii neutron-common 2:16.3.1-0ubuntu1~cloud0
all Neutron is a virtual network service for
Openstack - common
ii neutron-dhcp-agent 2:16.3.1-0ubuntu1~cloud0
all Neutron is a virtual network service for
Openstack - DHCP agent
ii neutron-l3-agent 2:16.3.1-0ubuntu1~cloud0
all Neutron is a virtual network service for
Openstack - l3 agent
ii neutron-metadata-agent 2:16.3.1-0ubuntu1~cloud0
all Neutron is a virtual network service for
Openstack - metadata agent
ii neutron-metering-agent 2:16.3.1-0ubuntu1~cloud0
all Neutron is a virtual network service for
Openstack - metering agent
ii neutron-openvswitch-agent 2:16.3.1-0ubuntu1~cloud0
all Neutron is a virtual network service for
Openstack - Open vSwitch plugin agent
ii python3-neutron 2:16.3.1-0ubuntu1~cloud0
all Neutron is a virtual network service for
Openstack - Python library
ii python3-neutron-lib 2.3.0-0ubuntu1~cloud0
all Neutron shared routines and utilities -
Python 3.x
ii python3-neutronclient 1:7.1.1-0ubuntu1~cloud0
all client API library for Neutron - Python
3.x
Downgrading to 16.3.0 resolves the issues.
=================================
Ubuntu SRU details:
[Impact]
See above.
[Test Case]
Deploy openstack with l3ha and create several HA routers, the number required
varies per environment. It is probably best to deploy a known bad version of
the package, ensure it is failing, upgrade to the version in proposed, and
re-test several times to confirm it is fixed.
Restarting neutron-l3-agent should expect all HA Routers are restored.
[Regression Potential]
This change is fixing a regression by reverting a patch that was introduced
in a stable point release of neutron.
To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1927868/+subscriptions
--
Mailing list: https://launchpad.net/~yahoo-eng-team
Post to : yahoo-eng-team@lists.launchpad.net
Unsubscribe : https://launchpad.net/~yahoo-eng-team
More help : https://help.launchpad.net/ListHelp
