Public bug reported:
[stack@undercloud-0 ~]$ cat /etc/rhosp-release Red Hat OpenStack Platform release 14.0.1 RC (Rocky) [stack@undercloud-0 ~]$ yum info openstack-neutron Loaded plugins: search-disabled-repos Available Packages Name : openstack-neutron Arch : noarch Epoch : 1 Version : 13.0.3 Release : 0.20190119134915.886782c.el7ost Size : 28 k Repo : rhelosp-14.0-puddle/x86_64 Summary : OpenStack Networking Service URL : http://launchpad.net/neutron/ License : ASL 2.0 Description : : Neutron is a virtual network service for Openstack. Just like : OpenStack Nova provides an API to dynamically request and configure : virtual servers, Neutron provides an API to dynamically request and : configure virtual networks. These networks connect "interfaces" from : other OpenStack services (e.g., virtual NICs from Nova VMs). The : Neutron API supports extensions to provide advanced network : capabilities (e.g., QoS, ACLs, network monitoring, etc.) [stack@undercloud-0 ~]$ yum list | grep neutron puppet-neutron.noarch 13.3.1-0.20181013115834.el7ost python2-neutron-lib.noarch 1.18.0-0.20180816094046.67865c7.el7ost python2-neutronclient.noarch 6.9.1-0.20180925041810.7eba94e.el7ost openstack-neutron.noarch 1:13.0.3-0.20190119134915.886782c.el7ost openstack-neutron-bigswitch-agent.noarch openstack-neutron-bigswitch-lldp.noarch openstack-neutron-common.noarch 1:13.0.3-0.20190119134915.886782c.el7ost openstack-neutron-fwaas.noarch 1:13.0.2-0.20190123183836.90951a5.el7ost openstack-neutron-l2gw-agent.noarch openstack-neutron-lbaas.noarch 1:13.0.1-0.20181017150329.1353bad.el7ost openstack-neutron-lbaas-ui.noarch openstack-neutron-linuxbridge.noarch openstack-neutron-macvtap-agent.noarch openstack-neutron-metering-agent.noarch openstack-neutron-ml2.noarch 1:13.0.3-0.20190119134915.886782c.el7ost openstack-neutron-openvswitch.noarch openstack-neutron-rpc-server.noarch openstack-neutron-sriov-nic-agent.noarch python-neutron.noarch 1:13.0.3-0.20190119134915.886782c.el7ost python-neutron-fwaas.noarch 1:13.0.2-0.20190123183836.90951a5.el7ost python-neutron-fwaas-tests.noarch python-neutron-lbaas.noarch 1:13.0.1-0.20181017150329.1353bad.el7ost python-neutron-lbaas-tests.noarch python2-ironic-neutron-agent.noarch python2-neutron-lib-tests.noarch 1.18.0-0.20180816094046.67865c7.el7ost python2-neutron-tests-tempest.noarch Subnets are deleted from the routers: 51 openstack router remove subnet router 8646bed0-7dfd-43a3-bdb5-ab7368cbbbdb 54 openstack router remove subnet router2 dd8f26ec-b98a-4fe3-8d36-ee54b117dbca (overcloud) [stack@undercloud-0 ~]$ openstack router show router +-------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Field | Value | +-------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | admin_state_up | UP | | availability_zone_hints | | | availability_zones | nova | | created_at | 2019-03-20T09:15:21Z | | description | | | distributed | True | | external_gateway_info | {"network_id": "4eecbefb-7d7a-4210-836e-3b2b3de215db", "enable_snat": true, "external_fixed_ips": [{"subnet_id": "6c9c958d-caf3-4154-b266-6df78c9bd4df", "ip_address": "10.0.0.223"}]} | | flavor_id | None | | ha | False | | id | 15e60f7b-1f53-4688-84ec-0a3b8747cb9a | | interfaces_info | [] | | name | router | | project_id | 908c484257cf4e8cb09d170caa0cea06 | | revision_number | 18 | | routes | | | status | ACTIVE | | tags | | | updated_at | 2019-03-21T15:15:45Z | +-------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ (overcloud) [stack@undercloud-0 ~]$ openstack router show router2 +-------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Field | Value | +-------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | admin_state_up | UP | | availability_zone_hints | | | availability_zones | nova | | created_at | 2019-03-20T09:15:27Z | | description | | | distributed | True | | external_gateway_info | {"network_id": "4eecbefb-7d7a-4210-836e-3b2b3de215db", "enable_snat": true, "external_fixed_ips": [{"subnet_id": "6c9c958d-caf3-4154-b266-6df78c9bd4df", "ip_address": "10.0.0.214"}]} | | flavor_id | None | | ha | False | | id | 6d303551-abc1-483e-9a12-ffaf7240fb2e | | interfaces_info | [] | | name | router2 | | project_id | 908c484257cf4e8cb09d170caa0cea06 | | revision_number | 10 | | routes | | | status | ACTIVE | | tags | | | updated_at | 2019-03-21T15:33:54Z | +-------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ But qrouter namespaces aren't deleted in the computes: [root@compute-1 heat-admin]# ip netns qrouter-6d303551-abc1-483e-9a12-ffaf7240fb2e (id: 2) fip-4eecbefb-7d7a-4210-836e-3b2b3de215db (id: 1) qrouter-15e60f7b-1f53-4688-84ec-0a3b8747cb9a (id: 0) [root@compute-1 heat-admin]# ip netns exec qrouter-6d303551-abc1-483e-9a12-ffaf7240fb2e ip a 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: rfp-6d303551-a@if3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000 link/ether 5a:92:68:df:f0:23 brd ff:ff:ff:ff:ff:ff link-netnsid 0 inet 169.254.109.46/31 scope global rfp-6d303551-a valid_lft forever preferred_lft forever inet6 fe80::5892:68ff:fedf:f023/64 scope link valid_lft forever preferred_lft forever 19: qr-cf638cc8-a6: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 link/ether fa:16:3e:2c:af:c1 brd ff:ff:ff:ff:ff:ff inet 10.0.3.1/24 brd 10.0.3.255 scope global qr-cf638cc8-a6 valid_lft forever preferred_lft forever inet6 fe80::f816:3eff:fe2c:afc1/64 scope link valid_lft forever preferred_lft forever [root@compute-1 heat-admin]# ip netns exec qrouter-15e60f7b-1f53-4688-84ec-0a3b8747cb9a ip a 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: rfp-15e60f7b-1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000 link/ether d6:9e:2b:3f:f1:c4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 inet 169.254.106.114/31 scope global rfp-15e60f7b-1 valid_lft forever preferred_lft forever inet6 fe80::d49e:2bff:fe3f:f1c4/64 scope link valid_lft forever preferred_lft forever 13: qr-db00fd0d-28: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 link/ether fa:16:3e:cb:1e:f0 brd ff:ff:ff:ff:ff:ff inet 10.0.3.1/24 brd 10.0.3.255 scope global qr-db00fd0d-28 valid_lft forever preferred_lft forever inet6 fe80::f816:3eff:fecb:1ef0/64 scope link valid_lft forever preferred_lft forever [root@compute-2 heat-admin]# ip netns qrouter-15e60f7b-1f53-4688-84ec-0a3b8747cb9a (id: 0) fip-4eecbefb-7d7a-4210-836e-3b2b3de215db (id: 1) [root@compute-2 heat-admin]# ip netns exec qrouter-15e60f7b-1f53-4688-84ec-0a3b8747cb9a ip a 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: rfp-15e60f7b-1@if5: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000 link/ether 4a:e2:e3:cd:66:44 brd ff:ff:ff:ff:ff:ff link-netnsid 0 inet 169.254.95.212/31 scope global rfp-15e60f7b-1 valid_lft forever preferred_lft forever inet6 fe80::48e2:e3ff:fecd:6644/64 scope link valid_lft forever preferred_lft forever 33: qr-00a27ff9-15: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 link/ether fa:16:3e:ae:76:ac brd ff:ff:ff:ff:ff:ff inet 10.1.0.1/24 brd 10.1.0.255 scope global qr-00a27ff9-15 valid_lft forever preferred_lft forever inet6 fe80::f816:3eff:feae:76ac/64 scope link valid_lft forever preferred_lft forever Similar behavior in controllers: (overcloud) [stack@undercloud-0 ~]$ openstack router show guirouter +-------------------------+--------------------------------------+ | Field | Value | +-------------------------+--------------------------------------+ | admin_state_up | UP | | availability_zone_hints | | | availability_zones | nova | | created_at | 2019-03-21T10:26:42Z | | description | | | distributed | True | | external_gateway_info | None | | flavor_id | None | | ha | False | | id | 1c862e3a-ccca-4cae-9893-7d6028400eae | | interfaces_info | [] | | name | guirouter | | project_id | 908c484257cf4e8cb09d170caa0cea06 | | revision_number | 6 | | routes | | | status | ACTIVE | | tags | | | updated_at | 2019-03-21T16:00:16Z | +-------------------------+--------------------------------------+ Deleted even esternal gateway: [root@controller-1 heat-admin]# ip netns exec qrouter-1c862e3a-ccca-4cae-9893-7d6028400eae ip a 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever [root@controller-1 heat-admin]# When the qrouters are deleted the qrouters are deleted. ** Affects: neutron Importance: Undecided Status: New -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to neutron. https://bugs.launchpad.net/bugs/1821203 Title: DVR: When a subnet is removed from a router the qrouter namespaces aren't removed from the compute nodes Status in neutron: New Bug description: [stack@undercloud-0 ~]$ cat /etc/rhosp-release Red Hat OpenStack Platform release 14.0.1 RC (Rocky) [stack@undercloud-0 ~]$ yum info openstack-neutron Loaded plugins: search-disabled-repos Available Packages Name : openstack-neutron Arch : noarch Epoch : 1 Version : 13.0.3 Release : 0.20190119134915.886782c.el7ost Size : 28 k Repo : rhelosp-14.0-puddle/x86_64 Summary : OpenStack Networking Service URL : http://launchpad.net/neutron/ License : ASL 2.0 Description : : Neutron is a virtual network service for Openstack. Just like : OpenStack Nova provides an API to dynamically request and configure : virtual servers, Neutron provides an API to dynamically request and : configure virtual networks. These networks connect "interfaces" from : other OpenStack services (e.g., virtual NICs from Nova VMs). The : Neutron API supports extensions to provide advanced network : capabilities (e.g., QoS, ACLs, network monitoring, etc.) [stack@undercloud-0 ~]$ yum list | grep neutron puppet-neutron.noarch 13.3.1-0.20181013115834.el7ost python2-neutron-lib.noarch 1.18.0-0.20180816094046.67865c7.el7ost python2-neutronclient.noarch 6.9.1-0.20180925041810.7eba94e.el7ost openstack-neutron.noarch 1:13.0.3-0.20190119134915.886782c.el7ost openstack-neutron-bigswitch-agent.noarch openstack-neutron-bigswitch-lldp.noarch openstack-neutron-common.noarch 1:13.0.3-0.20190119134915.886782c.el7ost openstack-neutron-fwaas.noarch 1:13.0.2-0.20190123183836.90951a5.el7ost openstack-neutron-l2gw-agent.noarch openstack-neutron-lbaas.noarch 1:13.0.1-0.20181017150329.1353bad.el7ost openstack-neutron-lbaas-ui.noarch openstack-neutron-linuxbridge.noarch openstack-neutron-macvtap-agent.noarch openstack-neutron-metering-agent.noarch openstack-neutron-ml2.noarch 1:13.0.3-0.20190119134915.886782c.el7ost openstack-neutron-openvswitch.noarch openstack-neutron-rpc-server.noarch openstack-neutron-sriov-nic-agent.noarch python-neutron.noarch 1:13.0.3-0.20190119134915.886782c.el7ost python-neutron-fwaas.noarch 1:13.0.2-0.20190123183836.90951a5.el7ost python-neutron-fwaas-tests.noarch python-neutron-lbaas.noarch 1:13.0.1-0.20181017150329.1353bad.el7ost python-neutron-lbaas-tests.noarch python2-ironic-neutron-agent.noarch python2-neutron-lib-tests.noarch 1.18.0-0.20180816094046.67865c7.el7ost python2-neutron-tests-tempest.noarch Subnets are deleted from the routers: 51 openstack router remove subnet router 8646bed0-7dfd-43a3-bdb5-ab7368cbbbdb 54 openstack router remove subnet router2 dd8f26ec-b98a-4fe3-8d36-ee54b117dbca (overcloud) [stack@undercloud-0 ~]$ openstack router show router +-------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Field | Value | +-------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | admin_state_up | UP | | availability_zone_hints | | | availability_zones | nova | | created_at | 2019-03-20T09:15:21Z | | description | | | distributed | True | | external_gateway_info | {"network_id": "4eecbefb-7d7a-4210-836e-3b2b3de215db", "enable_snat": true, "external_fixed_ips": [{"subnet_id": "6c9c958d-caf3-4154-b266-6df78c9bd4df", "ip_address": "10.0.0.223"}]} | | flavor_id | None | | ha | False | | id | 15e60f7b-1f53-4688-84ec-0a3b8747cb9a | | interfaces_info | [] | | name | router | | project_id | 908c484257cf4e8cb09d170caa0cea06 | | revision_number | 18 | | routes | | | status | ACTIVE | | tags | | | updated_at | 2019-03-21T15:15:45Z | +-------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ (overcloud) [stack@undercloud-0 ~]$ openstack router show router2 +-------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | Field | Value | +-------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ | admin_state_up | UP | | availability_zone_hints | | | availability_zones | nova | | created_at | 2019-03-20T09:15:27Z | | description | | | distributed | True | | external_gateway_info | {"network_id": "4eecbefb-7d7a-4210-836e-3b2b3de215db", "enable_snat": true, "external_fixed_ips": [{"subnet_id": "6c9c958d-caf3-4154-b266-6df78c9bd4df", "ip_address": "10.0.0.214"}]} | | flavor_id | None | | ha | False | | id | 6d303551-abc1-483e-9a12-ffaf7240fb2e | | interfaces_info | [] | | name | router2 | | project_id | 908c484257cf4e8cb09d170caa0cea06 | | revision_number | 10 | | routes | | | status | ACTIVE | | tags | | | updated_at | 2019-03-21T15:33:54Z | +-------------------------+----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+ But qrouter namespaces aren't deleted in the computes: [root@compute-1 heat-admin]# ip netns qrouter-6d303551-abc1-483e-9a12-ffaf7240fb2e (id: 2) fip-4eecbefb-7d7a-4210-836e-3b2b3de215db (id: 1) qrouter-15e60f7b-1f53-4688-84ec-0a3b8747cb9a (id: 0) [root@compute-1 heat-admin]# ip netns exec qrouter-6d303551-abc1-483e-9a12-ffaf7240fb2e ip a 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: rfp-6d303551-a@if3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000 link/ether 5a:92:68:df:f0:23 brd ff:ff:ff:ff:ff:ff link-netnsid 0 inet 169.254.109.46/31 scope global rfp-6d303551-a valid_lft forever preferred_lft forever inet6 fe80::5892:68ff:fedf:f023/64 scope link valid_lft forever preferred_lft forever 19: qr-cf638cc8-a6: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 link/ether fa:16:3e:2c:af:c1 brd ff:ff:ff:ff:ff:ff inet 10.0.3.1/24 brd 10.0.3.255 scope global qr-cf638cc8-a6 valid_lft forever preferred_lft forever inet6 fe80::f816:3eff:fe2c:afc1/64 scope link valid_lft forever preferred_lft forever [root@compute-1 heat-admin]# ip netns exec qrouter-15e60f7b-1f53-4688-84ec-0a3b8747cb9a ip a 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: rfp-15e60f7b-1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000 link/ether d6:9e:2b:3f:f1:c4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 inet 169.254.106.114/31 scope global rfp-15e60f7b-1 valid_lft forever preferred_lft forever inet6 fe80::d49e:2bff:fe3f:f1c4/64 scope link valid_lft forever preferred_lft forever 13: qr-db00fd0d-28: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 link/ether fa:16:3e:cb:1e:f0 brd ff:ff:ff:ff:ff:ff inet 10.0.3.1/24 brd 10.0.3.255 scope global qr-db00fd0d-28 valid_lft forever preferred_lft forever inet6 fe80::f816:3eff:fecb:1ef0/64 scope link valid_lft forever preferred_lft forever [root@compute-2 heat-admin]# ip netns qrouter-15e60f7b-1f53-4688-84ec-0a3b8747cb9a (id: 0) fip-4eecbefb-7d7a-4210-836e-3b2b3de215db (id: 1) [root@compute-2 heat-admin]# ip netns exec qrouter-15e60f7b-1f53-4688-84ec-0a3b8747cb9a ip a 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: rfp-15e60f7b-1@if5: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000 link/ether 4a:e2:e3:cd:66:44 brd ff:ff:ff:ff:ff:ff link-netnsid 0 inet 169.254.95.212/31 scope global rfp-15e60f7b-1 valid_lft forever preferred_lft forever inet6 fe80::48e2:e3ff:fecd:6644/64 scope link valid_lft forever preferred_lft forever 33: qr-00a27ff9-15: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 link/ether fa:16:3e:ae:76:ac brd ff:ff:ff:ff:ff:ff inet 10.1.0.1/24 brd 10.1.0.255 scope global qr-00a27ff9-15 valid_lft forever preferred_lft forever inet6 fe80::f816:3eff:feae:76ac/64 scope link valid_lft forever preferred_lft forever Similar behavior in controllers: (overcloud) [stack@undercloud-0 ~]$ openstack router show guirouter +-------------------------+--------------------------------------+ | Field | Value | +-------------------------+--------------------------------------+ | admin_state_up | UP | | availability_zone_hints | | | availability_zones | nova | | created_at | 2019-03-21T10:26:42Z | | description | | | distributed | True | | external_gateway_info | None | | flavor_id | None | | ha | False | | id | 1c862e3a-ccca-4cae-9893-7d6028400eae | | interfaces_info | [] | | name | guirouter | | project_id | 908c484257cf4e8cb09d170caa0cea06 | | revision_number | 6 | | routes | | | status | ACTIVE | | tags | | | updated_at | 2019-03-21T16:00:16Z | +-------------------------+--------------------------------------+ Deleted even esternal gateway: [root@controller-1 heat-admin]# ip netns exec qrouter-1c862e3a-ccca-4cae-9893-7d6028400eae ip a 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever [root@controller-1 heat-admin]# When the qrouters are deleted the qrouters are deleted. To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/1821203/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : yahoo-eng-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp