Public bug reported: Steps to reproduce: 1)Create a router 2)Add router interface to subnet 3)boot a vm 4)create a floating ip and associate it to vm port id 5)Make l3 agent down on active controller stack@padawan-ccp-c1-m2-mgmt:~$ neutron l3-agent-list-hosting-router 23ec6a25-b578-4630-86ba-3a544293385b --------------------------------------------------------------------------------------- id host admin_state_up alive ha_state --------------------------------------------------------------------------------------- 5d47d95e-3750-4007-86b3-a724092cfd85 padawan-ccp-c1-m3-mgmt True active 24dd994c-5e67-41b7-acd6-8766b50f838d padawan-ccp-c1-m2-mgmt True xxx standby --------------------------------------------------------------------------------------- stack@padawan-ccp-c1-m2-mgmt:~$ sudo ip netns exec qrouter-23ec6a25-b578-4630-86ba-3a544293385b ifconfig ha-b6dcf491-e6 Link encap:Ethernet HWaddr fa:16:3e:ce:ff:13 inet addr:169.254.192.5 Bcast:169.254.255.255 Mask:255.255.192.0 inet6 addr: fe80::f816:3eff:fece:ff13/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:3650 errors:0 dropped:391 overruns:0 frame:0 TX packets:404 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:229496 (224.1 KiB) TX bytes:22476 (21.9 KiB) lo Link encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 inet6 addr: ::1/128 Scope:Host UP LOOPBACK RUNNING MTU:65536 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 B) TX bytes:0 (0.0 B) qg-3d627c6b-86 Link encap:Ethernet HWaddr fa:16:3e:70:95:f3 inet addr:10.36.0.24 Bcast:0.0.0.0 Mask:255.255.0.0 inet6 addr: fe80::f816:3eff:fe70:95f3/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:8961 errors:0 dropped:8 overruns:0 frame:0 TX packets:249 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:600352 (586.2 KiB) TX bytes:20626 (20.1 KiB) qr-ba518ea4-f7 Link encap:Ethernet HWaddr fa:16:3e:9f:89:aa inet addr:7.7.7.1 Bcast:0.0.0.0 Mask:255.255.255.0 inet6 addr: fe80::f816:3eff:fe9f:89aa/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:923 errors:0 dropped:1 overruns:0 frame:0 TX packets:395 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:79946 (78.0 KiB) TX bytes:38625 (37.7 KiB) stack@padawan-ccp-c1-m3-mgmt:~$ sudo ip netns exec qrouter-23ec6a25-b578-4630-86ba-3a544293385b ifconfig ha-47cfce0e-c5 Link encap:Ethernet HWaddr fa:16:3e:db:39:24 inet addr:169.254.192.6 Bcast:169.254.255.255 Mask:255.255.192.0 inet6 addr: fe80::f816:3eff:fedb:3924/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:3223 errors:0 dropped:581 overruns:0 frame:0 TX packets:833 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:196426 (191.8 KiB) TX bytes:46062 (44.9 KiB) lo Link encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 inet6 addr: ::1/128 Scope:Host UP LOOPBACK RUNNING MTU:65536 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 B) TX bytes:0 (0.0 B) qg-3d627c6b-86 Link encap:Ethernet HWaddr fa:16:3e:70:95:f3 inet addr:10.36.0.24 Bcast:0.0.0.0 Mask:255.255.0.0 inet6 addr: fe80::f816:3eff:fe70:95f3/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:2522 errors:0 dropped:0 overruns:0 frame:0 TX packets:1059 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:213140 (208.1 KiB) TX bytes:98562 (96.2 KiB) qr-ba518ea4-f7 Link encap:Ethernet HWaddr fa:16:3e:9f:89:aa inet addr:7.7.7.1 Bcast:0.0.0.0 Mask:255.255.255.0 inet6 addr: fe80::f816:3eff:fe9f:89aa/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:1462 errors:0 dropped:0 overruns:0 frame:0 TX packets:1035 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:132248 (129.1 KiB) TX bytes:97302 (95.0 KiB)
================================================================== checking if there is any loss in network traffic when L3 agent comes back. And verifying the master ownership of the HA router. There is a duplicate ip in the network Three things to discuss here, 1) Before making l3 agent down these are the status of controllers m2 = active m1 = stand_by m3 = stand_by I made m2 l3 agent down and started again, There is a 4 packet loss and the status of the controllers ofter making m2 l3 agent down is m2 = stand_by m1 = active m3 = active 2 ) Before making l3 agent down, m1 = active m3 = active m2 standby I made l3 agent down of m1 and m3 controllers and started again, there is duplicate of ip address on controllers and there is no packet loss After making l3 agent down here is the status of the controllers m2 = active m1 = active m3 = active 3) Before making m2's L3 agent down m2 = active m1 = active m3 = active stack@padawan-ccp-c1-m2-mgmt:~$ neutron l3-agent-list-hosting-router 1f9d90e8-8e5c-4b8a-aa8e-59f28edd2243 --------------------------------------------------------------------------------------- id host admin_state_up alive ha_state --------------------------------------------------------------------------------------- 5d47d95e-3750-4007-86b3-a724092cfd85 padawan-ccp-c1-m3-mgmt True active 24dd994c-5e67-41b7-acd6-8766b50f838d padawan-ccp-c1-m2-mgmt True active --------------------------------------------------------------------------------------- stack@padawan-ccp-c1-m2-mgmt:~$ neutron l3-agent-list-hosting-router 5b20094e-e734-4961-a2b9-4b7812d50c02 --------------------------------------------------------------------------------------- id host admin_state_up alive ha_state --------------------------------------------------------------------------------------- a291a2fd-0a2b-4bc3-b04c-ab750e4ae8db padawan-ccp-c1-m1-mgmt True active 24dd994c-5e67-41b7-acd6-8766b50f838d padawan-ccp-c1-m2-mgmt True active --------------------------------------------------------------------------------------- I made l3 agent down of m2 controller, and started again, there is a duplicate of ip address and duplicate of ping. 64 bytes from 10.36.0.6: icmp_seq=1 ttl=62 time=2.72 ms 64 bytes from 10.36.0.6: icmp_seq=1 ttl=62 time=2.75 ms (DUP!) 64 bytes from 10.36.0.6: icmp_seq=2 ttl=62 time=1.33 ms 64 bytes from 10.36.0.6: icmp_seq=3 ttl=62 time=0.648 ms 64 bytes from 10.36.0.6: icmp_seq=4 ttl=62 time=0.707 ms 64 bytes from 10.36.0.6: icmp_seq=5 ttl=62 time=0.658 ms ** Affects: neutron Importance: Undecided Status: New ** Attachment added: "keepalived.zip" https://bugs.launchpad.net/bugs/1547412/+attachment/4575405/+files/keepalived.zip ** Summary changed: - Router interfaces exists on all the controllers after making L3 agent down on active controller i.r duplicate ip's present + Router interfaces exists on all the controllers after making L3 agent down on active controller i.e duplicate ip's present with duplication of ping -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to neutron. https://bugs.launchpad.net/bugs/1547412 Title: Router interfaces exists on all the controllers after making L3 agent down on active controller i.e duplicate ip's present with duplication of ping Status in neutron: New Bug description: Steps to reproduce: 1)Create a router 2)Add router interface to subnet 3)boot a vm 4)create a floating ip and associate it to vm port id 5)Make l3 agent down on active controller stack@padawan-ccp-c1-m2-mgmt:~$ neutron l3-agent-list-hosting-router 23ec6a25-b578-4630-86ba-3a544293385b --------------------------------------------------------------------------------------- id host admin_state_up alive ha_state --------------------------------------------------------------------------------------- 5d47d95e-3750-4007-86b3-a724092cfd85 padawan-ccp-c1-m3-mgmt True active 24dd994c-5e67-41b7-acd6-8766b50f838d padawan-ccp-c1-m2-mgmt True xxx standby --------------------------------------------------------------------------------------- stack@padawan-ccp-c1-m2-mgmt:~$ sudo ip netns exec qrouter-23ec6a25-b578-4630-86ba-3a544293385b ifconfig ha-b6dcf491-e6 Link encap:Ethernet HWaddr fa:16:3e:ce:ff:13 inet addr:169.254.192.5 Bcast:169.254.255.255 Mask:255.255.192.0 inet6 addr: fe80::f816:3eff:fece:ff13/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:3650 errors:0 dropped:391 overruns:0 frame:0 TX packets:404 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:229496 (224.1 KiB) TX bytes:22476 (21.9 KiB) lo Link encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 inet6 addr: ::1/128 Scope:Host UP LOOPBACK RUNNING MTU:65536 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 B) TX bytes:0 (0.0 B) qg-3d627c6b-86 Link encap:Ethernet HWaddr fa:16:3e:70:95:f3 inet addr:10.36.0.24 Bcast:0.0.0.0 Mask:255.255.0.0 inet6 addr: fe80::f816:3eff:fe70:95f3/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:8961 errors:0 dropped:8 overruns:0 frame:0 TX packets:249 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:600352 (586.2 KiB) TX bytes:20626 (20.1 KiB) qr-ba518ea4-f7 Link encap:Ethernet HWaddr fa:16:3e:9f:89:aa inet addr:7.7.7.1 Bcast:0.0.0.0 Mask:255.255.255.0 inet6 addr: fe80::f816:3eff:fe9f:89aa/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:923 errors:0 dropped:1 overruns:0 frame:0 TX packets:395 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:79946 (78.0 KiB) TX bytes:38625 (37.7 KiB) stack@padawan-ccp-c1-m3-mgmt:~$ sudo ip netns exec qrouter-23ec6a25-b578-4630-86ba-3a544293385b ifconfig ha-47cfce0e-c5 Link encap:Ethernet HWaddr fa:16:3e:db:39:24 inet addr:169.254.192.6 Bcast:169.254.255.255 Mask:255.255.192.0 inet6 addr: fe80::f816:3eff:fedb:3924/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:3223 errors:0 dropped:581 overruns:0 frame:0 TX packets:833 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:196426 (191.8 KiB) TX bytes:46062 (44.9 KiB) lo Link encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 inet6 addr: ::1/128 Scope:Host UP LOOPBACK RUNNING MTU:65536 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 B) TX bytes:0 (0.0 B) qg-3d627c6b-86 Link encap:Ethernet HWaddr fa:16:3e:70:95:f3 inet addr:10.36.0.24 Bcast:0.0.0.0 Mask:255.255.0.0 inet6 addr: fe80::f816:3eff:fe70:95f3/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:2522 errors:0 dropped:0 overruns:0 frame:0 TX packets:1059 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:213140 (208.1 KiB) TX bytes:98562 (96.2 KiB) qr-ba518ea4-f7 Link encap:Ethernet HWaddr fa:16:3e:9f:89:aa inet addr:7.7.7.1 Bcast:0.0.0.0 Mask:255.255.255.0 inet6 addr: fe80::f816:3eff:fe9f:89aa/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:1462 errors:0 dropped:0 overruns:0 frame:0 TX packets:1035 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:132248 (129.1 KiB) TX bytes:97302 (95.0 KiB) ================================================================== checking if there is any loss in network traffic when L3 agent comes back. And verifying the master ownership of the HA router. There is a duplicate ip in the network Three things to discuss here, 1) Before making l3 agent down these are the status of controllers m2 = active m1 = stand_by m3 = stand_by I made m2 l3 agent down and started again, There is a 4 packet loss and the status of the controllers ofter making m2 l3 agent down is m2 = stand_by m1 = active m3 = active 2 ) Before making l3 agent down, m1 = active m3 = active m2 standby I made l3 agent down of m1 and m3 controllers and started again, there is duplicate of ip address on controllers and there is no packet loss After making l3 agent down here is the status of the controllers m2 = active m1 = active m3 = active 3) Before making m2's L3 agent down m2 = active m1 = active m3 = active stack@padawan-ccp-c1-m2-mgmt:~$ neutron l3-agent-list-hosting-router 1f9d90e8-8e5c-4b8a-aa8e-59f28edd2243 --------------------------------------------------------------------------------------- id host admin_state_up alive ha_state --------------------------------------------------------------------------------------- 5d47d95e-3750-4007-86b3-a724092cfd85 padawan-ccp-c1-m3-mgmt True active 24dd994c-5e67-41b7-acd6-8766b50f838d padawan-ccp-c1-m2-mgmt True active --------------------------------------------------------------------------------------- stack@padawan-ccp-c1-m2-mgmt:~$ neutron l3-agent-list-hosting-router 5b20094e-e734-4961-a2b9-4b7812d50c02 --------------------------------------------------------------------------------------- id host admin_state_up alive ha_state --------------------------------------------------------------------------------------- a291a2fd-0a2b-4bc3-b04c-ab750e4ae8db padawan-ccp-c1-m1-mgmt True active 24dd994c-5e67-41b7-acd6-8766b50f838d padawan-ccp-c1-m2-mgmt True active --------------------------------------------------------------------------------------- I made l3 agent down of m2 controller, and started again, there is a duplicate of ip address and duplicate of ping. 64 bytes from 10.36.0.6: icmp_seq=1 ttl=62 time=2.72 ms 64 bytes from 10.36.0.6: icmp_seq=1 ttl=62 time=2.75 ms (DUP!) 64 bytes from 10.36.0.6: icmp_seq=2 ttl=62 time=1.33 ms 64 bytes from 10.36.0.6: icmp_seq=3 ttl=62 time=0.648 ms 64 bytes from 10.36.0.6: icmp_seq=4 ttl=62 time=0.707 ms 64 bytes from 10.36.0.6: icmp_seq=5 ttl=62 time=0.658 ms To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/1547412/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : yahoo-eng-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp