[ https://issues.apache.org/jira/browse/CLOUDSTACK-7544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jayapal Reddy updated CLOUDSTACK-7544: -------------------------------------- Description: Repro steps: Step1: Enable static nat on 10.147.30.50 - static nat - eth3 Step2: Enable static nat on 10.147.48.90 - static nat - eth4 Step3: Enable static nat on 10.147.48.92 - static nat - eth4 5: eth3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000 link/ether 06:cb:f9:00:00:0d brd ff:ff:ff:ff:ff:ff inet 10.147.30.50/24 brd 10.147.30.255 scope global eth3 inet6 fe80::4cb:f9ff:fe00:d/64 scope link valid_lft forever preferred_lft forever 6: eth4: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000 link/ether 06:cb:fa:00:00:0d brd ff:ff:ff:ff:ff:ff inet 10.147.48.90/24 brd 10.147.48.255 scope global eth4 inet 10.147.48.92/24 brd 10.147.48.255 scope global secondary eth4 inet6 fe80::4cb:faff:fe00:d/64 scope link valid_lft forever preferred_lft forever Step4: delete static nat on 10.147.40.50 - atatic nat, eth3 got removed on VR 4: eth2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000 link/ether 06:cb:f0:00:00:0d brd ff:ff:ff:ff:ff:ff inet 10.147.31.23/24 brd 10.147.31.255 scope global eth2 inet 10.147.31.22/24 brd 10.147.31.255 scope global secondary eth2 inet6 fe80::4cb:f0ff:fe00:d/64 scope link valid_lft forever preferred_lft forever 22: eth4: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000 link/ether 06:cb:fa:00:00:0d brd ff:ff:ff:ff:ff:ff inet 10.147.48.92/24 brd 10.147.48.255 scope global eth4 inet 10.147.48.90/24 brd 10.147.48.255 scope global secondary eth4 inet6 fe80::4cb:faff:fe00:d/64 scope link valid_lft forever preferred_lft forever Step4: disable static nat on 10.147.48.90 (first ip) and observe that the eth4 is removed with all the ups [30573] 2014-08-14 17:44:45.175056 #### VMOPS enter setFirewallRule #### [30573] 2014-08-14 17:44:45.175140 ['/bin/bash', '/opt/xensource/bin/call_firewall.sh', '169.254.3.228', '-D', '', '-l', '10.147.48.92', '-r', '10.1.1.138', '-d', '0:0', '-G', ''] [30573] 2014-08-14 17:44:45.421672 SUCCESS [30573] 2014-08-14 17:44:45.421774 #### VMOPS exit setFirewallRule #### [30586] 2014-08-14 17:44:45.790151 #### VMOPS enter routerProxy #### [30586] 2014-08-14 17:44:45.790228 ['/bin/bash', '/opt/xensource/bin/router_proxy.sh', 'ipassoc.sh', '169.254.3.228', '-D', '', '-s', '-f', '-l', '10.147.48.92/24', '-c', 'eth4', '-g', '10.147.48.1'] 4: eth2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000 link/ether 06:cb:f0:00:00:0d brd ff:ff:ff:ff:ff:ff inet 10.147.31.23/24 brd 10.147.31.255 scope global eth2 inet 10.147.31.22/24 brd 10.147.31.255 scope global secondary eth2 inet6 fe80::4cb:f0ff:fe00:d/64 scope link valid_lft forever preferred_lft forever 23: eth4: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000 link/ether 06:cb:fa:00:00:0d brd ff:ff:ff:ff:ff:ff inet6 fe80::4cb:faff:fe00:d/64 scope link valid_lft forever preferred_lft forever was: Repro steps: Step1: Enable static nat on 10.147.30.50 - static nat - eth3 Step2: Enable static nat on 10.147.48.90 - static nat - eth4 Step3: Enable static nat on 10.147.48.92 - static nat - eth4 5: eth3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000 link/ether 06:cb:f9:00:00:0d brd ff:ff:ff:ff:ff:ff inet 10.147.30.50/24 brd 10.147.30.255 scope global eth3 inet6 fe80::4cb:f9ff:fe00:d/64 scope link valid_lft forever preferred_lft forever 6: eth4: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000 link/ether 06:cb:fa:00:00:0d brd ff:ff:ff:ff:ff:ff inet 10.147.48.90/24 brd 10.147.48.255 scope global eth4 inet 10.147.48.92/24 brd 10.147.48.255 scope global secondary eth4 inet6 fe80::4cb:faff:fe00:d/64 scope link valid_lft forever preferred_lft forever Step4: delete static nat on 10.147.40.50 - atatic nat, eth3 got removed on VR 4: eth2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000 link/ether 06:cb:f0:00:00:0d brd ff:ff:ff:ff:ff:ff inet 10.147.31.23/24 brd 10.147.31.255 scope global eth2 inet 10.147.31.22/24 brd 10.147.31.255 scope global secondary eth2 inet6 fe80::4cb:f0ff:fe00:d/64 scope link valid_lft forever preferred_lft forever 22: eth4: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000 link/ether 06:cb:fa:00:00:0d brd ff:ff:ff:ff:ff:ff inet 10.147.48.92/24 brd 10.147.48.255 scope global eth4 inet 10.147.48.90/24 brd 10.147.48.255 scope global secondary eth4 inet6 fe80::4cb:faff:fe00:d/64 scope link valid_lft forever preferred_lft forever Step4: disable static nat on 10.147.48.90 (first ip) and observe that the eth4 is removed and eth3 got created. eth4 should not be created untill all the ips on eth4 are removed. [30573] 2014-08-14 17:44:45.175056 #### VMOPS enter setFirewallRule #### [30573] 2014-08-14 17:44:45.175140 ['/bin/bash', '/opt/xensource/bin/call_firewall.sh', '169.254.3.228', '-D', '', '-l', '10.147.48.92', '-r', '10.1.1.138', '-d', '0:0', '-G', ''] [30573] 2014-08-14 17:44:45.421672 SUCCESS [30573] 2014-08-14 17:44:45.421774 #### VMOPS exit setFirewallRule #### [30586] 2014-08-14 17:44:45.790151 #### VMOPS enter routerProxy #### [30586] 2014-08-14 17:44:45.790228 ['/bin/bash', '/opt/xensource/bin/router_proxy.sh', 'ipassoc.sh', '169.254.3.228', '-D', '', '-s', '-f', '-l', '10.147.48.92/24', '-c', 'eth4', '-g', '10.147.48.1'] [30586] 2014-08-14 17:44:46.052362 SUCCESS [30586] 2014-08-14 17:44:46.052464 #### VMOPS exit routerProxy #### [30592] 2014-08-14 17:44:46.135226 #### VMOPS enter routerProxy #### [30592] 2014-08-14 17:44:46.135306 ['/bin/bash', '/opt/xensource/bin/router_proxy.sh', 'ipassoc.sh', '169.254.3.228', '-D', '', '-s', '-f', '-l', '10.147.48.92/24', '-c', 'eth4', '-g', '10.147.48.1', '-d'] [30592] 2014-08-14 17:44:46.244325 FAILED: (rc 1) stdout: '', stderr: '+ ssh -p 3922 -q -o StrictHostKeyChecking=no -i /root/.ssh/id_rsa.cloud root@169.254.3.228 '/opt/cloud/bin/ipassoc.sh -D -s -f -l 10.147.48.92/24 -c eth4 -g 10.147.48.1 -d' + exit 1 ' [30592] 2014-08-14 17:44:46.244453 routerProxy command ipassoc.sh 169.254.3.228 -D -s -f -l 10.147.48.92/24 -c eth4 -g 10.147.48.1 -d failed [30592] 2014-08-14 17:44:46.244511 #### VMOPS exit routerProxy #### [30598] 2014-08-14 17:44:46.336404 #### VMOPS enter routerProxy #### [30598] 2014-08-14 17:44:46.336475 ['/bin/bash', '/opt/xensource/bin/router_proxy.sh', 'netusage.sh', '169.254.3.228', '-d', 'eth4'] [30598] 2014-08-14 17:44:46.443086 SUCCESS [30598] 2014-08-14 17:44:46.443189 #### VMOPS exit routerProxy #### [31018] 2014-08-14 17:44:49.121661 #### VMOPS enter routerProxy #### [31018] 2014-08-14 17:44:49.121736 ['/bin/bash', '/opt/xensource/bin/router_proxy.sh', 'netusage.sh', '169.254.3.228', '-a', 'eth3'] [31018] 2014-08-14 17:44:49.238719 SUCCESS [31018] 2014-08-14 17:44:49.238821 #### VMOPS exit routerProxy #### [31025] 2014-08-14 17:44:49.330067 #### VMOPS enter routerProxy #### [31025] 2014-08-14 17:44:49.330145 ['/bin/bash', '/opt/xensource/bin/router_proxy.sh', 'ipassoc.sh', '169.254.3.228', '-A', '', '-s', '-f', '-l', '10.147.48.90/24', '-c', 'eth3', '-g', '10.147.48.1'] [31025] 2014-08-14 17:44:49.735468 SUCCESS [31025] 2014-08-14 17:44:49.735568 #### VMOPS exit routerProxy #### [31037] 2014-08-14 17:44:50.265990 #### VMOPS enter routerProxy #### [31037] 2014-08-14 17:44:50.266069 ['/bin/bash', '/opt/xensource/bin/router_proxy.sh', 'ipassoc.sh', '169.254.3.228', '-A', '', '-s', '-f', '-l', '10.147.31.23/24', '-c', 'eth2', '-g', '10.147.31.1'] [31037] 2014-08-14 17:44:50.574538 SUCCESS [31037] 2014-08-14 17:44:50.574635 #### VMOPS exit routerProxy #### [31043] 2014-08-14 17:44:50.782783 #### VMOPS enter routerProxy #### [31043] 2014-08-14 17:44:50.782859 ['/bin/bash', '/opt/xensource/bin/router_proxy.sh', 'ipassoc.sh', '169.254.3.228', '-A', '', '-l', '10.147.31.22/24', '-c', 'eth2', '-g', '10.147.31.1'] [31043] 2014-08-14 17:44:51.042625 SUCCESS [31043] 2014-08-14 17:44:51.042726 #### VMOPS 4: eth2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000 link/ether 06:cb:f0:00:00:0d brd ff:ff:ff:ff:ff:ff inet 10.147.31.23/24 brd 10.147.31.255 scope global eth2 inet 10.147.31.22/24 brd 10.147.31.255 scope global secondary eth2 inet6 fe80::4cb:f0ff:fe00:d/64 scope link valid_lft forever preferred_lft forever 23: eth3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000 link/ether 06:cb:fa:00:00:0d brd ff:ff:ff:ff:ff:ff inet 10.147.48.90/24 brd 10.147.48.255 scope global eth3 inet6 fe80::4cb:faff:fe00:d/64 scope link valid_lft forever preferred_lft forever > In multiple public subnet interface all ips got removed while removing first > ip > ------------------------------------------------------------------------------- > > Key: CLOUDSTACK-7544 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-7544 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) > Components: Network Controller > Affects Versions: 4.0.2 > Reporter: Jayapal Reddy > Assignee: Jayapal Reddy > Fix For: 4.5.0 > > > Repro steps: > Step1: Enable static nat on 10.147.30.50 - static nat - eth3 > Step2: Enable static nat on 10.147.48.90 - static nat - eth4 > Step3: Enable static nat on 10.147.48.92 - static nat - eth4 > 5: eth3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP > qlen 1000 > link/ether 06:cb:f9:00:00:0d brd ff:ff:ff:ff:ff:ff > inet 10.147.30.50/24 brd 10.147.30.255 scope global eth3 > inet6 fe80::4cb:f9ff:fe00:d/64 scope link > valid_lft forever preferred_lft forever > 6: eth4: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP > qlen 1000 > link/ether 06:cb:fa:00:00:0d brd ff:ff:ff:ff:ff:ff > inet 10.147.48.90/24 brd 10.147.48.255 scope global eth4 > inet 10.147.48.92/24 brd 10.147.48.255 scope global secondary eth4 > inet6 fe80::4cb:faff:fe00:d/64 scope link > valid_lft forever preferred_lft forever > Step4: delete static nat on 10.147.40.50 - atatic nat, eth3 got removed on VR > 4: eth2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP > qlen 1000 > link/ether 06:cb:f0:00:00:0d brd ff:ff:ff:ff:ff:ff > inet 10.147.31.23/24 brd 10.147.31.255 scope global eth2 > inet 10.147.31.22/24 brd 10.147.31.255 scope global secondary eth2 > inet6 fe80::4cb:f0ff:fe00:d/64 scope link > valid_lft forever preferred_lft forever > 22: eth4: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state > UP qlen 1000 > link/ether 06:cb:fa:00:00:0d brd ff:ff:ff:ff:ff:ff > inet 10.147.48.92/24 brd 10.147.48.255 scope global eth4 > inet 10.147.48.90/24 brd 10.147.48.255 scope global secondary eth4 > inet6 fe80::4cb:faff:fe00:d/64 scope link > valid_lft forever preferred_lft forever > Step4: disable static nat on 10.147.48.90 (first ip) and observe that the > eth4 is removed with all the ups > [30573] 2014-08-14 17:44:45.175056 #### VMOPS enter setFirewallRule #### > [30573] 2014-08-14 17:44:45.175140 ['/bin/bash', > '/opt/xensource/bin/call_firewall.sh', '169.254.3.228', '-D', '', '-l', > '10.147.48.92', '-r', '10.1.1.138', '-d', '0:0', '-G', ''] > [30573] 2014-08-14 17:44:45.421672 SUCCESS > [30573] 2014-08-14 17:44:45.421774 #### VMOPS exit setFirewallRule #### > [30586] 2014-08-14 17:44:45.790151 #### VMOPS enter routerProxy #### > [30586] 2014-08-14 17:44:45.790228 ['/bin/bash', > '/opt/xensource/bin/router_proxy.sh', 'ipassoc.sh', '169.254.3.228', '-D', > '', '-s', '-f', '-l', '10.147.48.92/24', '-c', 'eth4', '-g', '10.147.48.1'] > 4: eth2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP > qlen 1000 > link/ether 06:cb:f0:00:00:0d brd ff:ff:ff:ff:ff:ff > inet 10.147.31.23/24 brd 10.147.31.255 scope global eth2 > inet 10.147.31.22/24 brd 10.147.31.255 scope global secondary eth2 > inet6 fe80::4cb:f0ff:fe00:d/64 scope link > valid_lft forever preferred_lft forever > 23: eth4: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state > UP qlen 1000 > link/ether 06:cb:fa:00:00:0d brd ff:ff:ff:ff:ff:ff > inet6 fe80::4cb:faff:fe00:d/64 scope link > valid_lft forever preferred_lft forever -- This message was sent by Atlassian JIRA (v6.3.4#6332)