[ https://issues.apache.org/jira/browse/CLOUDSTACK-5254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
shweta agarwal closed CLOUDSTACK-5254. -------------------------------------- Verified . fixed . Passed > firewall command is not applied on VR after upgrade if firewall rule is set > on VR when VR is on older version > ------------------------------------------------------------------------------------------------------------- > > Key: CLOUDSTACK-5254 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-5254 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) > Components: Upgrade, Virtual Router > Affects Versions: 4.3.0 > Environment: upgrade setup from 3.07 to 4.3 > Reporter: shweta agarwal > Assignee: Kishan Kavala > Priority: Critical > Fix For: 4.3.0 > > Attachments: cloud-afterupgrade.dmp, management-server.log.tar.gz > > > Repro steps: > Upgrade setup from 3.0.7 to 4.3 > Apply firewall rule, lb and PF rule on router that are not yet upgraded. > We will get failure message that rules are not applied as router need upgrade > however all rules are stored in Db so as to be applied on router once router > is upgraded > Now upgrade the router > check Firewall rule on router > Bug: > Firewall rule is not applied > Verified as LB rule on the IP is also not working > MS log shows sending Firewall rule being send as a part of upgrade router > Snippets: > 2013-11-25 04:51:03,063 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] > (Job-Executor-7:ctx-2083f2cb ctx-61e53048) Boot Args for > VM[DomainRouter|r-6-VM]: template=domP name=r-6-VM eth2ip=10.147.51.21 > eth2mask=255.255.255.0 gateway=10.147.51.1 eth0ip=10.1.1.1 > eth0mask=255.255.255.0 domain=cs2cloud.internal dhcprange=10.1.1.1 > eth1ip=169.254.0.42 eth1mask=255.255.0.0 type=router disable_rp_filter=true > dns1=10.140.50.6 > 2013-11-25 04:51:03,164 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] > (Job-Executor-7:ctx-2083f2cb ctx-61e53048) Found 2 ip(s) to apply as a part > of domR VM[DomainRouter|r-6-VM] start. > 2013-11-25 04:51:03,203 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] > (Job-Executor-7:ctx-2083f2cb ctx-61e53048) Resending ipAssoc, port > forwarding, load balancing rules as a part of Virtual router start > 2013-11-25 04:51:03,219 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] > (Job-Executor-7:ctx-2083f2cb ctx-61e53048) Found 0 firewall Egress rule(s) to > apply as a part of domR VM[DomainRouter|r-6-VM] start. > 2013-11-25 04:51:03,238 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] > (Job-Executor-7:ctx-2083f2cb ctx-61e53048) Found 0 static nat(s) to apply as > a part of domR VM[DomainRouter|r-6-VM] start. > 2013-11-25 04:51:03,238 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] > (Job-Executor-7:ctx-2083f2cb ctx-61e53048) Found 2 firewall Ingress rule(s) > to apply as a part of domR VM[DomainRouter|r-6-VM] start. > 2013-11-25 04:51:03,262 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] > (Job-Executor-7:ctx-2083f2cb ctx-61e53048) Found 1 port forwarding rule(s) to > apply as a part of domR VM[DomainRouter|r-6-VM] start. > 2013-11-25 04:51:03,272 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] > (Job-Executor-7:ctx-2083f2cb ctx-61e53048) Found 0 static nat rule(s) to > apply as a part of domR VM[DomainRouter|r-6-VM] start. > 2013-11-25 04:51:03,272 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] > (Job-Executor-7:ctx-2083f2cb ctx-61e53048) Found 0 vpn(s) to apply as a part > of domR VM[DomainRouter|r-6-VM] start. > 2013-11-25 04:51:03,288 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] > (Job-Executor-7:ctx-2083f2cb ctx-61e53048) Found 1 load balancing rule(s) to > apply as a part of domR VM[DomainRouter|r-6-VM] start. > 2013-11-25 04:51:03,318 DEBUG [c.c.n.NetworkModelImpl] > (Job-Executor-7:ctx-2083f2cb ctx-61e53048) Service SecurityGroup is not > supported in the network id=208 > 2013-11-25 04:51:03,339 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] > (Job-Executor-7:ctx-2083f2cb ctx-61e53048) Reapplying dhcp entries as a part > of domR VM[DomainRouter|r-6-VM] start... > 2013-11-25 04:51:03,345 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] > (Job-Executor-7:ctx-2083f2cb ctx-61e53048) Creating dhcp entry for vm > VM[User|vr-xen-admin] on domR VM[DomainRouter|r-6-VM]. > 2013-11-25 04:51:03,364 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] > (Job-Executor-7:ctx-2083f2cb ctx-61e53048) Reapplying vm data (userData and > metaData) entries as a part of domR VM[DomainRouter|r-6-VM] start... > 2013-11-25 04:51:03,369 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] > (Job-Executor-7:ctx-2083f2cb ctx-61e53048) Creating user data entry for vm > VM[User|vr-xen-admin] on domR VM[DomainRouter|r-6-VM] > 2013-11-25 04:51:03,382 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] > (Job-Executor-7:ctx-2083f2cb ctx-61e53048) Creating monitoring services on > VM[DomainRouter|r-6-VM] start... > 2013-11-25 04:51:03,455 DEBUG [c.c.a.t.Request] (Job-Executor-7:ctx-2083f2cb > ctx-61e53048) Seq 1-687079448: Sending { Cmd , MgmtId: 7252119388271, via: > 1(Rack1Pod1Host27), Ver: v1, Flags: 100011, > [{"com.cloud.agent.api.StartCommand":{"vm":{"id":6,"name":"r-6-VM","bootloader":"PyGrub","type":"DomainRouter","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":134217728,"maxRam":134217728,"arch":"x86_64","os":"Debian > GNU/Linux 6(64-bit)","bootArgs":" template=domP name=r-6-VM > eth2ip=10.147.51.21 eth2mask=255.255.255.0 gateway=10.147.51.1 > eth0ip=10.1.1.1 eth0mask=255.255.255.0 domain=cs2cloud.internal > dhcprange=10.1.1.1 eth1ip=169.254.0.42 eth1mask=255.255.0.0 type=router > disable_rp_filter=true > dns1=10.140.50.6","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"e49247aa86704772","params":{"memoryOvercommitRatio":"1","cpuOvercommitRatio":"1"},"uuid":"ca7f684d-915f-4d65-8b93-10eab67f8bb7","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"772a78b0-53ac-453a-a419-8282d3a67c88","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"816a701b-e279-3d88-aa76-ebc08937b2f2","id":200,"poolType":"NetworkFilesystem","host":"10.147.28.7","path":"/export/home/shweta/307.xen.primary","port":2049,"url":"NetworkFilesystem://10.147.28.7//export/home/shweta/307.xen.primary/?ROLE=Primary&STOREUUID=816a701b-e279-3d88-aa76-ebc08937b2f2"}},"name":"ROOT-6","size":2621440000,"path":"5e4d8a7e-e6d5-4c3c-9a93-b216e4bcff43","volumeId":59,"vmName":"r-6-VM","accountId":2,"format":"VHD","id":59,"deviceId":0,"hypervisorType":"XenServer"}},"diskSeq":0,"path":"5e4d8a7e-e6d5-4c3c-9a93-b216e4bcff43","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"10.147.28.7","volumeSize":"2621440000"}}],"nics":[{"deviceId":2,"networkRateMbps":200,"defaultNic":true,"uuid":"cebdf095-b3cd-4053-9dc7-b73ca1eb4f02","ip":"10.147.51.21","netmask":"255.255.255.0","gateway":"10.147.51.1","mac":"06:bb:aa:00:00:20","dns1":"10.140.50.6","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://51","isolationUri":"vlan://51","isSecurityGroupEnabled":false},{"deviceId":0,"networkRateMbps":200,"defaultNic":false,"uuid":"fdf69706-b0f3-4827-8d93-00edc973dfcf","ip":"10.1.1.1","netmask":"255.255.255.0","mac":"02:00:01:99:00:02","dns1":"10.140.50.6","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://1059","isolationUri":"vlan://1059","isSecurityGroupEnabled":false},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"uuid":"ae74a4b2-05c5-4543-8a94-7770626f07dc","ip":"169.254.0.42","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:00:2a","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.147.40.27","executeInSequence":false,"wait":0}},{"com.cloud.agent.api.check.CheckSshCommand":{"ip":"169.254.0.42","port":3922,"interval":6,"retries":100,"name":"r-6-VM","wait":0}},{"com.cloud.agent.api.GetDomRVersionCmd":{"accessDetails":{"router.ip":"169.254.0.42","router.name":"r-6-VM"},"wait":0}},{},{"com.cloud.agent.api.routing.IpAssocCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.147.51.21","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":true,"broadcastUri":"51","vlanGateway":"10.147.51.1","vlanNetmask":"255.255.255.0","vifMacAddress":"06:cb:ea:00:00:20","networkRate":200,"trafficType":"Public"},{"accountId":2,"publicIp":"10.147.51.27","sourceNat":false,"add":true,"oneToOneNat":false,"firstIP":false,"broadcastUri":"51","vlanGateway":"10.147.51.1","vlanNetmask":"255.255.255.0","vifMacAddress":"06:bb:ab:00:00:20","networkRate":200,"trafficType":"Public"}],"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.0.42","router.name":"r-6-VM"},"wait":0}},{"com.cloud.agent.api.routing.SetFirewallRulesCommand":{"rules":[{"id":37,"srcIp":"10.147.51.21","protocol":"tcp","srcPortRange":[1,55],"revoked":true,"alreadyAdded":false,"purpose":"Firewall","trafficType":"Ingress","defaultEgressPolicy":false},{"id":39,"srcIp":"10.147.51.27","protocol":"tcp","srcPortRange":[1,100],"revoked":true,"alreadyAdded":false,"purpose":"Firewall","trafficType":"Ingress","defaultEgressPolicy":false}],"accessDetails":{"router.guest.ip":"10.1.1.1","firewall.egress.default":"false","zone.network.type":"Advanced","router.ip":"169.254.0.42","router.name":"r-6-VM"},"wait":0}},{"com.cloud.agent.api.routing.SetPortForwardingRulesCommand":{"rules":[{"dstIp":"10.1.1.103","dstPortRange":[22,22],"id":38,"srcIp":"10.147.51.21","protocol":"tcp","srcPortRange":[22,22],"revoked":true,"alreadyAdded":false,"purpose":"PortForwarding","defaultEgressPolicy":false}],"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.0.42","router.name":"r-6-VM"},"wait":0}},{"com.cloud.agent.api.routing.LoadBalancerConfigCommand":{"loadBalancers":[{"uuid":"ed1d0a74-1375-4ced-8f8d-d70fc83804ea","srcIp":"10.147.51.27","srcPort":22,"protocol":"tcp","algorithm":"roundrobin","revoked":false,"alreadyAdded":false,"inline":false,"destinations":[{"destIp":"10.1.1.103","destPort":22,"revoked":false,"alreadyAdded":false}]}],"lbStatsVisibility":"global","lbStatsPublicIP":"10.147.51.21","lbStatsPrivateIP":"169.254.0.42","lbStatsGuestIP":"10.1.1.1","lbStatsPort":"8081","lbStatsSrcCidrs":"0/0","lbStatsAuth":"admin1:AdMiN123","lbStatsUri":"/admin?stats","maxconn":"4096","keepAliveEnabled":true,"nic":{"deviceId":0,"networkRateMbps":200,"defaultNic":false,"uuid":"fdf69706-b0f3-4827-8d93-00edc973dfcf","ip":"10.1.1.1","netmask":"255.255.255.0","mac":"02:00:01:99:00:02","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://1059","isolationUri":"vlan://1059","isSecurityGroupEnabled":false},"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.0.42","router.name":"r-6-VM"},"wait":0}},{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:26:b1:00:01","vmIpAddress":"10.1.1.103","vmName":"vr-xen-admin","defaultRouter":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:26:b1:00:01","isDefault":true,"executeInSequence":false,"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.name":"r-6-VM","router.ip":"169.254.0.42"},"wait":0}},{"com.cloud.agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.103","vmName":"vr-xen-admin","executeInSequence":false,"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.0.42","router.name":"r-6-VM"},"wait":0}},{"com.cloud.agent.api.routing.SetMonitorServiceCommand":{"services":[{"id":0,"service":"dhcp","processname":"dnsmasq","serviceName":"dnsmasq","servicePath":"/var/run/dnsmasq/dnsmasq.pid","pidFile":"/var/run/dnsmasq/dnsmasq.pid","isDefault":false},{"id":0,"service":"loadbalancing","processname":"haproxy","serviceName":"haproxy","servicePath":"/var/run/haproxy.pid","pidFile":"/var/run/haproxy.pid","isDefault":false},{"id":0,"service":"ssh","processname":"sshd","serviceName":"ssh","servicePath":"/var/run/sshd.pid","pidFile":"/var/run/sshd.pid","isDefault":true},{"id":0,"service":"webserver","processname":"apache2","serviceName":"apache2","servicePath":"/var/run/apache2.pid","pidFile":"/var/run/apache2.pid","isDefault":true}],"accessDetails":{"router.name":"r-6-VM","router.ip":"169.254.0.42","router.guest.ip":"10.1.1.1"},"wait":0}}] > } > 2013-11-25 04:51:03,469 DEBUG [c.c.a.t.Request] (Job-Executor-7:ctx-2083f2cb > ctx-61e53048) Seq 1-687079448: Executing: { Cmd , MgmtId: 7252119388271, > via: 1(Rack1Pod1Host27), Ver: v1, Flags: 100011, > [{"com.cloud.agent.api.StartCommand":{"vm":{"id":6,"name":"r-6-VM","bootloader":"PyGrub","type":"DomainRouter","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":134217728,"maxRam":134217728,"arch":"x86_64","os":"Debian > GNU/Linux 6(64-bit)","bootArgs":" template=domP name=r-6-VM > eth2ip=10.147.51.21 eth2mask=255.255.255.0 gateway=10.147.51.1 > eth0ip=10.1.1.1 eth0mask=255.255.255.0 domain=cs2cloud.internal > dhcprange=10.1.1.1 eth1ip=169.254.0.42 eth1mask=255.255.0.0 type=router > disable_rp_filter=true > dns1=10.140.50.6","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"e49247aa86704772","params":{"memoryOvercommitRatio":"1","cpuOvercommitRatio":"1"},"uuid":"ca7f684d-915f-4d65-8b93-10eab67f8bb7","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"772a78b0-53ac-453a-a419-8282d3a67c88","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"816a701b-e279-3d88-aa76-ebc08937b2f2","id":200,"poolType":"NetworkFilesystem","host":"10.147.28.7","path":"/export/home/shweta/307.xen.primary","port":2049,"url":"NetworkFilesystem://10.147.28.7//export/home/shweta/307.xen.primary/?ROLE=Primary&STOREUUID=816a701b-e279-3d88-aa76-ebc08937b2f2"}},"name":"ROOT-6","size":2621440000,"path":"5e4d8a7e-e6d5-4c3c-9a93-b216e4bcff43","volumeId":59,"vmName":"r-6-VM","accountId":2,"format":"VHD","id":59,"deviceId":0,"hypervisorType":"XenServer"}},"diskSeq":0,"path":"5e4d8a7e-e6d5-4c3c-9a93-b216e4bcff43","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"10.147.28.7","volumeSize":"2621440000"}}],"nics":[{"deviceId":2,"networkRateMbps":200,"defaultNic":true,"uuid":"cebdf095-b3cd-4053-9dc7-b73ca1eb4f02","ip":"10.147.51.21","netmask":"255.255.255.0","gateway":"10.147.51.1","mac":"06:bb:aa:00:00:20","dns1":"10.140.50.6","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://51","isolationUri":"vlan://51","isSecurityGroupEnabled":false},{"deviceId":0,"networkRateMbps":200,"defaultNic":false,"uuid":"fdf69706-b0f3-4827-8d93-00edc973dfcf","ip":"10.1.1.1","netmask":"255.255.255.0","mac":"02:00:01:99:00:02","dns1":"10.140.50.6","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://1059","isolationUri":"vlan://1059","isSecurityGroupEnabled":false},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"uuid":"ae74a4b2-05c5-4543-8a94-7770626f07dc","ip":"169.254.0.42","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:00:2a","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.147.40.27","executeInSequence":false,"wait":0}},{"com.cloud.agent.api.check.CheckSshCommand":{"ip":"169.254.0.42","port":3922,"interval":6,"retries":100,"name":"r-6-VM","wait":0}},{"com.cloud.agent.api.GetDomRVersionCmd":{"accessDetails":{"router.ip":"169.254.0.42","router.name":"r-6-VM"},"wait":0}},{},{"com.cloud.agent.api.routing.IpAssocCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.147.51.21","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":true,"broadcastUri":"51","vlanGateway":"10.147.51.1","vlanNetmask":"255.255.255.0","vifMacAddress":"06:cb:ea:00:00:20","networkRate":200,"trafficType":"Public"},{"accountId":2,"publicIp":"10.147.51.27","sourceNat":false,"add":true,"oneToOneNat":false,"firstIP":false,"broadcastUri":"51","vlanGateway":"10.147.51.1","vlanNetmask":"255.255.255.0","vifMacAddress":"06:bb:ab:00:00:20","networkRate":200,"trafficType":"Public"}],"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.0.42","router.name":"r-6-VM"},"wait":0}},{"com.cloud.agent.api.routing.SetFirewallRulesCommand":{"rules":[{"id":37,"srcIp":"10.147.51.21","protocol":"tcp","srcPortRange":[1,55],"revoked":true,"alreadyAdded":false,"purpose":"Firewall","trafficType":"Ingress","defaultEgressPolicy":false},{"id":39,"srcIp":"10.147.51.27","protocol":"tcp","srcPortRange":[1,100],"revoked":true,"alreadyAdded":false,"purpose":"Firewall","trafficType":"Ingress","defaultEgressPolicy":false}],"accessDetails":{"router.guest.ip":"10.1.1.1","firewall.egress.default":"false","zone.network.type":"Advanced","router.ip":"169.254.0.42","router.name":"r-6-VM"},"wait":0}},{"com.cloud.agent.api.routing.SetPortForwardingRulesCommand":{"rules":[{"dstIp":"10.1.1.103","dstPortRange":[22,22],"id":38,"srcIp":"10.147.51.21","protocol":"tcp","srcPortRange":[22,22],"revoked":true,"alreadyAdded":false,"purpose":"PortForwarding","defaultEgressPolicy":false}],"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.0.42","router.name":"r-6-VM"},"wait":0}},{"com.cloud.agent.api.routing.LoadBalancerConfigCommand":{"loadBalancers":[{"uuid":"ed1d0a74-1375-4ced-8f8d-d70fc83804ea","srcIp":"10.147.51.27","srcPort":22,"protocol":"tcp","algorithm":"roundrobin","revoked":false,"alreadyAdded":false,"inline":false,"destinations":[{"destIp":"10.1.1.103","destPort":22,"revoked":false,"alreadyAdded":false}]}],"lbStatsVisibility":"global","lbStatsPublicIP":"10.147.51.21","lbStatsPrivateIP":"169.254.0.42","lbStatsGuestIP":"10.1.1.1","lbStatsPort":"8081","lbStatsSrcCidrs":"0/0","lbStatsAuth":"admin1:AdMiN123","lbStatsUri":"/admin?stats","maxconn":"4096","keepAliveEnabled":true,"nic":{"deviceId":0,"networkRateMbps":200,"defaultNic":false,"uuid":"fdf69706-b0f3-4827-8d93-00edc973dfcf","ip":"10.1.1.1","netmask":"255.255.255.0","mac":"02:00:01:99:00:02","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://1059","isolationUri":"vlan://1059","isSecurityGroupEnabled":false},"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.0.42","router.name":"r-6-VM"},"wait":0}},{"com.cloud.agent.api.routing.DhcpEntryCommand":{"vmMac":"02:00:26:b1:00:01","vmIpAddress":"10.1.1.103","vmName":"vr-xen-admin","defaultRouter":"10.1.1.1","defaultDns":"10.1.1.1","duid":"00:03:00:01:02:00:26:b1:00:01","isDefault":true,"executeInSequence":false,"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.name":"r-6-VM","router.ip":"169.254.0.42"},"wait":0}},{"com.cloud.agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.103","vmName":"vr-xen-admin","executeInSequence":false,"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.0.42","router.name":"r-6-VM"},"wait":0}},{"com.cloud.agent.api.routing.SetMonitorServiceCommand":{"services":[{"id":0,"service":"dhcp","processname":"dnsmasq","serviceName":"dnsmasq","servicePath":"/var/run/dnsmasq/dnsmasq.pid","pidFile":"/var/run/dnsmasq/dnsmasq.pid","isDefault":false},{"id":0,"service":"loadbalancing","processname":"haproxy","serviceName":"haproxy","servicePath":"/var/run/haproxy.pid","pidFile":"/var/run/haproxy.pid","isDefault":false},{"id":0,"service":"ssh","processname":"sshd","serviceName":"ssh","servicePath":"/var/run/sshd.pid","pidFile":"/var/run/sshd.pid","isDefault":true},{"id":0,"service":"webserver","processname":"apache2","serviceName":"apache2","servicePath":"/var/run/apache2.pid","pidFile":"/var/run/apache2.pid","isDefault":true}],"accessDetails":{"router.name":"r-6-VM","router.ip":"169.254.0.42","router.guest.ip":"10.1.1.1"},"wait":0}} > 2013-11-25 04:51:03,473 DEBUG [c.c.a.m.DirectAgentAttache] > (DirectAgent-4:ctx-84beda19) Seq 1-687079448: Executing request > 2013-11-25 04:51:03,561 DEBUG [c.c.h.x.r.CitrixResourceBase] > (DirectAgent-4:ctx-84beda19) 1. The VM r-6-VM is in Starting state. > 2013-11-25 04:51:03,668 DEBUG [c.c.h.x.r.CitrixResourceBase] > (DirectAgent-4:ctx-84beda19) Created VM a4ea0540-a5d9-5e8c-60cf-87352f06933b > for r-6-VM > 2013-11-25 04:51:03,685 DEBUG [c.c.h.x.r.CitrixResourceBase] > (DirectAgent-4:ctx-84beda19) PV args are -- quiet > console=hvc0%template=domP%name=r-6-VM%eth2ip=10.147.51.21%eth2mask=255.255.255.0%gateway=10.147.51.1%eth0ip=10.1.1.1%eth0mask=255.255.255.0%domain=cs2cloud.internal%dhcprange=10.1.1.1%eth1ip=169.254.0.42%eth1mask=255.255.0.0%type=router%disable_rp_filter=true%dns1=10.140.50.6 > 2013-11-25 04:51:03,783 DEBUG [c.c.h.x.r.CitrixResourceBase] > (DirectAgent-4:ctx-84beda19) VBD 95aa3eac-ba4e-c055-dea8-0d1355ed9b90 created > for com.cloud.agent.api.to.DiskTO@6d70d158 > 2013-11-25 04:51:04,087 DEBUG [c.c.h.x.r.CitrixResourceBase] > (DirectAgent-4:ctx-84beda19) Creating VIF for r-6-VM on nic > [Nic:Public-10.147.51.21-vlan://51] > 2013-11-25 04:51:04,173 DEBUG [c.c.h.x.r.CitrixResourceBase] > (DirectAgent-4:ctx-84beda19) Found a network called > VLAN-9298e274-0f61-292a-6b9d-1465b7d52698-51 on host=10.147.40.27; > Network=e21c4505-e7ce-27e7-f09d-1a38572fef2a; > pif=3e14e3d9-5988-5f5b-9669-d6f4e27ba24e > 2013-11-25 04:51:04,223 DEBUG [c.c.h.x.r.CitrixResourceBase] > (DirectAgent-4:ctx-84beda19) Created a vif > 266d55c8-8b14-25c5-afe5-55486c798fb6 on 2 > 2013-11-25 04:51:04,223 DEBUG [c.c.h.x.r.CitrixResourceBase] > (DirectAgent-4:ctx-84beda19) Creating VIF for r-6-VM on nic > [Nic:Guest-10.1.1.1-vlan://1059] > 2013-11-25 04:51:04,278 DEBUG [c.c.h.x.r.CitrixResourceBase] > (DirectAgent-4:ctx-84beda19) Found a network called > VLAN-9298e274-0f61-292a-6b9d-1465b7d52698-1059 on host=10.147.40.27; > Network=47ddfa1d-b7ed-8af7-efea-d429c14977fb; > pif=54911ae0-110b-75cf-7fc7-ca61ec871cc3 > 2013-11-25 04:51:04,305 DEBUG [c.c.h.x.r.CitrixResourceBase] > (DirectAgent-4:ctx-84beda19) Created a vif > 18771053-c0ba-309e-21ca-d0f1c1665528 on 0 > 2013-11-25 04:51:04,305 DEBUG [c.c.h.x.r.CitrixResourceBase] > (DirectAgent-4:ctx-84beda19) Creating VIF for r-6-VM on nic > [Nic:Control-169.254.0.42-null] > 2013-11-25 04:51:04,458 DEBUG [c.c.h.x.r.CitrixResourceBase] > (DirectAgent-4:ctx-84beda19) already have a vif on dom0 for link local network > 2013-11-25 04:51:04,666 DEBUG [c.c.h.x.r.CitrixResourceBase] > (DirectAgent-4:ctx-84beda19) Created a vif > ce7acdca-d610-3b64-261b-6452a60e42b4 on 1 > 2013-11-25 04:51:05,370 DEBUG [c.c.a.ApiServlet] > (catalina-exec-22:ctx-72919dac) ===START=== 10.146.0.132 -- GET > command=queryAsyncJobResult&jobId=4a4aea95-ac69-47f6-94aa-3cc856aeb613&response=json&sessionkey=Cs8ChjFzEckNrOznBGdVPnx%2FJKU%3D&_=1385373064864 > 2013-11-25 04:51:05,451 DEBUG [c.c.a.ApiServlet] > (catalina-exec-22:ctx-72919dac ctx-9fc7d7a9) ===END=== 10.146.0.132 -- GET > command=queryAsyncJobResult&jobId=4a4aea95-ac69-47f6-94aa-3cc856aeb613&response=json&sessionkey=Cs8ChjFzEckNrOznBGdVPnx%2FJKU%3D&_=1385373064864 > 2013-11-25 04:51:07,272 INFO [c.c.h.v.r.VmwareResource] > (DirectAgent-8:ctx-d45c5adb) Scan hung worker VM to recycle > 2013-11-25 04:51:07,473 DEBUG [c.c.a.m.DirectAgentAttache] > (DirectAgent-8:ctx-d45c5adb) Ping from 5(10.147.40.24) > 2013-11-25 04:51:08,002 DEBUG [c.c.a.m.AgentManagerImpl] > (AgentManager-Handler-8:null) SeqA 3-1866: Processing Seq 3-1866: { Cmd , > MgmtId: -1, via: 3, Ver: v1, Flags: 11, > [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":2,"_loadInfo":"{\n > \"connections\": []\n}","wait":0}}] } > 2013-11-25 04:51:08,037 DEBUG [c.c.a.m.AgentManagerImpl] > (AgentManager-Handler-9:null) SeqA 8-1728: Processing Seq 8-1728: { Cmd , > MgmtId: -1, via: 8, Ver: v1, Flags: 11, > [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":4,"_loadInfo":"{\n > \"connections\": []\n}","wait":0}}] } > 2013-11-25 04:51:08,089 DEBUG [c.c.a.m.AgentManagerImpl] > (AgentManager-Handler-8:null) SeqA 3-1866: Sending Seq 3-1866: { Ans: , > MgmtId: 7252119388271, via: 3, Ver: v1, Flags: 100010, > [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] } > 2013-11-25 04:51:08,095 DEBUG [c.c.a.m.AgentManagerImpl] > (AgentManager-Handler-9:null) SeqA 8-1728: Sending Seq 8-1728: { Ans: , > MgmtId: 7252119388271, via: 8, Ver: v1, Flags: 100010, > [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] } > 2013-11-25 04:51:08,230 DEBUG [c.c.a.ApiServlet] > (catalina-exec-23:ctx-1e299eb4) ===START=== 10.146.0.132 -- GET > command=queryAsyncJobResult&jobId=4a4aea95-ac69-47f6-94aa-3cc856aeb613&response=json&sessionkey=Cs8ChjFzEckNrOznBGdVPnx%2FJKU%3D&_=1385373067870 > 2013-11-25 04:51:08,261 DEBUG [c.c.a.ApiServlet] > (catalina-exec-23:ctx-1e299eb4 ctx-f0fe6af4) ===END=== 10.146.0.132 -- GET > command=queryAsyncJobResult&jobId=4a4aea95-ac69-47f6-94aa-3cc856aeb613&response=json&sessionkey=Cs8ChjFzEckNrOznBGdVPnx%2FJKU%3D&_=1385373067870 > 2013-11-25 04:51:11,223 DEBUG [c.c.a.ApiServlet] > (catalina-exec-24:ctx-0eb83898) ===START=== 10.146.0.132 -- GET > command=queryAsyncJobResult&jobId=4a4aea95-ac69-47f6-94aa-3cc856aeb613&response=json&sessionkey=Cs8ChjFzEckNrOznBGdVPnx%2FJKU%3D&_=1385373070871 > 2013-11-25 04:51:11,353 DEBUG [c.c.a.ApiServlet] > (catalina-exec-24:ctx-0eb83898 ctx-e5db9deb) ===END=== 10.146.0.132 -- GET > command=queryAsyncJobResult&jobId=4a4aea95-ac69-47f6-94aa-3cc856aeb613&response=json&sessionkey=Cs8ChjFzEckNrOznBGdVPnx%2FJKU%3D&_=1385373070871 > 2013-11-25 04:51:12,756 DEBUG [c.c.h.x.r.CitrixResourceBase] > (DirectAgent-4:ctx-84beda19) 2. The VM r-6-VM is in Running state. -- This message was sent by Atlassian JIRA (v6.1.5#6160)