[ https://issues.apache.org/jira/browse/CLOUDSTACK-6084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jayapal Reddy resolved CLOUDSTACK-6084. --------------------------------------- Resolution: Cannot Reproduce Create gateway is creating in latest 4.4. So marking it as Can't reproduce > [Automation] Failed to create private gateway > --------------------------------------------- > > Key: CLOUDSTACK-6084 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-6084 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) > Components: Management Server > Affects Versions: 4.4.0 > Environment: xenserver 6.2 ,advanced zone > Reporter: Srikanteswararao Talluri > Assignee: Jayapal Reddy > Priority: Critical > Fix For: 4.4.0 > > > Steps to reproduce: > ================= > # 1) Create VPC > self.createVPC() > # 2) Create ACl > self.createACL() > # 3) Create ACl Item > self.createACLItem() > # 4) Create network with ACL > self.createNetwork() > # 5) create private gw > self.createPvtGw() > Logs can be found here : > http://jenkins.buildacloud.org/view/cloudstack-qa-master/job/test-matrix-master/3/distro=centos63,hypervisor=xen,profile=xen62/artifact/3.tar.bz2 > ===START=== 10.208.8.5 -- GET > physicalnetworkid=200&vpcid=e1f5910c-1352-4274-9326-f8413f41d4bf&sourcenatsupported=true&aclid=bdca388c-c6cf-4757-b72d-c07e22ff9fa5&vlan=30&response=json&netmask=255.255.255.0&apiKey=ZVang0oygdXeY5o3XEz4X3i60YHJj5nVE8gN6hR_zlBWzIoxby09FIxK_a-UlWl_jzLen_4I8oXgmQLppn3ikw&command=createPrivateGateway&signature=2Z89SOGldeUm9Lfg10R8rcx%2FRZ0%3D&ipaddress=10.147.30.200&gateway=10.147.30.1 > Feb 12 02:23:49 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:49,779 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-335:ctx-48012a52) Ping from 1(apache-81-3) > Feb 12 02:23:49 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:49,808 DEBUG [network.vpc.VpcManagerImpl] (catalina-exec-3:ctx-d5a8de3b > ctx-fa9b0854 ctx-5b785c5e) Creating Private gateway for VPC [VPC [6-new vpc] > Feb 12 02:23:49 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:49,808 INFO [network.vpc.VpcManagerImpl] (catalina-exec-3:ctx-d5a8de3b > ctx-fa9b0854 ctx-5b785c5e) creating new network for vpc [VPC [6-new vpc] > using broadcast uri: 30 > Feb 12 02:23:49 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:49,834 DEBUG [contrail.management.ContrailGuru] > (catalina-exec-3:ctx-d5a8de3b ctx-fa9b0854 ctx-5b785c5e) Refusing to design > this network > Feb 12 02:23:49 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:49,834 DEBUG [network.guru.MidoNetGuestNetworkGuru] > (catalina-exec-3:ctx-d5a8de3b ctx-fa9b0854 ctx-5b785c5e) design called > Feb 12 02:23:49 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:49,835 DEBUG [network.guru.MidoNetGuestNetworkGuru] > (catalina-exec-3:ctx-d5a8de3b ctx-fa9b0854 ctx-5b785c5e) Refusing to design > this network, the physical isolation type is not MIDO > Feb 12 02:23:49 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:49,835 DEBUG [network.guru.NiciraNvpGuestNetworkGuru] > (catalina-exec-3:ctx-d5a8de3b ctx-fa9b0854 ctx-5b785c5e) Refusing to design > this network > Feb 12 02:23:49 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:49,840 DEBUG [network.opendaylight.OpendaylightGuestNetworkGuru] > (catalina-exec-3:ctx-d5a8de3b ctx-fa9b0854 ctx-5b785c5e) Refusing to design > this network > Feb 12 02:23:49 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:49,841 DEBUG [network.guru.OvsGuestNetworkGuru] > (catalina-exec-3:ctx-d5a8de3b ctx-fa9b0854 ctx-5b785c5e) Refusing to design > this network > Feb 12 02:23:49 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:49,857 DEBUG [network.guru.SspGuestNetworkGuru] > (catalina-exec-3:ctx-d5a8de3b ctx-fa9b0854 ctx-5b785c5e) SSP not configured > to be active > Feb 12 02:23:49 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:49,858 DEBUG [engine.orchestration.NetworkOrchestrator] > (catalina-exec-3:ctx-d5a8de3b ctx-fa9b0854 ctx-5b785c5e) Releasing lock for > Acct[bcbb718a-93c7-11e3-af4f-b6c8db337241-system] > Feb 12 02:23:49 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:49,858 DEBUG [cloud.network.NetworkServiceImpl] > (catalina-exec-3:ctx-d5a8de3b ctx-fa9b0854 ctx-5b785c5e) Created private > network Ntwk[230|Guest|5] > Feb 12 02:23:49 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:49,864 DEBUG [cloud.network.NetworkServiceImpl] > (catalina-exec-3:ctx-d5a8de3b ctx-fa9b0854 ctx-5b785c5e) Private network > Ntwk[230|Guest|5] is created > Feb 12 02:23:49 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:49,891 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-310:ctx-dca6e64d) Ping from 2(apache-81-2) > Feb 12 02:23:49 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:49,916 DEBUG [network.vpc.VpcManagerImpl] (catalina-exec-3:ctx-d5a8de3b > ctx-fa9b0854 ctx-5b785c5e) Created vpc gateway entry > VpcGateway[1|10.147.30.200|6] > Feb 12 02:23:49 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:49,935 DEBUG [jobs.impl.AsyncJobManagerImpl] > (catalina-exec-3:ctx-d5a8de3b ctx-fa9b0854 ctx-5b785c5e) submit async > job-238, details: AsyncJobVO {id:238, userId: 2, accountId: 2, instanceType: > PrivateGateway, instanceId: 1, cmd: > org.apache.cloudstack.api.command.admin.vpc.CreatePrivateGatewayCmd, cmdInfo: > {"physicalnetworkid":"200","cmdEventType":"PRIVATE.GATEWAY.CREATE","sourcenatsupported":"true","ctxUserId":"2","gateway":"10.147.30.1","httpmethod":"GET","ipaddress":"10.147.30.200","apiKey":"... > Feb 12 02:23:49 cloudstack-centos63.fmt.vmops.com > ...ZVang0oygdXeY5o3XEz4X3i60YHJj5nVE8gN6hR_zlBWzIoxby09FIxK_a-UlWl_jzLen_4I8oXgmQLppn3ikw","netmask": > > "255.255.255.0","id":"1","response":"json","aclid":"bdca388c-c6cf-4757-b72d-c07e22ff9fa5","vlan":"30","ctxAccountId":"2","vpcid":"e1f5910c-1352-4274-9326-f8413f41d4bf","ctxStartEventId":"1232","signature":"2Z89SOGldeUm9Lfg10R8rcx/RZ0\u003d"}, > cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: > null, initMsid: 200973787296321, completeMsid: null, lastUpdated: null, > lastPolled: null, created: null} > Feb 12 02:23:49 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:49,936 DEBUG [cloud.api.ApiServlet] (catalina-exec-3:ctx-d5a8de3b > ctx-fa9b0854 ctx-5b785c5e) ===END=== 10.208.8.5 -- GET > physicalnetworkid=200&vpcid=e1f5910c-1352-4274-9326-f8413f41d4bf&sourcenatsupported=true&aclid=bdca388c-c6cf-4757-b72d-c07e22ff9fa5&vlan=30&response=json&netmask=255.255.255.0&apiKey=ZVang0oygdXeY5o3XEz4X3i60YHJj5nVE8gN6hR_zlBWzIoxby09FIxK_a-UlWl_jzLen_4I8oXgmQLppn3ikw&command=createPrivateGateway&signature=2Z89SOGldeUm9Lfg10R8rcx%2FRZ0%3D&ipaddress=10.147.30.200&gateway=10.147.30.1 > Feb 12 02:23:49 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:49,938 INFO [jobs.impl.AsyncJobMonitor] (Job-Executor-52:ctx-3e63da61) > Add job-238 into job monitoring > Feb 12 02:23:49 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:49,938 DEBUG [jobs.impl.AsyncJobManagerImpl] > (Job-Executor-52:ctx-3e63da61) Executing AsyncJobVO {id:238, userId: 2, > accountId: 2, instanceType: PrivateGateway, instanceId: 1, cmd: > org.apache.cloudstack.api.command.admin.vpc.CreatePrivateGatewayCmd, cmdInfo: > {"physicalnetworkid":"200","cmdEventType":"PRIVATE.GATEWAY.CREATE","sourcenatsupported":"true","ctxUserId":"2","gateway":"10.147.30.1","httpmethod":"GET","ipaddress":"10.147.30.200","apiKey":"ZVang0oygdXeY5o3XEz4X3i60YHJj5nVE8gN6hR_zlBWzIoxby09FIxK_a-UlWl_jzLen_4I8oXgmQLppn3ikw","netmask":"255.255.255.0","id":"1","response":"json","aclid":"bdca388c-c6cf-4757-b72d-c07e22ff9fa5","vlan":"30","ctxAccountId":"2","vpcid":"e1f5910c-1352-4274-9326-f8413f41d4bf","ctxStartEventId":"1232","signature":"2Z89SOGldeUm9Lfg10R8rcx/RZ0\u003d"}, > cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: > null, initMsid: 200973787296321, completeMsid: null, lastUpdated: null, > lastPolled: null, created: null} > Feb 12 02:23:49 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:49,943 DEBUG [cloud.api.ApiServlet] (catalina-exec-21:ctx-d956fc77) > ===START=== 10.208.8.5 -- GET > signature=CYc%2BxM97bF978PWJB8Zs%2BE71oL4%3D&apiKey=ZVang0oygdXeY5o3XEz4X3i60YHJj5nVE8gN6hR_zlBWzIoxby09FIxK_a-UlWl_jzLen_4I8oXgmQLppn3ikw&command=queryAsyncJobResult&response=json&jobid=69f9dcf4-0e6c-4bf1-81d2-bf22d60fb0f1 > Feb 12 02:23:49 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:49,963 DEBUG [cloud.api.ApiServlet] (catalina-exec-21:ctx-d956fc77 > ctx-ad7125fb ctx-5b233a47) ===END=== 10.208.8.5 -- GET > signature=CYc%2BxM97bF978PWJB8Zs%2BE71oL4%3D&apiKey=ZVang0oygdXeY5o3XEz4X3i60YHJj5nVE8gN6hR_zlBWzIoxby09FIxK_a-UlWl_jzLen_4I8oXgmQLppn3ikw&command=queryAsyncJobResult&response=json&jobid=69f9dcf4-0e6c-4bf1-81d2-bf22d60fb0f1 > Feb 12 02:23:49 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:49,980 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (Job-Executor-52:ctx-3e63da61 ctx-5b785c5e) Adding vm > VM[DomainRouter|r-63-QA] to network Ntwk[230|Guest|5]; requested nic profile > NicProfile[0-0-vlan://30-10.147.30.200-vlan://30 > Feb 12 02:23:49 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:49,988 DEBUG [engine.orchestration.NetworkOrchestrator] > (Job-Executor-52:ctx-3e63da61 ctx-5b785c5e) Allocating nic for vm > VM[DomainRouter|r-63-QA] in network Ntwk[230|Guest|5] with requested profile > NicProfile[0-0-vlan://30-10.147.30.200-vlan://30 > Feb 12 02:23:50 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:49,999 DEBUG [cloud.network.NetworkModelImpl] > (Job-Executor-52:ctx-3e63da61 ctx-5b785c5e) Service SecurityGroup is not > supported in the network id=230 > Feb 12 02:23:50 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:50,000 DEBUG [engine.orchestration.NetworkOrchestrator] > (Job-Executor-52:ctx-3e63da61 ctx-5b785c5e) Nic is allocated successfully for > vm VM[DomainRouter|r-63-QA] in network Ntwk[230|Guest|5] > Feb 12 02:23:50 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:50,001 DEBUG [engine.orchestration.NetworkOrchestrator] > (Job-Executor-52:ctx-3e63da61 ctx-5b785c5e) Network id=230 is already > implemented > Feb 12 02:23:50 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:50,006 DEBUG [cloud.network.NetworkModelImpl] > (Job-Executor-52:ctx-3e63da61 ctx-5b785c5e) Service SecurityGroup is not > supported in the network id=230 > Feb 12 02:23:50 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:50,012 DEBUG [cloud.network.NetworkModelImpl] > (Job-Executor-52:ctx-3e63da61 ctx-5b785c5e) Service SecurityGroup is not > supported in the network id=230 > Feb 12 02:23:50 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:50,012 DEBUG [engine.orchestration.NetworkOrchestrator] > (Job-Executor-52:ctx-3e63da61 ctx-5b785c5e) Nic is prepared successfully for > vm VM[DomainRouter|r-63-QA] in network Ntwk[230|Guest|5] > Feb 12 02:23:50 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:50,016 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (Job-Executor-52:ctx-3e63da61 ctx-5b785c5e) Plugging nic for vm > VM[DomainRouter|r-63-QA] in network Ntwk[230|Guest|5] > Feb 12 02:23:50 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:50,020 DEBUG [agent.transport.Request] (Job-Executor-52:ctx-3e63da61 > ctx-5b785c5e) Seq 3-27584547717644593: Sending { Cmd , MgmtId: > 200973787296321, via: 3(apache-83-1), Ver: v1, Flags: 100111, > [{"com.cloud.agent.api.PlugNicCommand":{"nic":{"deviceId":2,"networkRateMbps":200,"defaultNic":false,"uuid":"50d3e76d-3321-4dc5-91d0-9ee489a54b58","ip":"10.147.30.200","netmask":"255.255.255.0","gateway":"10.147.30.1","mac":"06:fb:a4:00:00:9a","dns1":"8.8.8.8","dns2":"8.8.8.8","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://30","isolationUri":"vlan://30","isSecurityGroupEnabled":false},"instanceName":"r-63-QA","vmType":"DomainRouter","wait":0}}] > } > Feb 12 02:23:50 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:50,020 DEBUG [agent.transport.Request] (Job-Executor-52:ctx-3e63da61 > ctx-5b785c5e) Seq 3-27584547717644593: Executing: { Cmd , MgmtId: > 200973787296321, via: 3(apache-83-1), Ver: v1, Flags: 100111, > [{"com.cloud.agent.api.PlugNicCommand":{"nic":{"deviceId":2,"networkRateMbps":200,"defaultNic":false,"uuid":"50d3e76d-3321-4dc5-91d0-9ee489a54b58","ip":"10.147.30.200","netmask":"255.255.255.0","gateway":"10.147.30.1","mac":"06:fb:a4:00:00:9a","dns1":"8.8.8.8","dns2":"8.8.8.8","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://30","isolationUri":"vlan://30","isSecurityGroupEnabled":false},"instanceName":"r-63-QA","vmType":"DomainRouter","wait":0}}] > } > Feb 12 02:23:50 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:50,021 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-40:ctx-70d7a0a9) Seq 3-27584547717644593: Executing request > Feb 12 02:23:50 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:50,039 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-40:ctx-70d7a0a9) Lowest available Vif device number: 2 for VM: > r-63-QA > Feb 12 02:23:50 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:50,039 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-40:ctx-70d7a0a9) Creating VIF for r-63-QA on nic > [Nic:Guest-10.147.30.200-vlan://30] > Feb 12 02:23:50 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:50,046 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-40:ctx-70d7a0a9) Couldn't find vlan network with the new name so > trying old name: VLAN30 > Feb 12 02:23:50 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:50,048 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-40:ctx-70d7a0a9) Creating VLAN network for 30 on host > 10.208.8.195 > Feb 12 02:23:50 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:50,058 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-40:ctx-70d7a0a9) Creating VLAN 30 on host 10.208.8.195 on device > eth0 > Feb 12 02:23:50 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:50,106 DEBUG [resource.virtualnetwork.VirtualRoutingResource] > (DirectAgent-312:ctx-54a0cd28) JSON > IS:{"10.1.1.250":[["userdata","user-data",null],["metadata","service-offering","Tiny > > Instance"],["metadata","availability-zone","z0"],["metadata","local-ipv4","10.1.1.250"],["metadata","local-hostname","QA-a9c7a9de-b2ba-46a1-990c-7cd3c95dabac"],["metadata","public-ipv4","10.208.10.23"],["metadata","public-hostname","10.208.10.23"],["metadata","instance-id","a9c7a9de-b2ba-46a1-990c-7cd3c95dabac"],["metadata","vm-id","a9c7a9de-b2ba-46a1-990c-7cd3c95dabac"],["metadata","public-keys",null],["metadata","cloud-identifier","CloudStack-{c80057ec-fa44-47a8-bf6c-12f3cfd332ab}"]]} > Feb 12 02:23:50 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:50,277 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-40:ctx-70d7a0a9) VLAN is created for 30. The uuid is > c5f19928-d21b-1c52-3dcc-10429786dc0b > Feb 12 02:23:50 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:50,286 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-40:ctx-70d7a0a9) Created a vif > dab41a97-51dd-7df0-df47-038af39b9bb5 on 2 > Feb 12 02:23:50 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:50,440 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-312:ctx-54a0cd28) Seq 1-7242632625741889746: Response Received: > Feb 12 02:23:50 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:50,441 DEBUG [agent.transport.Request] (DirectAgent-312:ctx-54a0cd28) > Seq 1-7242632625741889746: Processing: { Ans: , MgmtId: 200973787296321, > via: 1, Ver: v1, Flags: 10, > [{"com.cloud.agent.api.Answer":{"result":true,"details":"","wait":0}},{"com.cloud.agent.api.Answer":{"result":true,"details":"","wait":0}}] > } > Feb 12 02:23:50 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:50,441 DEBUG [agent.transport.Request] (Job-Executor-47:ctx-6430e5c2 > ctx-8a91378b) Seq 1-7242632625741889746: Received: { Ans: , MgmtId: > 200973787296321, via: 1, Ver: v1, Flags: 10, { Answer, Answer } } > Feb 12 02:23:50 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:50,442 DEBUG [cloud.network.NetworkModelImpl] > (Job-Executor-47:ctx-6430e5c2 ctx-8a91378b) Service SecurityGroup is not > supported in the network id=228 > Feb 12 02:23:50 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:50,443 DEBUG [engine.orchestration.VolumeOrchestrator] > (Job-Executor-47:ctx-6430e5c2 ctx-8a91378b) Checking if we need to prepare 1 > volumes for VM[User|QA-a9c7a9de-b2ba-46a1-990c-7cd3c95dabac] > Feb 12 02:23:50 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:50,450 DEBUG [storage.image.TemplateDataFactoryImpl] > (Job-Executor-47:ctx-6430e5c2 ctx-8a91378b) template 5 is already in store:1, > type:Image > Feb 12 02:23:50 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:50,453 DEBUG [storage.image.TemplateDataFactoryImpl] > (Job-Executor-47:ctx-6430e5c2 ctx-8a91378b) template 5 is already in store:3, > type:Primary > Feb 12 02:23:50 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:50,470 DEBUG [storage.motion.AncientDataMotionStrategy] > (Job-Executor-47:ctx-6430e5c2 ctx-8a91378b) copyAsync inspecting src type > TEMPLATE copyAsync inspecting dest type VOLUME > Feb 12 02:23:50 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:50,478 DEBUG [agent.transport.Request] (Job-Executor-47:ctx-6430e5c2 > ctx-8a91378b) Seq 3-27584547717644594: Sending { Cmd , MgmtId: > 200973787296321, via: 3(apache-83-1), Ver: v1, Flags: 100011, > [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"2072379e-c85e-4713-8f0f-da350c557613","origUrl":"http://nfs/templates/builtin/centos56-x86_64.vhd.bz2","uuid":"5","id":5,"format":"VHD","accountId":1,"checksum":"778e2541209c927628d433ee2900707b","hvm":false,"displayText":"CentOS > 5.6(64-bit) no GUI > (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"21ce6784-c950-3f15-a29b-8da8bd65bfe7","id":3,"poolType":"NetworkFilesystem","host":"nfs.fmt.vmops.com","path":"/export/automation/acs/primary2","port":2049,"url":"NetworkFilesystem://nfs.... > Feb 12 02:23:50 cloudstack-centos63.fmt.vmops.com > ...fmt.vmops.com/export/automation/acs/primary2/?ROLE=Primary&STOREUUID=21ce6784-c950-3f15-a29b-8da8bd65bfe7"}},"name": > > "centos56-x86_64-xen","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"bc264695-a209-4bda-8b33-ee2afad96990","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"21ce6784-c950-3f15-a29b-8da8bd65bfe7","id":3,"poolType":"NetworkFilesystem","host":"nfs.fmt.vmops.com","path":"/export/automation/acs/primary2","port":2049,"url":"NetworkFilesystem://nfs.fmt.vmops.com/export/automation/acs/primary2/?ROLE=Primary&STOREUUID=21ce6784-c950-3f15-a29b-8da8bd65bfe7"}},"name":"ROOT-61","size":21474836480,"volumeId":66,"vmName":"i-30-61-QA","accountId":30,"format":"VHD","id":66,"deviceId":0,"hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":0}}] > } > Feb 12 02:23:50 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:50,478 DEBUG [agent.transport.Request] (Job-Executor-47:ctx-6430e5c2 > ctx-8a91378b) Seq 3-27584547717644594: Executing: { Cmd , MgmtId: > 200973787296321, via: 3(apache-83-1), Ver: v1, Flags: 100011, > [{"org.apache.cloudstack.storage.command.CopyCommand":{"srcTO":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"path":"2072379e-c85e-4713-8f0f-da350c557613","origUrl":"http://nfs/templates/builtin/centos56-x86_64.vhd.bz2","uuid":"5","id":5,"format":"VHD","accountId":1,"checksum":"778e2541209c927628d433ee2900707b","hvm":false,"displayText":"CentOS > 5.6(64-bit) no GUI > (XenServer)","imageDataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"21ce6784-c950-3f15-a29b-8da8bd65bfe7","id":3,"poolType":"NetworkFilesystem","host":"nfs.fmt.vmops.com","path":"/export/automation/acs/primary2","port":2049,"url":"NetworkFilesystem://nfs... > Feb 12 02:23:50 cloudstack-centos63.fmt.vmops.com > ....fmt.vmops.com/export/automation/acs/primary2/?ROLE=Primary&STOREUUID=21ce6784-c950-3f15-a29b-8da8bd65bfe7"}},"name": > > "centos56-x86_64-xen","hypervisorType":"XenServer"}},"destTO":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"bc264695-a209-4bda-8b33-ee2afad96990","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"21ce6784-c950-3f15-a29b-8da8bd65bfe7","id":3,"poolType":"NetworkFilesystem","host":"nfs.fmt.vmops.com","path":"/export/automation/acs/primary2","port":2049,"url":"NetworkFilesystem://nfs.fmt.vmops.com/export/automation/acs/primary2/?ROLE=Primary&STOREUUID=21ce6784-c950-3f15-a29b-8da8bd65bfe7"}},"name":"ROOT-61","size":21474836480,"volumeId":66,"vmName":"i-30-61-QA","accountId":30,"format":"VHD","id":66,"deviceId":0,"hypervisorType":"XenServer"}},"executeInSequence":false,"options":{},"wait":0}}] > } > Feb 12 02:23:50 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:50,479 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-63:ctx-7056fa7d) Seq 3-27584547717644594: Executing request > Feb 12 02:23:50 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:50,519 DEBUG [cloud.api.ApiServlet] (catalina-exec-23:ctx-1791f16d) > ===START=== 10.208.8.5 -- GET > signature=Y3v82oQASrrvuBoAnlguU7Nwlek%3D&apiKey=ZVang0oygdXeY5o3XEz4X3i60YHJj5nVE8gN6hR_zlBWzIoxby09FIxK_a-UlWl_jzLen_4I8oXgmQLppn3ikw&command=queryAsyncJobResult&response=json&jobid=c8cea0d6-4cbd-411b-8f39-1ac10be3a092 > Feb 12 02:23:50 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:50,533 DEBUG [cloud.api.ApiServlet] (catalina-exec-23:ctx-1791f16d > ctx-12ffec14 ctx-fe8f8476) ===END=== 10.208.8.5 -- GET > signature=Y3v82oQASrrvuBoAnlguU7Nwlek%3D&apiKey=ZVang0oygdXeY5o3XEz4X3i60YHJj5nVE8gN6hR_zlBWzIoxby09FIxK_a-UlWl_jzLen_4I8oXgmQLppn3ikw&command=queryAsyncJobResult&response=json&jobid=c8cea0d6-4cbd-411b-8f39-1ac10be3a092 > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,112 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-40:ctx-70d7a0a9) Seq 3-27584547717644593: Response Received: > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,112 DEBUG [agent.transport.Request] (DirectAgent-40:ctx-70d7a0a9) > Seq 3-27584547717644593: Processing: { Ans: , MgmtId: 200973787296321, via: > 3, Ver: v1, Flags: 110, > [{"com.cloud.agent.api.PlugNicAnswer":{"result":true,"details":"success","wait":0}}] > } > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,113 DEBUG [agent.transport.Request] (Job-Executor-52:ctx-3e63da61 > ctx-5b785c5e) Seq 3-27584547717644593: Received: { Ans: , MgmtId: > 200973787296321, via: 3, Ver: v1, Flags: 110, { PlugNicAnswer } } > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,113 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (Job-Executor-52:ctx-3e63da61 ctx-5b785c5e) Nic is plugged successfully for > vm VM[DomainRouter|r-63-QA] in network Ntwk[230|Guest|5]. Vm is a part of > network now > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,115 DEBUG [agent.manager.AgentAttache] (DirectAgent-40:ctx-70d7a0a9) > Seq 3-27584547717644593: No more commands found > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,125 DEBUG [xen.resource.XenServerStorageProcessor] > (DirectAgent-63:ctx-7056fa7d) Succesfully created VDI: Uuid = > 9873cecc-418b-414a-a58f-c2d6a3bdf932 > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,125 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-63:ctx-7056fa7d) Seq 3-27584547717644594: Response Received: > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,126 DEBUG [agent.transport.Request] (DirectAgent-63:ctx-7056fa7d) > Seq 3-27584547717644594: Processing: { Ans: , MgmtId: 200973787296321, via: > 3, Ver: v1, Flags: 10, > [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"newData":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"name":"ROOT-61","size":21474836480,"path":"9873cecc-418b-414a-a58f-c2d6a3bdf932","accountId":0,"id":0}},"result":true,"wait":0}}] > } > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,130 DEBUG [agent.transport.Request] (Job-Executor-47:ctx-6430e5c2 > ctx-8a91378b) Seq 3-27584547717644594: Received: { Ans: , MgmtId: > 200973787296321, via: 3, Ver: v1, Flags: 10, { CopyCmdAnswer } } > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,139 DEBUG [agent.transport.Request] (Job-Executor-52:ctx-3e63da61 > ctx-5b785c5e) Seq 3-27584547717644595: Sending { Cmd , MgmtId: > 200973787296321, via: 3(apache-83-1), Ver: v1, Flags: 100011, > [{"com.cloud.agent.api.routing.IpAssocVpcCommand":{"ipAddresses":[{"accountId":1,"publicIp":"10.147.30.200","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"broadcastUri":"vlan://30","vlanGateway":"10.147.30.1","vlanNetmask":"255.255.255.0","vifMacAddress":"06:fb:a4:00:00:9a","trafficType":"Guest","newNic":false}],"accessDetails":{"zone.network.type":"Advanced","router.name":"r-63-QA","router.ip":"169.254.1.152","router.guest.ip":"10.147.30.200"},"wait":0}}] > } > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,140 DEBUG [agent.transport.Request] (Job-Executor-52:ctx-3e63da61 > ctx-5b785c5e) Seq 3-27584547717644595: Executing: { Cmd , MgmtId: > 200973787296321, via: 3(apache-83-1), Ver: v1, Flags: 100011, > [{"com.cloud.agent.api.routing.IpAssocVpcCommand":{"ipAddresses":[{"accountId":1,"publicIp":"10.147.30.200","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"broadcastUri":"vlan://30","vlanGateway":"10.147.30.1","vlanNetmask":"255.255.255.0","vifMacAddress":"06:fb:a4:00:00:9a","trafficType":"Guest","newNic":false}],"accessDetails":{"zone.network.type":"Advanced","router.name":"r-63-QA","router.ip":"169.254.1.152","router.guest.ip":"10.147.30.200"},"wait":0}}] > } > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,144 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-328:ctx-b9c15854) Seq 3-27584547717644595: Executing request > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,191 DEBUG [cloud.api.ApiServlet] (catalina-exec-7:ctx-9be9f554) > ===START=== 10.208.8.5 -- GET > signature=9FMtvc3NSfAdNDJ0xR1zlK%2B%2BiFw%3D&apiKey=ZVang0oygdXeY5o3XEz4X3i60YHJj5nVE8gN6hR_zlBWzIoxby09FIxK_a-UlWl_jzLen_4I8oXgmQLppn3ikw&command=queryAsyncJobResult&response=json&jobid=bcfc203e-651e-4b89-89b3-e7809fa6d7fc > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,208 DEBUG [agent.transport.Request] (Job-Executor-47:ctx-6430e5c2 > ctx-8a91378b) Seq 3-27584547717644596: Sending { Cmd , MgmtId: > 200973787296321, via: 3(apache-83-1), Ver: v1, Flags: 100011, > [{"com.cloud.agent.api.StartCommand":{"vm":{"id":61,"name":"i-30-61-QA","bootloader":"PyGrub","type":"User","cpus":1,"minSpeed":200,"maxSpeed":200,"minRam":268435456,"maxRam":268435456,"arch":"x86_64","os":"CentOS > 5.6 > (64-bit)","bootArgs":"","rebootOnCrash":false,"enableHA":false,"limitCpuUse":false,"enable... > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com ...DynamicallyScaleVm": > true,"vncPassword":"71da317e3ed8da48","params":{},"uuid":"a9c7a9de-b2ba-46a1-990c-7cd3c95dabac","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"bc264695-a209-4bda-8b33-ee2afad96990","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"21ce6784-c950-3f15-a29b-8da8bd65bfe7","id":3,"poolType":"NetworkFilesystem","host":"nfs.fmt.vmops.com","path":"/export/automation/acs/primary2","port":2049,"url":"NetworkFilesystem://nfs.fmt.vmops.... > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com > ...com/export/automation/acs/primary2/?ROLE=Primary&STOREUUID=21ce6784-c950-3f15-a29b-8da8bd65bfe7"}},"name": > > "ROOT-61","size":21474836480,"path":"9873cecc-418b-414a-a58f-c2d6a3bdf932","volumeId":66,"vmName":"i-30-61-QA","accountId":30,"format":"VHD","id":66,"deviceId":0,"hypervisorType":"XenServer"}},"diskSeq":0,"path":"9873cecc-418b-414a-a58f-c2d6a3bdf932","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"nfs.fmt.vmops.com","volumeSize":"21474836480"}},{"data":{"org.apache.cloudstack.storage... > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com ....to.TemplateObjectTO": > {"id":0,"format":"ISO","accountId":0,"hvm":false}},"diskSeq":3,"type":"ISO"}],"nics":[{"deviceId":0,"networkRateMbps":200,"defaultNic":true,"uuid":"a366b8b0-93ad-4dbc-a927-c45b423ba8b3","ip":"10.1.1.250","netmask":"255.255.255.0","gateway":"10.1.1.1","mac":"02:00:62:e7:00:01","dns1":"8.8.8.8","dns2":"8.8.8.8","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://2007","isolationUri":"vlan://2007","isSecurityGroupEnabled":false}]},"hostIp":"10.208.8.195","executeInSequence":false,"wait":0}}] > } > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,209 DEBUG [agent.transport.Request] (Job-Executor-47:ctx-6430e5c2 > ctx-8a91378b) Seq 3-27584547717644596: Executing: { Cmd , MgmtId: > 200973787296321, via: 3(apache-83-1), Ver: v1, Flags: 100011, > [{"com.cloud.agent.api.StartCommand":{"vm":{"id":61,"name":"i-30-61-QA","bootloader":"PyGrub","type":"User","cpus":1,"minSpeed":200,"maxSpeed":200,"minRam":268435456,"maxRam":268435456,"arch":"x86_64","os":"CentOS > 5.6 > (64-bit)","bootArgs":"","rebootOnCrash":false,"enableHA":false,"limitCpuUse":false,"ena... > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com ...bleDynamicallyScaleVm": > true,"vncPassword":"71da317e3ed8da48","params":{},"uuid":"a9c7a9de-b2ba-46a1-990c-7cd3c95dabac","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"bc264695-a209-4bda-8b33-ee2afad96990","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"21ce6784-c950-3f15-a29b-8da8bd65bfe7","id":3,"poolType":"NetworkFilesystem","host":"nfs.fmt.vmops.com","path":"/export/automation/acs/primary2","port":2049,"url":"NetworkFilesystem://nfs.fmt.vmop... > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com > ...s.com/export/automation/acs/primary2/?ROLE=Primary&STOREUUID=21ce6784-c950-3f15-a29b-8da8bd65bfe7"}},"name": > > "ROOT-61","size":21474836480,"path":"9873cecc-418b-414a-a58f-c2d6a3bdf932","volumeId":66,"vmName":"i-30-61-QA","accountId":30,"format":"VHD","id":66,"deviceId":0,"hypervisorType":"XenServer"}},"diskSeq":0,"path":"9873cecc-418b-414a-a58f-c2d6a3bdf932","type":"ROOT","_details":{"managed":"false","storagePort":"2049","storageHost":"nfs.fmt.vmops.com","volumeSize":"21474836480"}},{"data":{"org.apache.cloudstack.storag... > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com ...e.to.TemplateObjectTO": > {"id":0,"format":"ISO","accountId":0,"hvm":false}},"diskSeq":3,"type":"ISO"}],"nics":[{"deviceId":0,"networkRateMbps":200,"defaultNic":true,"uuid":"a366b8b0-93ad-4dbc-a927-c45b423ba8b3","ip":"10.1.1.250","netmask":"255.255.255.0","gateway":"10.1.1.1","mac":"02:00:62:e7:00:01","dns1":"8.8.8.8","dns2":"8.8.8.8","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://2007","isolationUri":"vlan://2007","isSecurityGroupEnabled":false}]},"hostIp":"10.208.8.195","executeInSequence":false,"wait":0}}] > } > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,212 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-331:ctx-f169d18f) Seq 3-27584547717644596: Executing request > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,218 DEBUG [cloud.api.ApiServlet] (catalina-exec-7:ctx-9be9f554 > ctx-c8580ad7 ctx-45e03716) ===END=== 10.208.8.5 -- GET > signature=9FMtvc3NSfAdNDJ0xR1zlK%2B%2BiFw%3D&apiKey=ZVang0oygdXeY5o3XEz4X3i60YHJj5nVE8gN6hR_zlBWzIoxby09FIxK_a-UlWl_jzLen_4I8oXgmQLppn3ikw&command=queryAsyncJobResult&response=json&jobid=bcfc203e-651e-4b89-89b3-e7809fa6d7fc > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,219 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-331:ctx-f169d18f) 1. The VM i-30-61-QA is in Starting state. > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,231 WARN [xen.resource.XenServer620Resource] > (DirectAgent-331:ctx-f169d18f) Vm is set to dynamixMin 268435456 less than > the recommended static min 536870912, could lead to stability issues > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,242 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-331:ctx-f169d18f) Created VM > ecbbd81f-32b1-bced-8bfa-b54796938aaf for i-30-61-QA > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,261 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-331:ctx-f169d18f) VBD 0c7456e8-485b-acf4-f4d5-798892073366 > created for com.cloud.agent.api.to.DiskTO@52de543d > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,268 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-331:ctx-f169d18f) VBD f1cacd44-7e0a-8289-2eb2-6c154d4bf068 > created for com.cloud.agent.api.to.DiskTO@26c9b4c > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,268 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-331:ctx-f169d18f) Creating VIF for i-30-61-QA on nic > [Nic:Guest-10.1.1.250-vlan://2007] > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,276 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-331:ctx-f169d18f) Couldn't find vlan network with the new name > so trying old name: VLAN2007 > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,277 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-331:ctx-f169d18f) Creating VLAN network for 2007 on host > 10.208.8.195 > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,287 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-331:ctx-f169d18f) Creating VLAN 2007 on host 10.208.8.195 on > device eth0 > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,545 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-331:ctx-f169d18f) VLAN is created for 2007. The uuid is > d1b1e3c1-65d6-7202-4991-98ea7661464b > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,549 DEBUG [cloud.server.StatsCollector] > (StatsCollector-3:ctx-36d4da59) AutoScaling Monitor is running... > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,553 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-331:ctx-f169d18f) Created a vif > 003bfdd7-5dd4-1071-9fe3-fb6eb7637f7f on 0 > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,564 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-228:ctx-29336423) Seq 2-4427038433705197574: Executing request > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,576 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-228:ctx-29336423) Seq 2-4427038433705197574: Response Received: > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,577 DEBUG [agent.transport.Request] (DirectAgent-228:ctx-29336423) > Seq 2-4427038433705197574: Processing: { Ans: , MgmtId: 200973787296321, > via: 2, Ver: v1, Flags: 10, > [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] } > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,984 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-328:ctx-b9c15854) Seq 3-27584547717644595: Response Received: > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,985 DEBUG [agent.transport.Request] (DirectAgent-328:ctx-b9c15854) > Seq 3-27584547717644595: Processing: { Ans: , MgmtId: 200973787296321, via: > 3, Ver: v1, Flags: 10, > [{"com.cloud.agent.api.routing.IpAssocAnswer":{"results":["10.147.30.200 - > vpc_privateGateway failed:"],"result":true,"wait":0}}] } > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,985 DEBUG [agent.transport.Request] (Job-Executor-52:ctx-3e63da61 > ctx-5b785c5e) Seq 3-27584547717644595: Received: { Ans: , MgmtId: > 200973787296321, via: 3, Ver: v1, Flags: 10, { IpAssocAnswer } } > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,985 DEBUG [network.router.VpcVirtualNetworkApplianceManagerImpl] > (Job-Executor-52:ctx-3e63da61 ctx-5b785c5e) Successfully applied ip > association for ip com.cloud.network.vpc.PrivateIpAddress@2f1aea5 in vpc > network Ntwk[230|Guest|5] > Feb 12 02:23:51 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,990 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] > (Job-Executor-52:ctx-3e63da61 ctx-5b785c5e) Applying network acls in network > Ntwk[230|Guest|5] > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:51,999 DEBUG [cloud.network.NetworkModelImpl] > (Job-Executor-52:ctx-3e63da61 ctx-5b785c5e) Service SecurityGroup is not > supported in the network id=230 > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,003 DEBUG [agent.transport.Request] (Job-Executor-52:ctx-3e63da61 > ctx-5b785c5e) Seq 3-27584547717644597: Sending { Cmd , MgmtId: > 200973787296321, via: 3(apache-83-1), Ver: v1, Flags: 100001, > [{"com.cloud.agent.api.routing.SetNetworkACLCommand":{"rules":[{"id":0,"vlanTag":"30","protocol":"tcp","revoked":false,"alreadyAdded":true,"cidrList":["0.0.0.0/0"],"trafficType":"Ingress","action":"DROP","number":10}],"nic":{"deviceId":2,"networkRateMbps":200,"defaultNic":false,"uuid":"50d3e76d-3321-4dc5-91d0-9ee489a54b58","ip":"10.147.30.200","netmask":"255.255.255.0","gateway":"10.147.30.1","mac":"06:fb:a4:00:00:9a","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://30","isolationUri":"vlan://30","isSecurityGroupEnabled":false},"accessDetails":{"router.guest.ip":"10.147.30.200","guest.vlan.tag":"30","zone.network.type":"Advanced","vpc.gateway.private":"Private","router.ip":"169.254.1.152","router.name":"r-63-QA"},"wait":0}}] > } > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,004 DEBUG [agent.transport.Request] (Job-Executor-52:ctx-3e63da61 > ctx-5b785c5e) Seq 3-27584547717644597: Executing: { Cmd , MgmtId: > 200973787296321, via: 3(apache-83-1), Ver: v1, Flags: 100001, > [{"com.cloud.agent.api.routing.SetNetworkACLCommand":{"rules":[{"id":0,"vlanTag":"30","protocol":"tcp","revoked":false,"alreadyAdded":true,"cidrList":["0.0.0.0/0"],"trafficType":"Ingress","action":"DROP","number":10}],"nic":{"deviceId":2,"networkRateMbps":200,"defaultNic":false,"uuid":"50d3e76d-3321-4dc5-91d0-9ee489a54b58","ip":"10.147.30.200","netmask":"255.255.255.0","gateway":"10.147.30.1","mac":"06:fb:a4:00:00:9a","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://30","isolationUri":"vlan://30","isSecurityGroupEnabled":false},"accessDetails":{"router.guest.ip":"10.147.30.200","guest.vlan.tag":"30","zone.network.type":"Advanced","vpc.gateway.private":"Private","router.ip":"169.254.1.152","router.name":"r-63-QA"},"wait":0}}] > } > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,007 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-207:ctx-7da786b2) Seq 3-27584547717644597: Executing request > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,057 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-205:ctx-3515564e) Seq 1-7242632625741889544: Executing request > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,066 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-108:ctx-0ce0c972) Seq 3-27584547717644295: Executing request > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,253 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-205:ctx-3515564e) VM missing i-27-56-QA old state stopped so > removing. > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,254 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-205:ctx-3515564e) VM missing i-27-55-QA old state stopped so > removing. > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,254 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-205:ctx-3515564e) Seq 1-7242632625741889544: Response Received: > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,254 DEBUG [agent.transport.Request] (DirectAgent-205:ctx-3515564e) > Seq 1-7242632625741889544: Processing: { Ans: , MgmtId: 200973787296321, > via: 1, Ver: v1, Flags: 10, > [{"com.cloud.agent.api.ClusterSyncAnswer":{"_clusterId":1,"_newStates":{},"_isExecuted":false,"result":true,"wait":0}}] > } > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,308 WARN [xen.resource.CitrixResourceBase] > (DirectAgent-108:ctx-0ce0c972) Detecting a change in platform for r-63-QA > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,308 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-108:ctx-0ce0c972) 11. The VM r-63-QA is in Running state > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,308 WARN [xen.resource.CitrixResourceBase] > (DirectAgent-108:ctx-0ce0c972) Detecting a change in platform for i-27-57-QA > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,308 DEBUG [xen.resource.CitrixResourceBase] > (DirectAgent-108:ctx-0ce0c972) 11. The VM i-27-57-QA is in Running state > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,308 WARN [xen.resource.CitrixResourceBase] > (DirectAgent-108:ctx-0ce0c972) Ignoring VM i-30-61-QA in transition state > starting. > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,309 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-108:ctx-0ce0c972) Seq 3-27584547717644295: Response Received: > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,309 DEBUG [agent.transport.Request] (DirectAgent-108:ctx-0ce0c972) > Seq 3-27584547717644295: Processing: { Ans: , MgmtId: 200973787296321, via: > 3, Ver: v1, Flags: 10, > [{"com.cloud.agent.api.ClusterSyncAnswer":{"_clusterId":2,"_newStates":{"r-63-QA":{"t":"0aef0e10-86b6-40d5-ac22-db3a368fddc3","u":"Running","v":"viridian:true;acpi:1;apic:true;pae:true;nx:true"},"i-27-57-QA":{"t":"0aef0e10-86b6-40d5-ac22-db3a368fddc3","u":"Running","v":"viridian:true;acpi:1;apic:true;pae:true;nx:true"}},"_isExecuted":false,"result":true,"wait":0}}] > } > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,314 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (DirectAgent-108:ctx-0ce0c972) VM i-27-57-QA: cs state = Stopping and > realState = Running > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,314 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (DirectAgent-108:ctx-0ce0c972) VM i-27-57-QA: cs state = Stopping and > realState = Running > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,319 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (DirectAgent-108:ctx-0ce0c972) server VM state Stopping does not meet > expectation of a running VM report from agent > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,320 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (DirectAgent-108:ctx-0ce0c972) VM r-63-QA: cs state = Running and realState = > Running > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,320 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (DirectAgent-108:ctx-0ce0c972) VM r-63-QA: cs state = Running and realState = > Running > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,320 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (DirectAgent-108:ctx-0ce0c972) Both states are Running for > VM[DomainRouter|r-63-QA] > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,321 DEBUG [cloud.capacity.CapacityManagerImpl] > (DirectAgent-108:ctx-0ce0c972) VM state transitted from :Running to Running > with event: AgentReportRunningvm's original host id: 3 new host id: 3 host id > before state transition: 3 > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,346 WARN [xen.resource.CitrixResourceBase] > (DirectAgent-207:ctx-7da786b2) callHostPlugin failed for cmd: routerProxy > with args args: vpc_privategw_acl.sh 169.254.1.152 -d eth2 -M > 06:fb:a4:00:00:9a -a Ingress:tcp:0:0:0.0.0.0/0:DROP:,, due to There was a > failure communicating with the plugin. > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,346 ERROR [resource.virtualnetwork.VirtualRoutingResource] > (DirectAgent-207:ctx-7da786b2) SetNetworkACL failed due to > com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed for > cmd: routerProxy with args args: vpc_privategw_acl.sh 169.254.1.152 -d eth2 > -M 06:fb:a4:00:00:9a -a Ingress:tcp:0:0:0.0.0.0/0:DROP:,, due to There was a > failure communicating with the plugin. > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com > com.cloud.utils.exception.CloudRuntimeException: callHostPlugin failed for > cmd: routerProxy with args args: vpc_privategw_acl.sh 169.254.1.152 -d eth2 > -M 06:fb:a4:00:00:9a -a Ingress:tcp:0:0:0.0.0.0/0:DROP:,, due to There was a > failure communicating with the plugin. > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com at > com.cloud.hypervisor.xen.resource.CitrixResourceBase.callHostPlugin(CitrixResourceBase.java:3699) > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com at > com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeInVR(CitrixResourceBase.java:536) > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com at > com.cloud.agent.resource.virtualnetwork.VirtualRoutingResource.execute(VirtualRoutingResource.java:690) > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com at > com.cloud.agent.resource.virtualnetwork.VirtualRoutingResource.executeRequest(VirtualRoutingResource.java:155) > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com at > com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:415) > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com at > com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59) > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com at > com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:107) > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com at > com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:218) > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com at > org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49) > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com at > org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46) > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com at > java.util.concurrent.FutureTask.run(FutureTask.java:262) > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com at > java.lang.Thread.run(Thread.java:744) > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,347 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-207:ctx-7da786b2) Seq 3-27584547717644597: Response Received: > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,347 DEBUG [agent.transport.Request] (DirectAgent-207:ctx-7da786b2) > Seq 3-27584547717644597: Processing: { Ans: , MgmtId: 200973787296321, via: > 3, Ver: v1, Flags: 0, > [{"com.cloud.agent.api.routing.SetNetworkACLAnswer":{"results":[null],"result":false,"wait":0}}] > } > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,347 DEBUG [agent.transport.Request] (Job-Executor-52:ctx-3e63da61 > ctx-5b785c5e) Seq 3-27584547717644597: Received: { Ans: , MgmtId: > 200973787296321, via: 3, Ver: v1, Flags: 0, { SetNetworkACLAnswer } } > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,347 DEBUG [network.element.VpcVirtualRouterElement] > (Job-Executor-52:ctx-3e63da61 ctx-5b785c5e) Failed to apply network acl id 4 > on gateway > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,347 DEBUG [contrail.management.ContrailElement] > (Job-Executor-52:ctx-3e63da61 ctx-5b785c5e) NetworkElement > createPrivateGateway > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,347 WARN [network.vpc.VpcManagerImpl] (Job-Executor-52:ctx-3e63da61 > ctx-5b785c5e) Private gateway > com.cloud.network.vpc.PrivateGatewayProfile@65bd41dc failed to apply on the > backend > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,347 DEBUG [network.vpc.VpcManagerImpl] (Job-Executor-52:ctx-3e63da61 > ctx-5b785c5e) Destroying private gateway VpcGateway[1|10.147.30.200|6] that > failed to start > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,352 DEBUG [network.vpc.VpcManagerImpl] (Job-Executor-52:ctx-3e63da61 > ctx-5b785c5e) Deleted private ip > com.cloud.network.vpc.PrivateIpVO$$EnhancerByCGLIB$$80275e@76aec34d > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,355 DEBUG [engine.orchestration.NetworkOrchestrator] > (Job-Executor-52:ctx-3e63da61 ctx-5b785c5e) Network is not implemented: > Ntwk[230|Guest|5] > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,356 DEBUG [network.rules.RulesManagerImpl] > (Job-Executor-52:ctx-3e63da61 ctx-5b785c5e) Releasing 0 port forwarding rules > for network id=230 > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,357 DEBUG [network.rules.RulesManagerImpl] > (Job-Executor-52:ctx-3e63da61 ctx-5b785c5e) Releasing 0 static nat rules for > network id=230 > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,357 DEBUG [network.rules.RulesManagerImpl] > (Job-Executor-52:ctx-3e63da61 ctx-5b785c5e) There are no port forwarding > rules to apply for network id=230 > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,357 DEBUG [network.rules.RulesManagerImpl] > (Job-Executor-52:ctx-3e63da61 ctx-5b785c5e) There are no static nat rules to > apply for network id=230 > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,358 DEBUG [network.rules.RulesManagerImpl] > (Job-Executor-52:ctx-3e63da61 ctx-5b785c5e) Successfully released rules for > network id=230 and # of rules now = 0 > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,358 DEBUG [engine.orchestration.NetworkOrchestrator] > (Job-Executor-52:ctx-3e63da61 ctx-5b785c5e) Successfully cleaned up > portForwarding/staticNat rules for network id=230 > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,359 DEBUG [network.lb.LoadBalancingRulesManagerImpl] > (Job-Executor-52:ctx-3e63da61 ctx-5b785c5e) Found 0 lb rules to cleanup > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,359 DEBUG [engine.orchestration.NetworkOrchestrator] > (Job-Executor-52:ctx-3e63da61 ctx-5b785c5e) Successfully cleaned up load > balancing rules for network id=230 > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,363 DEBUG [network.firewall.FirewallManagerImpl] > (Job-Executor-52:ctx-3e63da61 ctx-5b785c5e) Releasing 0 firewall rules for > network id=230 > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,363 DEBUG [network.firewall.FirewallManagerImpl] > (Job-Executor-52:ctx-3e63da61 ctx-5b785c5e) There are no firewall rules to > apply > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,364 DEBUG [network.firewall.FirewallManagerImpl] > (Job-Executor-52:ctx-3e63da61 ctx-5b785c5e) Successfully released firewall > rules for network id=230 and # of rules now = 0 > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,365 DEBUG [engine.orchestration.NetworkOrchestrator] > (Job-Executor-52:ctx-3e63da61 ctx-5b785c5e) Successfully cleaned up > firewallRules rules for network id=230 > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,366 DEBUG [engine.orchestration.NetworkOrchestrator] > (Job-Executor-52:ctx-3e63da61 ctx-5b785c5e) Successfully cleaned up > NetworkACLs for network id=230 > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,367 DEBUG [engine.orchestration.NetworkOrchestrator] > (Job-Executor-52:ctx-3e63da61 ctx-5b785c5e) Network id=230 is destroyed > successfully, cleaning up corresponding resources now. > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,369 DEBUG [engine.orchestration.NetworkOrchestrator] > (Job-Executor-52:ctx-3e63da61 ctx-5b785c5e) Deleted ip range for private > network id=230 > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,372 DEBUG [network.vpc.VpcManagerImpl] (Job-Executor-52:ctx-3e63da61 > ctx-5b785c5e) Deleted private network id=230 > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,373 DEBUG [network.vpc.VpcManagerImpl] (Job-Executor-52:ctx-3e63da61 > ctx-5b785c5e) Deleted private gateway > com.cloud.network.vpc.PrivateGatewayProfile@42e21748 > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,375 WARN [network.vpc.VpcManagerImpl] (Job-Executor-52:ctx-3e63da61 > ctx-5b785c5e) Successfully destroyed vpc VpcGateway[1|10.147.30.200|6] that > failed to start > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,376 DEBUG [jobs.impl.AsyncJobManagerImpl] > (Job-Executor-52:ctx-3e63da61) Complete async job-238, jobStatus: FAILED, > resultCode: 530, result: > org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Failed > to create private gateway"} > Feb 12 02:23:52 cloudstack-centos63.fmt.vmops.com local0: 2014-02-12 > 10:23:52,381 DEBUG [jobs.impl.AsyncJobManagerImpl] > (Job-Executor-52:ctx-3e63da61) Done executing > org.apache.cloudstack.api.command.admin.vpc.CreatePrivateGatewayCmd for > job-238 -- This message was sent by Atlassian JIRA (v6.2#6252)