Hi,
I'm carrying out my End of Career Project related to CloudStack deployment. I
got issues when I try to deploy a VPC, the VPC virtual router isn't deployed
completely and It's destroyed after timeout.
The rest of SSVMs (Console Proxy VM, Storage VM and Guest Network VM) are
deployed correctly. I can access to the instance console, put into guest
network a instance, connect to it, etc ...
Could you help me to resolve this issue? I don't know which is the thing that
I'm doing wrong ...
This is the context:
CloudStack Version: 4.1.1 (upgraded from 4.0.2)Num. of Management Server: 1
(under CentOS 6.4) [physical server]. The MS has this network configuration:IP:
10.10.10.110/24GW: 10.10.10.254DNS server: 10.10.10.116/24Hypervisor: VMWARE
4.1:2 ESXi hosts:IPs: 10.10.1.101 & .102/24GW: 10.10.1.254vCenter:
10.10.1.100Standard Virtual Switches.
Virtual Network Architecture:VmWare Virtual Switch CS Physical Network
Network Subnet Gateway VLAN TAG CS
Traffic Type Start IP Range End IP RangevSwitch0
PhysNet-mgmt-svm 10.10.1.0 255.255.255.0 10.10.1.254
NONE CS Management 10.10.1.120 10.10.1.240vSwitch1
PhysNet-storage 10.10.2.0
255.255.255.0 10.10.2.254 NONE Storage
10.10.2.120 10.10.2.240vSwitch2
PhysNet-guest-1 10.10.3.0 255.255.255.0 10.10.3.254
NONE Guest 10.10.3.1
10.10.3.254vSwitch3 PhysNet-public
10.10.4.0 255.255.255.0 10.10.4.254 NONE Public
10.10.4.1 10.10.4.240
I log in to ssvm consoles and I can see the following:vRouter (VPC) System VM -
doesn't have a specific route to MS:root@r-53-VM:~# netstat -nrKernel IP
routing tableDestination Gateway Genmask Flags MSS Window
irtt Iface10.10.1.0 0.0.0.0 255.255.255.0 U 0 0
0 eth3root@r-53-VM:~#
CS management server:[root@cs-1 ~]# netstat -nrKernel IP routing
tableDestination Gateway Genmask Flags MSS Window irtt
Iface10.10.10.0 0.0.0.0 255.255.255.0 U 0 0 0
eth0169.254.0.0 0.0.0.0 255.255.0.0 U 0 0 0
eth00.0.0.0 10.10.10.254 0.0.0.0 UG 0 0 0
eth0[root@cs-1 ~]#
Console Proxy System VM:root@v-50-VM:~# netstat -nrKernel IP routing
tableDestination Gateway Genmask Flags MSS Window irtt
Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH 0 0 0
eth110.10.10.110 10.10.1.254 255.255.255.255 UGH 0 0 0
eth110.10.4.0 0.0.0.0 255.255.255.0 U 0 0 0
eth210.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
eth110.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
eth10.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
eth2root@v-50-VM:~#
vRouter (no VPC- Guest Network) System VM:root@r-49-VM:~# netstat -nrKernel IP
routing tableDestination Gateway Genmask Flags MSS Window
irtt Iface10.10.4.0 0.0.0.0 255.255.255.0 U 0 0
0 eth210.10.3.0 0.0.0.0 255.255.255.0 U 0 0
0 eth010.10.1.0 0.0.0.0 255.255.255.0 U 0 0 0
eth110.10.10.0 10.10.1.254 255.255.255.0 UG 0 0 0
eth10.0.0.0 10.10.4.254 0.0.0.0 UG 0 0 0
eth2root@r-49-VM:~#
Secondary Storage System VMroot@s-28-VM:~# netstat -nrKernel IP routing
tableDestination Gateway Genmask Flags MSS
Window irtt Iface10.10.10.116 10.10.1.254 255.255.255.255 UGH 0
0 0 eth110.10.10.110 10.10.1.254 255.255.255.255 UGH
0 0 0 eth110.10.4.0 0.0.0.0
255.255.255.0 U 0 0 0 eth210.10.2.0
0.0.0.0 255.255.255.0 U 0 0 0
eth310.10.1.0 0.0.0.0 255.255.255.0 U 0 0
0 eth110.10.10.0 10.10.1.254 255.255.255.0 UG
0 0 0 eth10.0.0.0 10.10.4.254 0.0.0.0
UG 0 0 0 eth2root@s-28-VM:~#
management-server.log (filtered by r-53-VM):
[root@cs-1 ~]# grep -i r-53-VM management-server.log.2013-08-25 2013-08-25
11:34:24,164 DEBUG [cloud.vm.VirtualMachineManagerImpl]
(Job-Executor-13:job-11) Allocating entries for VM:
VM[DomainRouter|r-53-VM]2013-08-25 11:34:24,167 DEBUG
[cloud.vm.VirtualMachineManagerImpl] (Job-Executor-13:job-11) Allocating nics
for VM[DomainRouter|r-53-VM]2013-08-25 11:34:24,168 DEBUG
[cloud.network.NetworkManagerImpl] (Job-Executor-13:job-11) Allocating nic for
vm VM[DomainRouter|r-53-VM] in network Ntwk[202|Control|3] with requested
profile null2013-08-25 11:34:24,176 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-13:job-11) Allocating nic for vm VM[DomainRouter|r-53-VM] in
network Ntwk[200|Public|1] with requested profile
NicProfile[0-0-null-10.10.4.78-vlan://untagged2013-08-25 11:34:24,185 DEBUG
[cloud.vm.VirtualMachineManagerImpl] (Job-Executor-13:job-11) Allocaing disks
for VM[DomainRouter|r-53-VM]2013-08-25 11:34:24,191 DEBUG
[cloud.vm.VirtualMachineManagerImpl] (Job-Executor-13:job-11) Allocation
completed for VM: VM[DomainRouter|r-53-VM]2013-08-25 11:34:24,191 DEBUG
[network.router.VirtualNetworkApplianceManagerImpl] (Job-Executor-13:job-11)
Starting router VM[DomainRouter|r-53-VM]2013-08-25 11:34:24,195 DEBUG
[cloud.vm.VirtualMachineManagerImpl] (Job-Executor-13:job-11) Successfully
transitioned to start state for VM[DomainRouter|r-53-VM] reservation id =
b4039e49-0c0a-455b-ba6a-7fde25ea27382013-08-25 11:34:24,233 DEBUG
[cloud.vm.VirtualMachineManagerImpl] (Job-Executor-13:job-11) Deployment found
- P0=VM[DomainRouter|r-53-VM],
P0=Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
:
Dest[Zone(1)-Pod(1)-Cluster(1)-Host(1)-Storage(Volume(54|ROOT-->Pool(200))]2013-08-25
11:34:24,275 DEBUG [network.guru.PodBasedNetworkGuru] (Job-Executor-13:job-11)
Allocated a nic
NicProfile[166-53-b4039e49-0c0a-455b-ba6a-7fde25ea2738-10.10.1.238-null for
VM[DomainRouter|r-53-VM]2013-08-25 11:34:24,281 DEBUG
[cloud.storage.StorageManagerImpl] (Job-Executor-13:job-11) Checking if we need
to prepare 1 volumes for VM[DomainRouter|r-53-VM]2013-08-25 11:34:47,940 DEBUG
[network.router.VirtualNetworkApplianceManagerImpl] (Job-Executor-13:job-11)
Boot Args for VM[DomainRouter|r-53-VM]: vpccidr=192.168.0.0/22
domain=cs2cloud.internal dns1=10.10.10.116 template=domP name=r-53-VM
eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=10.10.10.0/24
localgw=10.10.1.254 type=vpcrouter disable_rp_filter=true
extra_pubnics=22013-08-25 11:34:47,994 DEBUG
[network.router.VpcVirtualNetworkApplianceManagerImpl] (Job-Executor-13:job-11)
Found 0 static routes to apply as a part of vpc route VM[DomainRouter|r-53-VM]
start2013-08-25 11:34:48,000 DEBUG [agent.transport.Request]
(Job-Executor-13:job-11) Seq 1-1308430869: Sending { Cmd , MgmtId:
52244109874, via: 1, Ver: v1, Flags: 100111,
[{"StartCommand":{"vm":{"id":53,"name":"r-53-VM","bootloader":"HVM","type":"DomainRouter","cpus":1,"speed":500,"minRam":134217728,"maxRam":134217728,"arch":"i686","os":"Debian
GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=192.168.0.0/22
domain=cs2cloud.internal dns1=10.10.10.116 template=domP name=r-53-VM
eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=10.10.10.0/24
localgw=10.10.1.254 type=vpcrouter disable_rp_filter=true extra_pubnics=2
nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.10.1.101","wait":0}},{"check.CheckSshCommand":{"ip":"10.10.1.238","port":3922,"interval":6,"retries":100,"name":"r-53-VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"10.10.1.238","router.name":"r-53-VM"},"wait":0}},{"PlugNicCommand":{"nic":{"deviceId":1,"networkRateMbps":200,"defaultNic":true,"uuid":"639efd08-1755-4d6e-84e4-1db4bc686a66","ip":"10.10.4.78","netmask":"255.255.255.0","gateway":"10.10.4.254","mac":"06:76:58:00:00:c7","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"vSwitch3"},"instanceName":"r-53-VM","wait":0}},{"routing.IpAssocVpcCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"}],"accessDetails":{"router.guest.ip":"10.10.4.78","zone.network.type":"Advanced","router.ip":"10.10.1.238","router.name":"r-53-VM"},"wait":0}},{"routing.SetSourceNatCommand":{"ipAddress":{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"},"add":true,"accessDetails":{"zone.network.type":"Advanced","router.ip":"10.10.1.238","router.name":"r-53-VM"},"wait":0}},{}]
}2013-08-25 11:34:48,001 DEBUG [agent.transport.Request]
(Job-Executor-13:job-11) Seq 1-1308430869: Executing: { Cmd , MgmtId:
52244109874, via: 1, Ver: v1, Flags: 100111,
[{"StartCommand":{"vm":{"id":53,"name":"r-53-VM","bootloader":"HVM","type":"DomainRouter","cpus":1,"speed":500,"minRam":134217728,"maxRam":134217728,"arch":"i686","os":"Debian
GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=192.168.0.0/22
domain=cs2cloud.internal dns1=10.10.10.116 template=domP name=r-53-VM
eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=10.10.10.0/24
localgw=10.10.1.254 type=vpcrouter disable_rp_filter=true extra_pubnics=2
nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.10.1.101","wait":0}},{"check.CheckSshCommand":{"ip":"10.10.1.238","port":3922,"interval":6,"retries":100,"name":"r-53-VM","wait":0}},{"GetDomRVersionCmd":{"accessDetails":{"router.ip":"10.10.1.238","router.name":"r-53-VM"},"wait":0}},{"PlugNicCommand":{"nic":{"deviceId":1,"networkRateMbps":200,"defaultNic":true,"uuid":"639efd08-1755-4d6e-84e4-1db4bc686a66","ip":"10.10.4.78","netmask":"255.255.255.0","gateway":"10.10.4.254","mac":"06:76:58:00:00:c7","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://untagged","isolationUri":"vlan://untagged","isSecurityGroupEnabled":false,"name":"vSwitch3"},"instanceName":"r-53-VM","wait":0}},{"routing.IpAssocVpcCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"}],"accessDetails":{"router.guest.ip":"10.10.4.78","zone.network.type":"Advanced","router.ip":"10.10.1.238","router.name":"r-53-VM"},"wait":0}},{"routing.SetSourceNatCommand":{"ipAddress":{"accountId":2,"publicIp":"10.10.4.78","sourceNat":true,"add":true,"oneToOneNat":false,"firstIP":false,"vlanId":"untagged","vlanGateway":"10.10.4.254","vlanNetmask":"255.255.255.0","vifMacAddress":"06:76:58:00:00:c7","networkRate":200,"trafficType":"Public","networkName":"vSwitch3"},"add":true,"accessDetails":{"zone.network.type":"Advanced","router.ip":"10.10.1.238","router.name":"r-53-VM"},"wait":0}},{}]
}2013-08-25 11:34:48,002 INFO [vmware.resource.VmwareResource]
(DirectAgent-142:10.10.1.101) Executing resource StartCommand:
{"vm":{"id":53,"name":"r-53-VM","bootloader":"HVM","type":"DomainRouter","cpus":1,"speed":500,"minRam":134217728,"maxRam":134217728,"arch":"i686","os":"Debian
GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=192.168.0.0/22
domain=cs2cloud.internal dns1=10.10.10.116 template=domP name=r-53-VM
eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=10.10.10.0/24
localgw=10.10.1.254 type=vpcrouter disable_rp_filter=true extra_pubnics=2
nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"Control","isSecurityGroupEnabled":false}]},"hostIp":"10.10.1.101","wait":0}2013-08-25
11:34:48,157 DEBUG [vmware.resource.VmwareResource]
(DirectAgent-142:10.10.1.101) VM r-53-VM will be started with NIC device type:
E10002013-08-25 11:34:48,810 DEBUG [vmware.mo.HostMO]
(DirectAgent-142:10.10.1.101) find VM r-53-VM on host2013-08-25 11:34:53,628
DEBUG [vmware.mo.HostMO] (DirectAgent-142:10.10.1.101) find VM r-53-VM on
host2013-08-25 11:34:54,068 INFO [vmware.mo.HypervisorHostHelper]
(DirectAgent-142:10.10.1.101) Blank VM: r-53-VM is ready for use2013-08-25
11:34:54,068 DEBUG [vmware.mo.HostMO] (DirectAgent-142:10.10.1.101) find VM
r-53-VM on host2013-08-25 11:34:54,068 DEBUG [vmware.mo.HostMO]
(DirectAgent-142:10.10.1.101) VM r-53-VM found in host cache2013-08-25
11:34:57,182 DEBUG [vmware.mo.HostMO] (DirectAgent-142:10.10.1.101) find VM
r-53-VM on host2013-08-25 11:34:57,182 DEBUG [vmware.mo.HostMO]
(DirectAgent-142:10.10.1.101) VM r-53-VM found in host cache2013-08-25
11:34:58,056 INFO [vmware.resource.VmwareResource]
(DirectAgent-142:10.10.1.101) Configure VNC port for VM r-53-VM, port: 5929,
host: 10.10.1.1012013-08-25 12:17:13,198 ERROR [vmware.resource.VmwareResource]
(DirectAgent-142:10.10.1.101) Can not ping System vm r-53-VMdue to:Unable to
connect2013-08-25 12:17:13,201 DEBUG [agent.transport.Request]
(DirectAgent-142:null) Seq 1-1308430869: Processing: { Ans: , MgmtId:
52244109874, via: 1, Ver: v1, Flags: 110,
[{"StartAnswer":{"vm":{"id":53,"name":"r-53-VM","bootloader":"HVM","type":"DomainRouter","cpus":1,"speed":500,"minRam":134217728,"maxRam":134217728,"arch":"i686","os":"Debian
GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=192.168.0.0/22
domain=cs2cloud.internal dns1=10.10.10.116 template=domP name=r-53-VM
eth0ip=10.10.1.238 eth0mask=255.255.255.0 mgmtcidr=10.10.10.0/24
localgw=10.10.1.254 type=vpcrouter disable_rp_filter=true extra_pubnics=2
nic_macs=02:00:38:da:00:31","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"e7fba8722b098afa","params":{"nicAdapter":"E1000"},"uuid":"c71fdb8a-7392-4491-8fa7-dc1074149871","disks":[{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"a0e3fae1-9e4b-4dd8-a342-ee4a2405cd1a","ip":"10.10.1.238","netmask":"255.255.255.0","gateway":"10.10.1.254","mac":"02:00:38:da:00:31","broadcastType":"Native","type":"Control","isSecurityGroupEnabled":false}]},"result":true,"wait":0}},{"check.CheckSshAnswer":{"result":false,"details":"Can
not ping System vm r-53-VMdue to:Unable to connect","wait":0}}] }2013-08-25
12:17:13,209 WARN [network.router.VirtualNetworkApplianceManagerImpl]
(Job-Executor-13:job-11) Unable to ssh to the VM: Can not ping System vm
r-53-VMdue to:Unable to connect2013-08-25 12:17:13,210 INFO
[cloud.vm.VirtualMachineManagerImpl] (Job-Executor-13:job-11) The guru did not
like the answers so stopping VM[DomainRouter|r-53-VM]2013-08-25 12:17:13,212
DEBUG [agent.transport.Request] (Job-Executor-13:job-11) Seq 1-1308430987:
Sending { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags: 100111,
[{"StopCommand":{"isProxy":false,"vmName":"r-53-VM","wait":0}}] }2013-08-25
12:17:13,212 DEBUG [agent.transport.Request] (Job-Executor-13:job-11) Seq
1-1308430987: Executing: { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags:
100111, [{"StopCommand":{"isProxy":false,"vmName":"r-53-VM","wait":0}}]
}2013-08-25 12:17:13,213 INFO [vmware.resource.VmwareResource]
(DirectAgent-484:10.10.1.101) Executing resource StopCommand:
{"isProxy":false,"vmName":"r-53-VM","wait":0}2013-08-25 12:17:13,213 DEBUG
[vmware.mo.HostMO] (DirectAgent-484:10.10.1.101) find VM r-53-VM on
host2013-08-25 12:17:14,111 INFO [vmware.resource.VmwareResource]
(DirectAgent-484:10.10.1.101) Remove all snapshot before stopping VM
r-53-VM2013-08-25 12:17:14,980 INFO [vmware.mo.VirtualMachineMO]
(DirectAgent-484:10.10.1.101) Try gracefully shut down VM r-53-VM2013-08-25
12:17:25,148 DEBUG [vmware.resource.VmwareResource] (DirectAgent-142:null)
Ignoring vm r-53-VM because of a lag in stopping the vm. 2013-08-25
12:17:34,694 DEBUG [agent.transport.Request] (DirectAgent-484:null) Seq
1-1308430987: Processing: { Ans: , MgmtId: 52244109874, via: 1, Ver: v1,
Flags: 110, [{"StopAnswer":{"vncPort":0,"result":true,"details":"Stop VM
r-53-VM Succeed","wait":0}}] }2013-08-25 12:17:34,695 DEBUG
[agent.manager.AgentManagerImpl] (Job-Executor-13:job-11) Details from
executing class com.cloud.agent.api.StopCommand: Stop VM r-53-VM
Succeed2013-08-25 12:17:34,702 ERROR [cloud.vm.VirtualMachineManagerImpl]
(Job-Executor-13:job-11) Failed to start instance
VM[DomainRouter|r-53-VM]com.cloud.utils.exception.ExecutionException: Unable to
start VM[DomainRouter|r-53-VM] due to error in finalizeStart, not
retrying2013-08-25 12:17:34,707 DEBUG [cloud.vm.VirtualMachineManagerImpl]
(Job-Executor-13:job-11) Cleaning up resources for the vm
VM[DomainRouter|r-53-VM] in Starting state2013-08-25 12:17:34,708 DEBUG
[agent.transport.Request] (Job-Executor-13:job-11) Seq 1-1308430989: Sending {
Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags: 100111,
[{"StopCommand":{"isProxy":false,"vmName":"r-53-VM","wait":0}}] }2013-08-25
12:17:34,708 DEBUG [agent.transport.Request] (Job-Executor-13:job-11) Seq
1-1308430989: Executing: { Cmd , MgmtId: 52244109874, via: 1, Ver: v1, Flags:
100111, [{"StopCommand":{"isProxy":false,"vmName":"r-53-VM","wait":0}}]
}2013-08-25 12:17:34,709 INFO [vmware.resource.VmwareResource]
(DirectAgent-453:10.10.1.101) Executing resource StopCommand:
{"isProxy":false,"vmName":"r-53-VM","wait":0}2013-08-25 12:17:34,709 DEBUG
[vmware.mo.HostMO] (DirectAgent-453:10.10.1.101) find VM r-53-VM on
host2013-08-25 12:17:35,596 INFO [vmware.resource.VmwareResource]
(DirectAgent-453:10.10.1.101) VM r-53-VM is already in stopped state2013-08-25
12:17:35,598 DEBUG [agent.transport.Request] (DirectAgent-453:null) Seq
1-1308430989: Processing: { Ans: , MgmtId: 52244109874, via: 1, Ver: v1,
Flags: 110, [{"StopAnswer":{"vncPort":0,"result":true,"details":"VM r-53-VM is
already in stopped state","wait":0}}] }2013-08-25 12:17:35,619 DEBUG
[cloud.vm.VirtualMachineManagerImpl] (Job-Executor-13:job-11) Successfully
released network resources for the vm VM[DomainRouter|r-53-VM]2013-08-25
12:17:35,619 DEBUG [cloud.vm.VirtualMachineManagerImpl]
(Job-Executor-13:job-11) Successfully cleanued up resources for the vm
VM[DomainRouter|r-53-VM] in Starting
statecom.cloud.exception.AgentUnavailableException: Resource [Host:1] is
unreachable: Host 1: Unable to start instance due to Unable to start
VM[DomainRouter|r-53-VM] due to error in finalizeStart, not retryingCaused by:
com.cloud.utils.exception.ExecutionException: Unable to start
VM[DomainRouter|r-53-VM] due to error in finalizeStart, not retrying2013-08-25
12:17:35,667 DEBUG [cloud.vm.VirtualMachineManagerImpl]
(Job-Executor-13:job-11) VM is already stopped:
VM[DomainRouter|r-53-VM]2013-08-25 12:17:35,671 DEBUG
[cloud.vm.VirtualMachineManagerImpl] (Job-Executor-13:job-11) Destroying vm
VM[DomainRouter|r-53-VM]2013-08-25 12:17:35,701 DEBUG [agent.transport.Request]
(Job-Executor-13:job-11) Seq 1-1308430990: Sending { Cmd , MgmtId:
52244109874, via: 1, Ver: v1, Flags: 100111,
[{"storage.DestroyCommand":{"vmName":"r-53-VM","volume":{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0},"wait":0}}]
}2013-08-25 12:17:35,701 DEBUG [agent.transport.Request]
(Job-Executor-13:job-11) Seq 1-1308430990: Executing: { Cmd , MgmtId:
52244109874, via: 1, Ver: v1, Flags: 100111,
[{"storage.DestroyCommand":{"vmName":"r-53-VM","volume":{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0},"wait":0}}]
}2013-08-25 12:17:35,702 INFO [vmware.resource.VmwareResource]
(DirectAgent-106:10.10.1.101) Executing resource DestroyCommand:
{"vmName":"r-53-VM","volume":{"id":54,"name":"ROOT-53","mountPoint":"/mnt/storage_group/primary_vol/primary_share","path":"ROOT-53-54","size":2097152000,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"961a0972-5d85-3a20-a3ab-98682266772b","deviceId":0},"wait":0}2013-08-25
12:17:37,006 INFO [vmware.resource.VmwareResource]
(DirectAgent-106:10.10.1.101) Destroy root volume and VM itself. vmName
r-53-VM2013-08-25 12:17:48,412 DEBUG [cloud.vm.VirtualMachineManagerImpl]
(Job-Executor-13:job-11) Expunged VM[DomainRouter|r-53-VM]2013-08-25
12:18:25,563 DEBUG [vmware.resource.VmwareResource] (DirectAgent-105:null) VM
r-53-VM is now missing from host report[root@cs-1 ~]#
Please, if you need more info to debug don't hesitate request it to me.
Many Thanks for you help.Regards.
