So, I'm not sure what's going on, but after setting up a new basic zone, the zone can't seem to setup the system VMs. Here's the log:
2013-04-11 10:14:37,121 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-36:null) Seq 6-1011154984: Executing request 2013-04-11 10:14:37,208 INFO [xen.resource.CitrixResourceBase] (DirectAgent-36:null) VM does not exist on XenServer73aa7179-8262-4181-8e7f-5e33ace0406e 2013-04-11 10:14:37,208 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-36:null) Seq 6-1011154984: Response Received: 2013-04-11 10:14:37,209 DEBUG [agent.transport.Request] (DirectAgent-36:null) Seq 6-1011154984: Processing: { Ans: , MgmtId: 144344415547, via: 6, Ver: v1, Flags: 110, [{"StopAnswer":{"vncPort":0,"result":true,"details":"VM does not exist","wait":0}}] } 2013-04-11 10:14:37,209 DEBUG [agent.manager.AgentAttache] (DirectAgent-36:null) Seq 6-1011154984: No more commands found 2013-04-11 10:14:37,209 DEBUG [agent.transport.Request] (secstorage-1:null) Seq 6-1011154984: Received: { Ans: , MgmtId: 144344415547, via: 6, Ver: v1, Flags: 110, { StopAnswer } } 2013-04-11 10:14:37,219 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Service SecurityGroup is not supported in the network id=214 2013-04-11 10:14:37,223 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to release Nic[375-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-10.255.100.2] 2013-04-11 10:14:37,223 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to release Nic[375-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-10.255.100.2] 2013-04-11 10:14:37,223 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to release Nic[375-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-10.255.100.2] 2013-04-11 10:14:37,223 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to release Nic[375-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-10.255.100.2] 2013-04-11 10:14:37,223 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to release Nic[375-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-10.255.100.2] 2013-04-11 10:14:37,223 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to release Nic[375-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-10.255.100.2] 2013-04-11 10:14:37,223 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to release Nic[375-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-10.255.100.2] 2013-04-11 10:14:37,227 DEBUG [network.guru.ControlNetworkGuru] (secstorage-1:null) Released nic: NicProfile[376-96-null-null-null 2013-04-11 10:14:37,229 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to release Nic[376-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] 2013-04-11 10:14:37,229 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to release Nic[376-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] 2013-04-11 10:14:37,229 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to release Nic[376-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] 2013-04-11 10:14:37,229 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to release Nic[376-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] 2013-04-11 10:14:37,229 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to release Nic[376-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] 2013-04-11 10:14:37,229 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to release Nic[376-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] 2013-04-11 10:14:37,230 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to release Nic[376-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] 2013-04-11 10:14:37,234 DEBUG [dc.dao.DataCenterIpAddressDaoImpl] (secstorage-1:null) Releasing ip address for reservationId=ab171535-9cbf-4cc8-87f3-f18f7e595549, instance=377 2013-04-11 10:14:37,235 DEBUG [network.guru.PodBasedNetworkGuru] (secstorage-1:null) Released nic: NicProfile[377-96-null-null-null 2013-04-11 10:14:37,237 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to release Nic[377-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] 2013-04-11 10:14:37,237 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to release Nic[377-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] 2013-04-11 10:14:37,237 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to release Nic[377-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] 2013-04-11 10:14:37,237 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to release Nic[377-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] 2013-04-11 10:14:37,237 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to release Nic[377-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] 2013-04-11 10:14:37,237 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to release Nic[377-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] 2013-04-11 10:14:37,237 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to release Nic[377-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] 2013-04-11 10:14:37,246 DEBUG [network.guru.StorageNetworkGuru] (secstorage-1:null) Release an storage ip 10.255.20.9 2013-04-11 10:14:37,249 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VirtualRouter to release Nic[378-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] 2013-04-11 10:14:37,249 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking Ovs to release Nic[378-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] 2013-04-11 10:14:37,249 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking ExternalDhcpServer to release Nic[378-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] 2013-04-11 10:14:37,249 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking BareMetal to release Nic[378-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] 2013-04-11 10:14:37,249 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking SecurityGroupProvider to release Nic[378-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] 2013-04-11 10:14:37,249 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking VpcVirtualRouter to release Nic[378-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] 2013-04-11 10:14:37,249 DEBUG [cloud.network.NetworkManagerImpl] (secstorage-1:null) Asking NiciraNvp to release Nic[378-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] 2013-04-11 10:14:37,249 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Successfully released network resources for the vm VM[SecondaryStorageVm|s-96-VM] 2013-04-11 10:14:37,249 DEBUG [cloud.vm.VirtualMachineManagerImpl] (secstorage-1:null) Successfully cleanued up resources for the vm VM[SecondaryStorageVm|s-96-VM] in Starting state 2013-04-11 10:14:37,250 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) DeploymentPlanner allocation algorithm: random 2013-04-11 10:14:37,250 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Trying to allocate a host and storage pools from dc:3, pod:null,cluster:null, requested cpu: 500, requested ram: 268435456 2013-04-11 10:14:37,250 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Is ROOT volume READY (pool already allocated)?: No 2013-04-11 10:14:37,250 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Searching all possible resources under this Zone: 3 2013-04-11 10:14:37,251 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Listing clusters in order of aggregate capacity, that have (atleast one host with) enough CPU and RAM capacity under this Zone: 3 2013-04-11 10:14:37,252 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) CPUOverprovisioningFactor considered: 1.0 2013-04-11 10:14:37,257 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Checking resources in Cluster: 3 under Pod: 3 2013-04-11 10:14:37,257 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Calling HostAllocators to find suitable hosts 2013-04-11 10:14:37,257 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Looking for hosts in dc: 3 pod:3 cluster:3 2013-04-11 10:14:37,259 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) FirstFitAllocator has 1 hosts to check for allocation: [Host[-6-Routing]] 2013-04-11 10:14:37,260 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Found 1 hosts for allocation after prioritization: [Host[-6-Routing]] 2013-04-11 10:14:37,260 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=256 2013-04-11 10:14:37,260 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Host name: host1, hostId: 6 is in avoid set, skipping this and trying other available hosts 2013-04-11 10:14:37,260 DEBUG [allocator.impl.FirstFitAllocator] (secstorage-1:FirstFitRoutingAllocator) Host Allocator returning 0 suitable hosts 2013-04-11 10:14:37,260 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) No suitable hosts found 2013-04-11 10:14:37,260 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) No suitable hosts found under this Cluster: 3 2013-04-11 10:14:37,260 DEBUG [cloud.deploy.FirstFitPlanner] (secstorage-1:null) Could not find suitable Deployment Destination for this VM under any clusters, returning. 2013-04-11 10:14:37,264 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) VM state transitted from :Starting to Stopped with event: OperationFailedvm's original host id: null new host id: null host id before state transition: 6 2013-04-11 10:14:37,266 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) Hosts's actual total CPU: 44800 and CPU after applying overprovisioning: 44800 2013-04-11 10:14:37,267 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) release cpu from host: 6, old used: 500,reserved: 0, actual total: 44800, total with overprovisioning: 44800; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse 2013-04-11 10:14:37,267 DEBUG [cloud.capacity.CapacityManagerImpl] (secstorage-1:null) release mem from host: 6, old used: 268435456,reserved: 0, total: 134355235392; new used: 0,reserved:0; movedfromreserved: false,moveToReserveredfalse 2013-04-11 10:14:37,268 WARN [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Exception while trying to start secondary storage vm com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM[SecondaryStorageVm|s-96-VM]Scope=interface com.cloud.dc.DataCenter; id=3 at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:734) at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:472) at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:465) at com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:257) at com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:684) at com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1310) at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:119) at com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50) at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:106) at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:34) at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:83) at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:73) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:679) 2013-04-11 10:14:37,269 INFO [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Unable to start secondary storage vm for standby capacity, secStorageVm vm Id : 96, will recycle it and start a new one 2013-04-11 10:14:37,269 INFO [cloud.secstorage.PremiumSecondaryStorageManagerImpl] (secstorage-1:null) Primary secondary storage is not even started, wait until next turn On Tue, Apr 9, 2013 at 12:59 PM, Kirk Jantzer <kirk.jant...@gmail.com>wrote: > back to normal, thanks again :-) > > > On Tue, Apr 9, 2013 at 10:45 AM, Kirk Jantzer <kirk.jant...@gmail.com>wrote: > >> awesome, thanks! >> >> >> On Tue, Apr 9, 2013 at 10:18 AM, Carlos Reategui <car...@reategui.com>wrote: >> >>> Hi Kirk, >>> This is the script I was using to do so and a few more things. You will >>> also need to go to each your hosts and stop/destroy all VMs and try to >>> get >>> the to their initial state or better yet re-install them: >>> >>> #!/bin/bash >>> # Set your password >>> DBPWD=Password >>> >>> /etc/init.d/cloud-management stop >>> >>> mysql -p$DBPWD -e 'drop database cloud' >>> mysql -p$DBPWD -e 'drop database cloud_usage' >>> >>> rm -rf /var/log/cloud/management/* >>> # Following assume storage on management server >>> # You may not want to do this >>> rm -rf /export/primary/* >>> rm -rf /export/secondary/* >>> >>> # Re-create DB >>> cloud-setup-databases cloud:$DBPWD@localhost --deploy-as=root:$DBPWD >>> cloud-setup-management >>> >>> # Re install template >>> # Please note I serve the template file from local machine >>> # Assumes secondary storage mounted at /mnt/secondary >>> /usr/lib/cloud/common/scripts/storage/secondary/cloud-install-sys-tmplt >>> -m >>> /mnt/secondary -u http://localhost/isos/acton-systemvm-02062012.vhd.bz2-h >>> xenserver -F >>> >>> /etc/init.d/cloud-management start >>> >>> >>> >>> On Tue, Apr 9, 2013 at 6:05 AM, Kirk Jantzer <kirk.jant...@gmail.com> >>> wrote: >>> >>> > Would you be able to provide steps to "drop the DB Schema then >>> re-deploy >>> > the Databases", please? It seems that's going to be my only option - >>> even >>> > though the host is on, the system vm's are either showing destroyed or >>> > unable to destroy. >>> > >>> > >>> > On Mon, Apr 8, 2013 at 5:16 PM, Geoff Higginbottom < >>> > geoff.higginbot...@shapeblue.com> wrote: >>> > >>> > > If you just want to start again, drop the DB Schema then re-deploy >>> the >>> > > Databases. >>> > > >>> > > Ensure you clear down your Storage and reinstall your Hypervisors >>> before >>> > > trying to use them again. >>> > > >>> > > Regards >>> > > >>> > > Geoff Higginbottom >>> > > >>> > > D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581 >>> > > >>> > > geoff.higginbot...@shapeblue.com >>> > > >>> > > >>> > > -----Original Message----- >>> > > From: Ahmad Emneina [mailto:aemne...@gmail.com] >>> > > Sent: 08 April 2013 21:25 >>> > > To: Cloudstack users mailing list >>> > > Subject: Re: Want to "start over" >>> > > >>> > > it appears that there is a system vm preventing the removal of the >>> host. >>> > > since the host is down, it cant delete (transition the state) of the >>> > > downed system vm. possible way to remedy this is to make sure your >>> host >>> > is >>> > > reachable, has storage plugged in and in a good state. zone >>> can/should be >>> > > disabled, to prevent spawning of new system vm's... then try to >>> destroy >>> > the >>> > > system vm's. There might be a 'grace period' until the vm's are >>> cleaned >>> > up >>> > > from the hosts. Once thats met you can follow it by removing storage >>> and >>> > > hosts. >>> > > >>> > > >>> > > On Mon, Apr 8, 2013 at 12:28 PM, Kirk Jantzer < >>> kirk.jant...@gmail.com >>> > > >wrote: >>> > > >>> > > > I want to do some more testing of things, so I'm trying to remove >>> the >>> > > > existing hosts/clusters/pods/zones, however I can't seem to do so. >>> I'm >>> > > > down to the last host but get the following: >>> > > > >>> > > > No resource adapter respond to DELETE_HOST event for qtwstratus1 >>> id = >>> > > > 13, hypervisorType is XenServer, host type is Routing >>> > > > >>> > > > The host is showing as disconnected in the UI along with all other >>> > > > important items: >>> > > > mysql> select id,name,status from host; >>> > > > +----+------------------------------------+--------------+ >>> > > > | id | name | status | >>> > > > +----+------------------------------------+--------------+ >>> > > > | 1 | qtwstratus1 | Removed | >>> > > > | 2 | qtwstratus2 | Removed | >>> > > > | 4 | qtwstratus4 | Removed | >>> > > > | 5 | qtwstratus5 | Removed | >>> > > > | 6 | qtwstratus6 | Removed | >>> > > > | 7 | qtwstratus7 | Removed | >>> > > > | 11 | s-18-VM | Disconnected | >>> > > > | 12 | v-2-VM | Disconnected | >>> > > > | 13 | qtwstratus1 | Disconnected | >>> > > > | 14 | v-24-VM | Disconnected | >>> > > > | 15 | s-25-VM | Disconnected | >>> > > > | 18 | s-26-VM | Disconnected | >>> > > > | 19 | v-27-VM | Disconnected | >>> > > > | 20 | v-79-VM | Down | >>> > > > | 21 | s-103-VM | Down | >>> > > > +----+------------------------------------+--------------+ >>> > > > >>> > > > management-server.log: >>> > > > >>> > > > 2013-04-08 15:16:56,713 DEBUG [cloud.api.ApiServlet] >>> > > > (http-8080-6:null) ===START=== <client_ip> -- GET >>> > > > >>> > > > >>> > > > >>> command=deleteHost&id=40ec48c4-697e-4498-bd3d-f9dd77566f45&forced=fals >>> > > > >>> e&response=json&sessionkey=7hKixOBlpz0f9%2BRGLFvdx%2B1snRE%3D&_=136544 >>> > > > 8764976 >>> > > > 2013-04-08 15:16:56,736 DEBUG [cloud.resource.ResourceManagerImpl] >>> > > > (http-8080-6:null) Dispatching resource state event DELETE_HOST to >>> > > > ConsoleProxyManagerImpl$$EnhancerByCGLIB$$bdfb2f62 >>> > > > 2013-04-08 15:16:56,736 DEBUG [cloud.resource.ResourceManagerImpl] >>> > > > (http-8080-6:null) Dispatching resource state event DELETE_HOST to >>> > > > PremiumSecondaryStorageManagerImpl$$EnhancerByCGLIB$$b376130a >>> > > > 2013-04-08 15:16:56,736 DEBUG [cloud.resource.ResourceManagerImpl] >>> > > > (http-8080-6:null) Dispatching resource state event DELETE_HOST to >>> > > > KvmServerDiscoverer$$EnhancerByCGLIB$$e167cbfd >>> > > > 2013-04-08 15:16:56,736 DEBUG [cloud.resource.ResourceManagerImpl] >>> > > > (http-8080-6:null) Dispatching resource state event DELETE_HOST to >>> > > > XcpServerDiscoverer$$EnhancerByCGLIB$$18f3e761 >>> > > > 2013-04-08 15:16:56,736 DEBUG [cloud.resource.ResourceManagerImpl] >>> > > > (http-8080-6:null) Deleting Host: 13 >>> > > > Guid:5a5efe1c-654b-411c-b4b7-4170ba887716 >>> > > > 2013-04-08 15:16:56,749 DEBUG [cloud.vm.VirtualMachineManagerImpl] >>> > > > (http-8080-6:null) Destroying vm VM[ConsoleProxy|v-79-VM] >>> > > > 2013-04-08 15:16:56,769 DEBUG [cloud.capacity.CapacityManagerImpl] >>> > > > (http-8080-6:null) VM state transitted from :Running to Stopping >>> with >>> > > > event: StopRequestedvm's original host id: 13 new host id: 13 host >>> id >>> > > > before state transition: 13 >>> > > > 2013-04-08 15:16:56,774 WARN [cloud.vm.VirtualMachineManagerImpl] >>> > > > (http-8080-6:null) Unable to stop vm VM[ConsoleProxy|v-79-VM] >>> > > > 2013-04-08 15:16:56,778 DEBUG [cloud.capacity.CapacityManagerImpl] >>> > > > (http-8080-6:null) VM state transitted from :Stopping to Running >>> with >>> > > > event: OperationFailedvm's original host id: 13 new host id: 13 >>> host >>> > > > id before state transition: 13 >>> > > > 2013-04-08 15:16:56,778 DEBUG [cloud.vm.VirtualMachineManagerImpl] >>> > > > (http-8080-6:null) Unable to stop VM[ConsoleProxy|v-79-VM] >>> > > > 2013-04-08 15:16:56,778 WARN [cloud.resource.ResourceManagerImpl] >>> > > > (http-8080-6:null) There was an error Destory the vm: >>> > > > VM[ConsoleProxy|v-79-VM] as a part of hostDelete id=13 >>> > > > 2013-04-08 15:16:56,778 INFO >>> [utils.exception.CSExceptionErrorCode] >>> > > > (http-8080-6:null) Could not find exception: >>> > > > com.cloud.resource.UnableDeleteHostException in error code list for >>> > > > exceptions >>> > > > 2013-04-08 15:16:56,778 DEBUG [cloud.resource.ResourceManagerImpl] >>> > > > (http-8080-6:null) There was an error Destory the vm: >>> > > > VM[ConsoleProxy|v-79-VM] as a part of hostDelete id=13 >>> > > > com.cloud.resource.UnableDeleteHostException: There was an error >>> > > > Destory the vm: VM[ConsoleProxy|v-79-VM] as a part of hostDelete >>> id=13 >>> > > > at >>> > > > >>> > > > >>> > > >>> > >>> com.cloud.resource.ResourceManagerImpl.deleteRoutingHost(ResourceManagerImpl.java:1800) >>> > > > at >>> > > > >>> > > > >>> > > >>> > >>> com.cloud.hypervisor.xen.discoverer.XcpServerDiscoverer.deleteHost(XcpServerDiscoverer.java:701) >>> > > > at >>> > > > >>> > > > >>> > > >>> > >>> com.cloud.resource.ResourceManagerImpl.dispatchToStateAdapters(ResourceManagerImpl.java:1387) >>> > > > at >>> > > > >>> > > > >>> > > >>> > >>> com.cloud.resource.ResourceManagerImpl.doDeleteHost(ResourceManagerImpl.java:766) >>> > > > at >>> > > > >>> com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34) >>> > > > at >>> > > > >>> > > > >>> > > >>> > >>> com.cloud.resource.ResourceManagerImpl.deleteHost(ResourceManagerImpl.java:847) >>> > > > at >>> > > > com.cloud.api.commands.DeleteHostCmd.execute(DeleteHostCmd.java:82) >>> > > > at >>> com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:138) >>> > > > at com.cloud.api.ApiServer.queueCommand(ApiServer.java:544) >>> > > > at >>> com.cloud.api.ApiServer.handleRequest(ApiServer.java:423) >>> > > > at >>> com.cloud.api.ApiServlet.processRequest(ApiServlet.java:312) >>> > > > at com.cloud.api.ApiServlet.doGet(ApiServlet.java:64) >>> > > > at >>> javax.servlet.http.HttpServlet.service(HttpServlet.java:617) >>> > > > at >>> javax.servlet.http.HttpServlet.service(HttpServlet.java:717) >>> > > > at >>> > > > >>> > > > >>> > > >>> > >>> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) >>> > > > at >>> > > > >>> > > > >>> > > >>> > >>> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) >>> > > > at >>> > > > >>> > > > >>> > > >>> > >>> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) >>> > > > at >>> > > > >>> > > > >>> > > >>> > >>> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) >>> > > > at >>> > > > >>> > > > >>> > > >>> > >>> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) >>> > > > at >>> > > > >>> > > > >>> > > >>> > >>> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) >>> > > > at >>> > > > >>> > >>> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555) >>> > > > at >>> > > > >>> > > > >>> > > >>> > >>> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) >>> > > > at >>> > > > >>> > > >>> > >>> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298) >>> > > > at >>> > > > >>> > > >>> > >>> org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857) >>> > > > at >>> > > > >>> > > > >>> > > >>> > >>> org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588) >>> > > > at >>> > > > >>> org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489) >>> > > > at java.lang.Thread.run(Thread.java:679) >>> > > > 2013-04-08 15:16:56,779 INFO >>> [utils.exception.CSExceptionErrorCode] >>> > > > (http-8080-6:null) Could not find exception: >>> > > > com.cloud.resource.UnableDeleteHostException in error code list for >>> > > > exceptions >>> > > > 2013-04-08 15:16:56,779 DEBUG [cloud.resource.ResourceManagerImpl] >>> > > > (http-8080-6:null) Adapter XCP Agent says unable to delete host >>> > > > com.cloud.resource.UnableDeleteHostException: There was an error >>> > > > Destory the vm: VM[ConsoleProxy|v-79-VM] as a part of hostDelete >>> > > > id=13,There was an error Destory the vm: VM[ConsoleProxy|v-79-VM] >>> as a >>> > > > part of hostDelete >>> > > > id=13 >>> > > > at >>> > > > >>> > > > >>> > > >>> > >>> com.cloud.resource.ResourceManagerImpl.deleteRoutingHost(ResourceManagerImpl.java:1805) >>> > > > at >>> > > > >>> > > > >>> > > >>> > >>> com.cloud.hypervisor.xen.discoverer.XcpServerDiscoverer.deleteHost(XcpServerDiscoverer.java:701) >>> > > > at >>> > > > >>> > > > >>> > > >>> > >>> com.cloud.resource.ResourceManagerImpl.dispatchToStateAdapters(ResourceManagerImpl.java:1387) >>> > > > at >>> > > > >>> > > > >>> > > >>> > >>> com.cloud.resource.ResourceManagerImpl.doDeleteHost(ResourceManagerImpl.java:766) >>> > > > at >>> > > > >>> com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34) >>> > > > at >>> > > > >>> > > > >>> > > >>> > >>> com.cloud.resource.ResourceManagerImpl.deleteHost(ResourceManagerImpl.java:847) >>> > > > at >>> > > > com.cloud.api.commands.DeleteHostCmd.execute(DeleteHostCmd.java:82) >>> > > > at >>> com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:138) >>> > > > at com.cloud.api.ApiServer.queueCommand(ApiServer.java:544) >>> > > > at >>> com.cloud.api.ApiServer.handleRequest(ApiServer.java:423) >>> > > > at >>> com.cloud.api.ApiServlet.processRequest(ApiServlet.java:312) >>> > > > at com.cloud.api.ApiServlet.doGet(ApiServlet.java:64) >>> > > > at >>> javax.servlet.http.HttpServlet.service(HttpServlet.java:617) >>> > > > at >>> javax.servlet.http.HttpServlet.service(HttpServlet.java:717) >>> > > > at >>> > > > >>> > > > >>> > > >>> > >>> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) >>> > > > at >>> > > > >>> > > > >>> > > >>> > >>> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) >>> > > > at >>> > > > >>> > > > >>> > > >>> > >>> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) >>> > > > at >>> > > > >>> > > > >>> > > >>> > >>> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) >>> > > > at >>> > > > >>> > > > >>> > > >>> > >>> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) >>> > > > at >>> > > > >>> > > > >>> > > >>> > >>> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) >>> > > > at >>> > > > >>> > >>> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555) >>> > > > at >>> > > > >>> > > > >>> > > >>> > >>> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) >>> > > > at >>> > > > >>> > > >>> > >>> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298) >>> > > > at >>> > > > >>> > > >>> > >>> org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857) >>> > > > at >>> > > > >>> > > > >>> > > >>> > >>> org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588) >>> > > > at >>> > > > >>> org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489) >>> > > > at java.lang.Thread.run(Thread.java:679) >>> > > > 2013-04-08 15:16:56,779 DEBUG [cloud.resource.ResourceManagerImpl] >>> > > > (http-8080-6:null) Dispatching resource state event DELETE_HOST to >>> > > > OvmDiscoverer$$EnhancerByCGLIB$$abfe93d0 >>> > > > 2013-04-08 15:16:56,779 DEBUG [cloud.resource.ResourceManagerImpl] >>> > > > (http-8080-6:null) Dispatching resource state event DELETE_HOST to >>> > > > NetworkUsageManagerImpl$$EnhancerByCGLIB$$34a46271 >>> > > > 2013-04-08 15:16:56,779 DEBUG [cloud.resource.ResourceManagerImpl] >>> > > > (http-8080-6:null) Dispatching resource state event DELETE_HOST to >>> > > > ExternalDhcpManagerImpl$$EnhancerByCGLIB$$7ded4baf >>> > > > 2013-04-08 15:16:56,779 DEBUG [cloud.resource.ResourceManagerImpl] >>> > > > (http-8080-6:null) Dispatching resource state event DELETE_HOST to >>> > > > NiciraNvpElement$$EnhancerByCGLIB$$a2b35039 >>> > > > 2013-04-08 15:16:56,779 DEBUG [cloud.resource.ResourceManagerImpl] >>> > > > (http-8080-6:null) Dispatching resource state event DELETE_HOST to >>> > > > BareMetalDiscoverer$$EnhancerByCGLIB$$9ca73829 >>> > > > 2013-04-08 15:16:56,779 DEBUG [cloud.resource.ResourceManagerImpl] >>> > > > (http-8080-6:null) Dispatching resource state event DELETE_HOST to >>> > > > PxeServerManagerImpl$$EnhancerByCGLIB$$28d62ea9 >>> > > > 2013-04-08 15:16:56,779 ERROR [cloud.api.ApiDispatcher] >>> > > > (http-8080-6:null) Exception while executing DeleteHostCmd: >>> > > > com.cloud.utils.exception.CloudRuntimeException: No resource >>> adapter >>> > > > respond to DELETE_HOST event for qtwstratus1 id = 13, >>> hypervisorType >>> > > > is XenServer, host type is Routing >>> > > > at >>> > > > >>> > > > >>> > > >>> > >>> com.cloud.resource.ResourceManagerImpl.doDeleteHost(ResourceManagerImpl.java:769) >>> > > > at >>> > > > >>> com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34) >>> > > > at >>> > > > >>> > > > >>> > > >>> > >>> com.cloud.resource.ResourceManagerImpl.deleteHost(ResourceManagerImpl.java:847) >>> > > > at >>> > > > com.cloud.api.commands.DeleteHostCmd.execute(DeleteHostCmd.java:82) >>> > > > at >>> com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:138) >>> > > > at com.cloud.api.ApiServer.queueCommand(ApiServer.java:544) >>> > > > at >>> com.cloud.api.ApiServer.handleRequest(ApiServer.java:423) >>> > > > at >>> com.cloud.api.ApiServlet.processRequest(ApiServlet.java:312) >>> > > > at com.cloud.api.ApiServlet.doGet(ApiServlet.java:64) >>> > > > at >>> javax.servlet.http.HttpServlet.service(HttpServlet.java:617) >>> > > > at >>> javax.servlet.http.HttpServlet.service(HttpServlet.java:717) >>> > > > at >>> > > > >>> > > > >>> > > >>> > >>> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) >>> > > > at >>> > > > >>> > > > >>> > > >>> > >>> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) >>> > > > at >>> > > > >>> > > > >>> > > >>> > >>> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) >>> > > > at >>> > > > >>> > > > >>> > > >>> > >>> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) >>> > > > at >>> > > > >>> > > > >>> > > >>> > >>> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) >>> > > > at >>> > > > >>> > > > >>> > > >>> > >>> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) >>> > > > at >>> > > > >>> > >>> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555) >>> > > > at >>> > > > >>> > > > >>> > > >>> > >>> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) >>> > > > at >>> > > > >>> > > >>> > >>> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298) >>> > > > at >>> > > > >>> > > >>> > >>> org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857) >>> > > > at >>> > > > >>> > > > >>> > > >>> > >>> org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588) >>> > > > at >>> > > > >>> org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489) >>> > > > at java.lang.Thread.run(Thread.java:679) >>> > > > 2013-04-08 15:16:56,781 DEBUG [cloud.api.ApiServlet] >>> > > > (http-8080-6:null) ===END=== <client_ip> -- GET >>> > > > >>> > > > >>> > > > >>> > > >>> > >>> command=deleteHost&id=40ec48c4-697e-4498-bd3d-f9dd77566f45&forced=false&response=json&sessionkey=7hKixOBlpz0f9%2BRGLFvdx%2B1snRE%3D&_=1365448764976 >>> > > > >>> > > This email and any attachments to it may be confidential and are >>> intended >>> > > solely for the use of the individual to whom it is addressed. Any >>> views >>> > or >>> > > opinions expressed are solely those of the author and do not >>> necessarily >>> > > represent those of Shape Blue Ltd or related companies. If you are >>> not >>> > the >>> > > intended recipient of this email, you must neither take any action >>> based >>> > > upon its contents, nor copy or show it to anyone. Please contact the >>> > sender >>> > > if you believe you have received this email in error. Shape Blue Ltd >>> is a >>> > > company incorporated in England & Wales. ShapeBlue Services India >>> LLP is >>> > > operated under license from Shape Blue Ltd. ShapeBlue is a registered >>> > > trademark. >>> > > >>> > > >>> > >>> > >>> > -- >>> > Regards, >>> > >>> > Kirk Jantzer >>> > c: (678) 561-5475 >>> > >>> >> >> >> >> -- >> Regards, >> >> Kirk Jantzer >> c: (678) 561-5475 >> > > > > -- > Regards, > > Kirk Jantzer > c: (678) 561-5475 > -- Regards, Kirk Jantzer c: (678) 561-5475