Ignore my last post - I made a mistake adding my secondary storage :-/
On Thu, Apr 11, 2013 at 10:35 AM, Kirk Jantzer <kirk.jant...@gmail.com>wrote: > So, I'm not sure what's going on, but after setting up a new basic zone, > the zone can't seem to setup the system VMs. Here's the log: > > 2013-04-11 10:14:37,121 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-36:null) Seq 6-1011154984: Executing request > 2013-04-11 10:14:37,208 INFO [xen.resource.CitrixResourceBase] > (DirectAgent-36:null) VM does not exist on > XenServer73aa7179-8262-4181-8e7f-5e33ace0406e > 2013-04-11 10:14:37,208 DEBUG [agent.manager.DirectAgentAttache] > (DirectAgent-36:null) Seq 6-1011154984: Response Received: > 2013-04-11 10:14:37,209 DEBUG [agent.transport.Request] > (DirectAgent-36:null) Seq 6-1011154984: Processing: { Ans: , MgmtId: > 144344415547, via: 6, Ver: v1, Flags: 110, > [{"StopAnswer":{"vncPort":0,"result":true,"details":"VM does not > exist","wait":0}}] } > 2013-04-11 10:14:37,209 DEBUG [agent.manager.AgentAttache] > (DirectAgent-36:null) Seq 6-1011154984: No more commands found > 2013-04-11 10:14:37,209 DEBUG [agent.transport.Request] > (secstorage-1:null) Seq 6-1011154984: Received: { Ans: , MgmtId: > 144344415547, via: 6, Ver: v1, Flags: 110, { StopAnswer } } > 2013-04-11 10:14:37,219 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Service SecurityGroup is not supported in the network > id=214 > 2013-04-11 10:14:37,223 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Asking VirtualRouter to release > Nic[375-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-10.255.100.2] > 2013-04-11 10:14:37,223 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Asking Ovs to release > Nic[375-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-10.255.100.2] > 2013-04-11 10:14:37,223 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Asking ExternalDhcpServer to release > Nic[375-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-10.255.100.2] > 2013-04-11 10:14:37,223 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Asking BareMetal to release > Nic[375-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-10.255.100.2] > 2013-04-11 10:14:37,223 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Asking SecurityGroupProvider to release > Nic[375-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-10.255.100.2] > 2013-04-11 10:14:37,223 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Asking VpcVirtualRouter to release > Nic[375-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-10.255.100.2] > 2013-04-11 10:14:37,223 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Asking NiciraNvp to release > Nic[375-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-10.255.100.2] > 2013-04-11 10:14:37,227 DEBUG [network.guru.ControlNetworkGuru] > (secstorage-1:null) Released nic: NicProfile[376-96-null-null-null > 2013-04-11 10:14:37,229 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Asking VirtualRouter to release > Nic[376-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] > 2013-04-11 10:14:37,229 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Asking Ovs to release > Nic[376-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] > 2013-04-11 10:14:37,229 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Asking ExternalDhcpServer to release > Nic[376-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] > 2013-04-11 10:14:37,229 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Asking BareMetal to release > Nic[376-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] > 2013-04-11 10:14:37,229 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Asking SecurityGroupProvider to release > Nic[376-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] > 2013-04-11 10:14:37,229 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Asking VpcVirtualRouter to release > Nic[376-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] > 2013-04-11 10:14:37,230 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Asking NiciraNvp to release > Nic[376-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] > 2013-04-11 10:14:37,234 DEBUG [dc.dao.DataCenterIpAddressDaoImpl] > (secstorage-1:null) Releasing ip address for > reservationId=ab171535-9cbf-4cc8-87f3-f18f7e595549, instance=377 > 2013-04-11 10:14:37,235 DEBUG [network.guru.PodBasedNetworkGuru] > (secstorage-1:null) Released nic: NicProfile[377-96-null-null-null > 2013-04-11 10:14:37,237 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Asking VirtualRouter to release > Nic[377-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] > 2013-04-11 10:14:37,237 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Asking Ovs to release > Nic[377-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] > 2013-04-11 10:14:37,237 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Asking ExternalDhcpServer to release > Nic[377-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] > 2013-04-11 10:14:37,237 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Asking BareMetal to release > Nic[377-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] > 2013-04-11 10:14:37,237 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Asking SecurityGroupProvider to release > Nic[377-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] > 2013-04-11 10:14:37,237 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Asking VpcVirtualRouter to release > Nic[377-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] > 2013-04-11 10:14:37,237 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Asking NiciraNvp to release > Nic[377-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] > 2013-04-11 10:14:37,246 DEBUG [network.guru.StorageNetworkGuru] > (secstorage-1:null) Release an storage ip 10.255.20.9 > 2013-04-11 10:14:37,249 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Asking VirtualRouter to release > Nic[378-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] > 2013-04-11 10:14:37,249 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Asking Ovs to release > Nic[378-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] > 2013-04-11 10:14:37,249 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Asking ExternalDhcpServer to release > Nic[378-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] > 2013-04-11 10:14:37,249 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Asking BareMetal to release > Nic[378-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] > 2013-04-11 10:14:37,249 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Asking SecurityGroupProvider to release > Nic[378-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] > 2013-04-11 10:14:37,249 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Asking VpcVirtualRouter to release > Nic[378-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] > 2013-04-11 10:14:37,249 DEBUG [cloud.network.NetworkManagerImpl] > (secstorage-1:null) Asking NiciraNvp to release > Nic[378-96-ab171535-9cbf-4cc8-87f3-f18f7e595549-null] > 2013-04-11 10:14:37,249 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (secstorage-1:null) Successfully released network resources for the vm > VM[SecondaryStorageVm|s-96-VM] > 2013-04-11 10:14:37,249 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (secstorage-1:null) Successfully cleanued up resources for the vm > VM[SecondaryStorageVm|s-96-VM] in Starting state > 2013-04-11 10:14:37,250 DEBUG [cloud.deploy.FirstFitPlanner] > (secstorage-1:null) DeploymentPlanner allocation algorithm: random > 2013-04-11 10:14:37,250 DEBUG [cloud.deploy.FirstFitPlanner] > (secstorage-1:null) Trying to allocate a host and storage pools from dc:3, > pod:null,cluster:null, requested cpu: 500, requested ram: 268435456 > 2013-04-11 10:14:37,250 DEBUG [cloud.deploy.FirstFitPlanner] > (secstorage-1:null) Is ROOT volume READY (pool already allocated)?: No > 2013-04-11 10:14:37,250 DEBUG [cloud.deploy.FirstFitPlanner] > (secstorage-1:null) Searching all possible resources under this Zone: 3 > 2013-04-11 10:14:37,251 DEBUG [cloud.deploy.FirstFitPlanner] > (secstorage-1:null) Listing clusters in order of aggregate capacity, that > have (atleast one host with) enough CPU and RAM capacity under this Zone: 3 > 2013-04-11 10:14:37,252 DEBUG [cloud.deploy.FirstFitPlanner] > (secstorage-1:null) CPUOverprovisioningFactor considered: 1.0 > 2013-04-11 10:14:37,257 DEBUG [cloud.deploy.FirstFitPlanner] > (secstorage-1:null) Checking resources in Cluster: 3 under Pod: 3 > 2013-04-11 10:14:37,257 DEBUG [cloud.deploy.FirstFitPlanner] > (secstorage-1:null) Calling HostAllocators to find suitable hosts > 2013-04-11 10:14:37,257 DEBUG [allocator.impl.FirstFitAllocator] > (secstorage-1:FirstFitRoutingAllocator) Looking for hosts in dc: 3 pod:3 > cluster:3 > 2013-04-11 10:14:37,259 DEBUG [allocator.impl.FirstFitAllocator] > (secstorage-1:FirstFitRoutingAllocator) FirstFitAllocator has 1 hosts to > check for allocation: [Host[-6-Routing]] > 2013-04-11 10:14:37,260 DEBUG [allocator.impl.FirstFitAllocator] > (secstorage-1:FirstFitRoutingAllocator) Found 1 hosts for allocation after > prioritization: [Host[-6-Routing]] > 2013-04-11 10:14:37,260 DEBUG [allocator.impl.FirstFitAllocator] > (secstorage-1:FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=256 > 2013-04-11 10:14:37,260 DEBUG [allocator.impl.FirstFitAllocator] > (secstorage-1:FirstFitRoutingAllocator) Host name: host1, hostId: 6 is in > avoid set, skipping this and trying other available hosts > 2013-04-11 10:14:37,260 DEBUG [allocator.impl.FirstFitAllocator] > (secstorage-1:FirstFitRoutingAllocator) Host Allocator returning 0 suitable > hosts > 2013-04-11 10:14:37,260 DEBUG [cloud.deploy.FirstFitPlanner] > (secstorage-1:null) No suitable hosts found > 2013-04-11 10:14:37,260 DEBUG [cloud.deploy.FirstFitPlanner] > (secstorage-1:null) No suitable hosts found under this Cluster: 3 > 2013-04-11 10:14:37,260 DEBUG [cloud.deploy.FirstFitPlanner] > (secstorage-1:null) Could not find suitable Deployment Destination for this > VM under any clusters, returning. > 2013-04-11 10:14:37,264 DEBUG [cloud.capacity.CapacityManagerImpl] > (secstorage-1:null) VM state transitted from :Starting to Stopped with > event: OperationFailedvm's original host id: null new host id: null host id > before state transition: 6 > 2013-04-11 10:14:37,266 DEBUG [cloud.capacity.CapacityManagerImpl] > (secstorage-1:null) Hosts's actual total CPU: 44800 and CPU after applying > overprovisioning: 44800 > 2013-04-11 10:14:37,267 DEBUG [cloud.capacity.CapacityManagerImpl] > (secstorage-1:null) release cpu from host: 6, old used: 500,reserved: 0, > actual total: 44800, total with overprovisioning: 44800; new used: > 0,reserved:0; movedfromreserved: false,moveToReserveredfalse > 2013-04-11 10:14:37,267 DEBUG [cloud.capacity.CapacityManagerImpl] > (secstorage-1:null) release mem from host: 6, old used: 268435456,reserved: > 0, total: 134355235392; new used: 0,reserved:0; movedfromreserved: > false,moveToReserveredfalse > 2013-04-11 10:14:37,268 WARN > [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) > Exception while trying to start secondary storage vm > com.cloud.exception.InsufficientServerCapacityException: Unable to create > a deployment for VM[SecondaryStorageVm|s-96-VM]Scope=interface > com.cloud.dc.DataCenter; id=3 > at > com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:734) > at > com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:472) > at > com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:465) > at > com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:257) > at > com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:684) > at > com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1310) > at > com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:119) > at > com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:50) > at > com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:106) > at > com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:34) > at > com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:83) > at > com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:73) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at > java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351) > at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:679) > 2013-04-11 10:14:37,269 INFO > [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Unable > to start secondary storage vm for standby capacity, secStorageVm vm Id : > 96, will recycle it and start a new one > 2013-04-11 10:14:37,269 INFO > [cloud.secstorage.PremiumSecondaryStorageManagerImpl] (secstorage-1:null) > Primary secondary storage is not even started, wait until next turn > > > > On Tue, Apr 9, 2013 at 12:59 PM, Kirk Jantzer <kirk.jant...@gmail.com>wrote: > >> back to normal, thanks again :-) >> >> >> On Tue, Apr 9, 2013 at 10:45 AM, Kirk Jantzer <kirk.jant...@gmail.com>wrote: >> >>> awesome, thanks! >>> >>> >>> On Tue, Apr 9, 2013 at 10:18 AM, Carlos Reategui <car...@reategui.com>wrote: >>> >>>> Hi Kirk, >>>> This is the script I was using to do so and a few more things. You will >>>> also need to go to each your hosts and stop/destroy all VMs and try to >>>> get >>>> the to their initial state or better yet re-install them: >>>> >>>> #!/bin/bash >>>> # Set your password >>>> DBPWD=Password >>>> >>>> /etc/init.d/cloud-management stop >>>> >>>> mysql -p$DBPWD -e 'drop database cloud' >>>> mysql -p$DBPWD -e 'drop database cloud_usage' >>>> >>>> rm -rf /var/log/cloud/management/* >>>> # Following assume storage on management server >>>> # You may not want to do this >>>> rm -rf /export/primary/* >>>> rm -rf /export/secondary/* >>>> >>>> # Re-create DB >>>> cloud-setup-databases cloud:$DBPWD@localhost --deploy-as=root:$DBPWD >>>> cloud-setup-management >>>> >>>> # Re install template >>>> # Please note I serve the template file from local machine >>>> # Assumes secondary storage mounted at /mnt/secondary >>>> /usr/lib/cloud/common/scripts/storage/secondary/cloud-install-sys-tmplt >>>> -m >>>> /mnt/secondary -u http://localhost/isos/acton-systemvm-02062012.vhd.bz2-h >>>> xenserver -F >>>> >>>> /etc/init.d/cloud-management start >>>> >>>> >>>> >>>> On Tue, Apr 9, 2013 at 6:05 AM, Kirk Jantzer <kirk.jant...@gmail.com> >>>> wrote: >>>> >>>> > Would you be able to provide steps to "drop the DB Schema then >>>> re-deploy >>>> > the Databases", please? It seems that's going to be my only option - >>>> even >>>> > though the host is on, the system vm's are either showing destroyed or >>>> > unable to destroy. >>>> > >>>> > >>>> > On Mon, Apr 8, 2013 at 5:16 PM, Geoff Higginbottom < >>>> > geoff.higginbot...@shapeblue.com> wrote: >>>> > >>>> > > If you just want to start again, drop the DB Schema then re-deploy >>>> the >>>> > > Databases. >>>> > > >>>> > > Ensure you clear down your Storage and reinstall your Hypervisors >>>> before >>>> > > trying to use them again. >>>> > > >>>> > > Regards >>>> > > >>>> > > Geoff Higginbottom >>>> > > >>>> > > D: +44 20 3603 0542 | S: +44 20 3603 0540 | M: +447968161581 >>>> > > >>>> > > geoff.higginbot...@shapeblue.com >>>> > > >>>> > > >>>> > > -----Original Message----- >>>> > > From: Ahmad Emneina [mailto:aemne...@gmail.com] >>>> > > Sent: 08 April 2013 21:25 >>>> > > To: Cloudstack users mailing list >>>> > > Subject: Re: Want to "start over" >>>> > > >>>> > > it appears that there is a system vm preventing the removal of the >>>> host. >>>> > > since the host is down, it cant delete (transition the state) of the >>>> > > downed system vm. possible way to remedy this is to make sure your >>>> host >>>> > is >>>> > > reachable, has storage plugged in and in a good state. zone >>>> can/should be >>>> > > disabled, to prevent spawning of new system vm's... then try to >>>> destroy >>>> > the >>>> > > system vm's. There might be a 'grace period' until the vm's are >>>> cleaned >>>> > up >>>> > > from the hosts. Once thats met you can follow it by removing >>>> storage and >>>> > > hosts. >>>> > > >>>> > > >>>> > > On Mon, Apr 8, 2013 at 12:28 PM, Kirk Jantzer < >>>> kirk.jant...@gmail.com >>>> > > >wrote: >>>> > > >>>> > > > I want to do some more testing of things, so I'm trying to remove >>>> the >>>> > > > existing hosts/clusters/pods/zones, however I can't seem to do >>>> so. I'm >>>> > > > down to the last host but get the following: >>>> > > > >>>> > > > No resource adapter respond to DELETE_HOST event for qtwstratus1 >>>> id = >>>> > > > 13, hypervisorType is XenServer, host type is Routing >>>> > > > >>>> > > > The host is showing as disconnected in the UI along with all other >>>> > > > important items: >>>> > > > mysql> select id,name,status from host; >>>> > > > +----+------------------------------------+--------------+ >>>> > > > | id | name | status | >>>> > > > +----+------------------------------------+--------------+ >>>> > > > | 1 | qtwstratus1 | Removed | >>>> > > > | 2 | qtwstratus2 | Removed | >>>> > > > | 4 | qtwstratus4 | Removed | >>>> > > > | 5 | qtwstratus5 | Removed | >>>> > > > | 6 | qtwstratus6 | Removed | >>>> > > > | 7 | qtwstratus7 | Removed | >>>> > > > | 11 | s-18-VM | Disconnected | >>>> > > > | 12 | v-2-VM | Disconnected | >>>> > > > | 13 | qtwstratus1 | Disconnected | >>>> > > > | 14 | v-24-VM | Disconnected | >>>> > > > | 15 | s-25-VM | Disconnected | >>>> > > > | 18 | s-26-VM | Disconnected | >>>> > > > | 19 | v-27-VM | Disconnected | >>>> > > > | 20 | v-79-VM | Down | >>>> > > > | 21 | s-103-VM | Down | >>>> > > > +----+------------------------------------+--------------+ >>>> > > > >>>> > > > management-server.log: >>>> > > > >>>> > > > 2013-04-08 15:16:56,713 DEBUG [cloud.api.ApiServlet] >>>> > > > (http-8080-6:null) ===START=== <client_ip> -- GET >>>> > > > >>>> > > > >>>> > > > >>>> command=deleteHost&id=40ec48c4-697e-4498-bd3d-f9dd77566f45&forced=fals >>>> > > > >>>> e&response=json&sessionkey=7hKixOBlpz0f9%2BRGLFvdx%2B1snRE%3D&_=136544 >>>> > > > 8764976 >>>> > > > 2013-04-08 15:16:56,736 DEBUG [cloud.resource.ResourceManagerImpl] >>>> > > > (http-8080-6:null) Dispatching resource state event DELETE_HOST to >>>> > > > ConsoleProxyManagerImpl$$EnhancerByCGLIB$$bdfb2f62 >>>> > > > 2013-04-08 15:16:56,736 DEBUG [cloud.resource.ResourceManagerImpl] >>>> > > > (http-8080-6:null) Dispatching resource state event DELETE_HOST to >>>> > > > PremiumSecondaryStorageManagerImpl$$EnhancerByCGLIB$$b376130a >>>> > > > 2013-04-08 15:16:56,736 DEBUG [cloud.resource.ResourceManagerImpl] >>>> > > > (http-8080-6:null) Dispatching resource state event DELETE_HOST to >>>> > > > KvmServerDiscoverer$$EnhancerByCGLIB$$e167cbfd >>>> > > > 2013-04-08 15:16:56,736 DEBUG [cloud.resource.ResourceManagerImpl] >>>> > > > (http-8080-6:null) Dispatching resource state event DELETE_HOST to >>>> > > > XcpServerDiscoverer$$EnhancerByCGLIB$$18f3e761 >>>> > > > 2013-04-08 15:16:56,736 DEBUG [cloud.resource.ResourceManagerImpl] >>>> > > > (http-8080-6:null) Deleting Host: 13 >>>> > > > Guid:5a5efe1c-654b-411c-b4b7-4170ba887716 >>>> > > > 2013-04-08 15:16:56,749 DEBUG [cloud.vm.VirtualMachineManagerImpl] >>>> > > > (http-8080-6:null) Destroying vm VM[ConsoleProxy|v-79-VM] >>>> > > > 2013-04-08 15:16:56,769 DEBUG [cloud.capacity.CapacityManagerImpl] >>>> > > > (http-8080-6:null) VM state transitted from :Running to Stopping >>>> with >>>> > > > event: StopRequestedvm's original host id: 13 new host id: 13 >>>> host id >>>> > > > before state transition: 13 >>>> > > > 2013-04-08 15:16:56,774 WARN [cloud.vm.VirtualMachineManagerImpl] >>>> > > > (http-8080-6:null) Unable to stop vm VM[ConsoleProxy|v-79-VM] >>>> > > > 2013-04-08 15:16:56,778 DEBUG [cloud.capacity.CapacityManagerImpl] >>>> > > > (http-8080-6:null) VM state transitted from :Stopping to Running >>>> with >>>> > > > event: OperationFailedvm's original host id: 13 new host id: 13 >>>> host >>>> > > > id before state transition: 13 >>>> > > > 2013-04-08 15:16:56,778 DEBUG [cloud.vm.VirtualMachineManagerImpl] >>>> > > > (http-8080-6:null) Unable to stop VM[ConsoleProxy|v-79-VM] >>>> > > > 2013-04-08 15:16:56,778 WARN [cloud.resource.ResourceManagerImpl] >>>> > > > (http-8080-6:null) There was an error Destory the vm: >>>> > > > VM[ConsoleProxy|v-79-VM] as a part of hostDelete id=13 >>>> > > > 2013-04-08 15:16:56,778 INFO >>>> [utils.exception.CSExceptionErrorCode] >>>> > > > (http-8080-6:null) Could not find exception: >>>> > > > com.cloud.resource.UnableDeleteHostException in error code list >>>> for >>>> > > > exceptions >>>> > > > 2013-04-08 15:16:56,778 DEBUG [cloud.resource.ResourceManagerImpl] >>>> > > > (http-8080-6:null) There was an error Destory the vm: >>>> > > > VM[ConsoleProxy|v-79-VM] as a part of hostDelete id=13 >>>> > > > com.cloud.resource.UnableDeleteHostException: There was an error >>>> > > > Destory the vm: VM[ConsoleProxy|v-79-VM] as a part of hostDelete >>>> id=13 >>>> > > > at >>>> > > > >>>> > > > >>>> > > >>>> > >>>> com.cloud.resource.ResourceManagerImpl.deleteRoutingHost(ResourceManagerImpl.java:1800) >>>> > > > at >>>> > > > >>>> > > > >>>> > > >>>> > >>>> com.cloud.hypervisor.xen.discoverer.XcpServerDiscoverer.deleteHost(XcpServerDiscoverer.java:701) >>>> > > > at >>>> > > > >>>> > > > >>>> > > >>>> > >>>> com.cloud.resource.ResourceManagerImpl.dispatchToStateAdapters(ResourceManagerImpl.java:1387) >>>> > > > at >>>> > > > >>>> > > > >>>> > > >>>> > >>>> com.cloud.resource.ResourceManagerImpl.doDeleteHost(ResourceManagerImpl.java:766) >>>> > > > at >>>> > > > >>>> com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34) >>>> > > > at >>>> > > > >>>> > > > >>>> > > >>>> > >>>> com.cloud.resource.ResourceManagerImpl.deleteHost(ResourceManagerImpl.java:847) >>>> > > > at >>>> > > > >>>> com.cloud.api.commands.DeleteHostCmd.execute(DeleteHostCmd.java:82) >>>> > > > at >>>> com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:138) >>>> > > > at >>>> com.cloud.api.ApiServer.queueCommand(ApiServer.java:544) >>>> > > > at >>>> com.cloud.api.ApiServer.handleRequest(ApiServer.java:423) >>>> > > > at >>>> com.cloud.api.ApiServlet.processRequest(ApiServlet.java:312) >>>> > > > at com.cloud.api.ApiServlet.doGet(ApiServlet.java:64) >>>> > > > at >>>> javax.servlet.http.HttpServlet.service(HttpServlet.java:617) >>>> > > > at >>>> javax.servlet.http.HttpServlet.service(HttpServlet.java:717) >>>> > > > at >>>> > > > >>>> > > > >>>> > > >>>> > >>>> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) >>>> > > > at >>>> > > > >>>> > > > >>>> > > >>>> > >>>> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) >>>> > > > at >>>> > > > >>>> > > > >>>> > > >>>> > >>>> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) >>>> > > > at >>>> > > > >>>> > > > >>>> > > >>>> > >>>> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) >>>> > > > at >>>> > > > >>>> > > > >>>> > > >>>> > >>>> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) >>>> > > > at >>>> > > > >>>> > > > >>>> > > >>>> > >>>> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) >>>> > > > at >>>> > > > >>>> > >>>> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555) >>>> > > > at >>>> > > > >>>> > > > >>>> > > >>>> > >>>> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) >>>> > > > at >>>> > > > >>>> > > >>>> > >>>> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298) >>>> > > > at >>>> > > > >>>> > > >>>> > >>>> org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857) >>>> > > > at >>>> > > > >>>> > > > >>>> > > >>>> > >>>> org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588) >>>> > > > at >>>> > > > >>>> org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489) >>>> > > > at java.lang.Thread.run(Thread.java:679) >>>> > > > 2013-04-08 15:16:56,779 INFO >>>> [utils.exception.CSExceptionErrorCode] >>>> > > > (http-8080-6:null) Could not find exception: >>>> > > > com.cloud.resource.UnableDeleteHostException in error code list >>>> for >>>> > > > exceptions >>>> > > > 2013-04-08 15:16:56,779 DEBUG [cloud.resource.ResourceManagerImpl] >>>> > > > (http-8080-6:null) Adapter XCP Agent says unable to delete host >>>> > > > com.cloud.resource.UnableDeleteHostException: There was an error >>>> > > > Destory the vm: VM[ConsoleProxy|v-79-VM] as a part of hostDelete >>>> > > > id=13,There was an error Destory the vm: VM[ConsoleProxy|v-79-VM] >>>> as a >>>> > > > part of hostDelete >>>> > > > id=13 >>>> > > > at >>>> > > > >>>> > > > >>>> > > >>>> > >>>> com.cloud.resource.ResourceManagerImpl.deleteRoutingHost(ResourceManagerImpl.java:1805) >>>> > > > at >>>> > > > >>>> > > > >>>> > > >>>> > >>>> com.cloud.hypervisor.xen.discoverer.XcpServerDiscoverer.deleteHost(XcpServerDiscoverer.java:701) >>>> > > > at >>>> > > > >>>> > > > >>>> > > >>>> > >>>> com.cloud.resource.ResourceManagerImpl.dispatchToStateAdapters(ResourceManagerImpl.java:1387) >>>> > > > at >>>> > > > >>>> > > > >>>> > > >>>> > >>>> com.cloud.resource.ResourceManagerImpl.doDeleteHost(ResourceManagerImpl.java:766) >>>> > > > at >>>> > > > >>>> com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34) >>>> > > > at >>>> > > > >>>> > > > >>>> > > >>>> > >>>> com.cloud.resource.ResourceManagerImpl.deleteHost(ResourceManagerImpl.java:847) >>>> > > > at >>>> > > > >>>> com.cloud.api.commands.DeleteHostCmd.execute(DeleteHostCmd.java:82) >>>> > > > at >>>> com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:138) >>>> > > > at >>>> com.cloud.api.ApiServer.queueCommand(ApiServer.java:544) >>>> > > > at >>>> com.cloud.api.ApiServer.handleRequest(ApiServer.java:423) >>>> > > > at >>>> com.cloud.api.ApiServlet.processRequest(ApiServlet.java:312) >>>> > > > at com.cloud.api.ApiServlet.doGet(ApiServlet.java:64) >>>> > > > at >>>> javax.servlet.http.HttpServlet.service(HttpServlet.java:617) >>>> > > > at >>>> javax.servlet.http.HttpServlet.service(HttpServlet.java:717) >>>> > > > at >>>> > > > >>>> > > > >>>> > > >>>> > >>>> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) >>>> > > > at >>>> > > > >>>> > > > >>>> > > >>>> > >>>> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) >>>> > > > at >>>> > > > >>>> > > > >>>> > > >>>> > >>>> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) >>>> > > > at >>>> > > > >>>> > > > >>>> > > >>>> > >>>> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) >>>> > > > at >>>> > > > >>>> > > > >>>> > > >>>> > >>>> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) >>>> > > > at >>>> > > > >>>> > > > >>>> > > >>>> > >>>> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) >>>> > > > at >>>> > > > >>>> > >>>> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555) >>>> > > > at >>>> > > > >>>> > > > >>>> > > >>>> > >>>> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) >>>> > > > at >>>> > > > >>>> > > >>>> > >>>> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298) >>>> > > > at >>>> > > > >>>> > > >>>> > >>>> org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857) >>>> > > > at >>>> > > > >>>> > > > >>>> > > >>>> > >>>> org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588) >>>> > > > at >>>> > > > >>>> org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489) >>>> > > > at java.lang.Thread.run(Thread.java:679) >>>> > > > 2013-04-08 15:16:56,779 DEBUG [cloud.resource.ResourceManagerImpl] >>>> > > > (http-8080-6:null) Dispatching resource state event DELETE_HOST to >>>> > > > OvmDiscoverer$$EnhancerByCGLIB$$abfe93d0 >>>> > > > 2013-04-08 15:16:56,779 DEBUG [cloud.resource.ResourceManagerImpl] >>>> > > > (http-8080-6:null) Dispatching resource state event DELETE_HOST to >>>> > > > NetworkUsageManagerImpl$$EnhancerByCGLIB$$34a46271 >>>> > > > 2013-04-08 15:16:56,779 DEBUG [cloud.resource.ResourceManagerImpl] >>>> > > > (http-8080-6:null) Dispatching resource state event DELETE_HOST to >>>> > > > ExternalDhcpManagerImpl$$EnhancerByCGLIB$$7ded4baf >>>> > > > 2013-04-08 15:16:56,779 DEBUG [cloud.resource.ResourceManagerImpl] >>>> > > > (http-8080-6:null) Dispatching resource state event DELETE_HOST to >>>> > > > NiciraNvpElement$$EnhancerByCGLIB$$a2b35039 >>>> > > > 2013-04-08 15:16:56,779 DEBUG [cloud.resource.ResourceManagerImpl] >>>> > > > (http-8080-6:null) Dispatching resource state event DELETE_HOST to >>>> > > > BareMetalDiscoverer$$EnhancerByCGLIB$$9ca73829 >>>> > > > 2013-04-08 15:16:56,779 DEBUG [cloud.resource.ResourceManagerImpl] >>>> > > > (http-8080-6:null) Dispatching resource state event DELETE_HOST to >>>> > > > PxeServerManagerImpl$$EnhancerByCGLIB$$28d62ea9 >>>> > > > 2013-04-08 15:16:56,779 ERROR [cloud.api.ApiDispatcher] >>>> > > > (http-8080-6:null) Exception while executing DeleteHostCmd: >>>> > > > com.cloud.utils.exception.CloudRuntimeException: No resource >>>> adapter >>>> > > > respond to DELETE_HOST event for qtwstratus1 id = 13, >>>> hypervisorType >>>> > > > is XenServer, host type is Routing >>>> > > > at >>>> > > > >>>> > > > >>>> > > >>>> > >>>> com.cloud.resource.ResourceManagerImpl.doDeleteHost(ResourceManagerImpl.java:769) >>>> > > > at >>>> > > > >>>> com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34) >>>> > > > at >>>> > > > >>>> > > > >>>> > > >>>> > >>>> com.cloud.resource.ResourceManagerImpl.deleteHost(ResourceManagerImpl.java:847) >>>> > > > at >>>> > > > >>>> com.cloud.api.commands.DeleteHostCmd.execute(DeleteHostCmd.java:82) >>>> > > > at >>>> com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:138) >>>> > > > at >>>> com.cloud.api.ApiServer.queueCommand(ApiServer.java:544) >>>> > > > at >>>> com.cloud.api.ApiServer.handleRequest(ApiServer.java:423) >>>> > > > at >>>> com.cloud.api.ApiServlet.processRequest(ApiServlet.java:312) >>>> > > > at com.cloud.api.ApiServlet.doGet(ApiServlet.java:64) >>>> > > > at >>>> javax.servlet.http.HttpServlet.service(HttpServlet.java:617) >>>> > > > at >>>> javax.servlet.http.HttpServlet.service(HttpServlet.java:717) >>>> > > > at >>>> > > > >>>> > > > >>>> > > >>>> > >>>> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) >>>> > > > at >>>> > > > >>>> > > > >>>> > > >>>> > >>>> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) >>>> > > > at >>>> > > > >>>> > > > >>>> > > >>>> > >>>> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) >>>> > > > at >>>> > > > >>>> > > > >>>> > > >>>> > >>>> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) >>>> > > > at >>>> > > > >>>> > > > >>>> > > >>>> > >>>> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) >>>> > > > at >>>> > > > >>>> > > > >>>> > > >>>> > >>>> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) >>>> > > > at >>>> > > > >>>> > >>>> org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555) >>>> > > > at >>>> > > > >>>> > > > >>>> > > >>>> > >>>> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) >>>> > > > at >>>> > > > >>>> > > >>>> > >>>> org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298) >>>> > > > at >>>> > > > >>>> > > >>>> > >>>> org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857) >>>> > > > at >>>> > > > >>>> > > > >>>> > > >>>> > >>>> org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588) >>>> > > > at >>>> > > > >>>> org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489) >>>> > > > at java.lang.Thread.run(Thread.java:679) >>>> > > > 2013-04-08 15:16:56,781 DEBUG [cloud.api.ApiServlet] >>>> > > > (http-8080-6:null) ===END=== <client_ip> -- GET >>>> > > > >>>> > > > >>>> > > > >>>> > > >>>> > >>>> command=deleteHost&id=40ec48c4-697e-4498-bd3d-f9dd77566f45&forced=false&response=json&sessionkey=7hKixOBlpz0f9%2BRGLFvdx%2B1snRE%3D&_=1365448764976 >>>> > > > >>>> > > This email and any attachments to it may be confidential and are >>>> intended >>>> > > solely for the use of the individual to whom it is addressed. Any >>>> views >>>> > or >>>> > > opinions expressed are solely those of the author and do not >>>> necessarily >>>> > > represent those of Shape Blue Ltd or related companies. If you are >>>> not >>>> > the >>>> > > intended recipient of this email, you must neither take any action >>>> based >>>> > > upon its contents, nor copy or show it to anyone. Please contact the >>>> > sender >>>> > > if you believe you have received this email in error. Shape Blue >>>> Ltd is a >>>> > > company incorporated in England & Wales. ShapeBlue Services India >>>> LLP is >>>> > > operated under license from Shape Blue Ltd. ShapeBlue is a >>>> registered >>>> > > trademark. >>>> > > >>>> > > >>>> > >>>> > >>>> > -- >>>> > Regards, >>>> > >>>> > Kirk Jantzer >>>> > c: (678) 561-5475 >>>> > >>>> >>> >>> >>> >>> -- >>> Regards, >>> >>> Kirk Jantzer >>> c: (678) 561-5475 >>> >> >> >> >> -- >> Regards, >> >> Kirk Jantzer >> c: (678) 561-5475 >> > > > > -- > Regards, > > Kirk Jantzer > c: (678) 561-5475 > -- Regards, Kirk Jantzer c: (678) 561-5475