Hi all, I re-installed the CS 4.0 server After re-install, the SSVMs took too long to get created so I deleted their entries from vm_instance table, so that CS restarts its creation. However, I ended up with - com.cloud.exception.InsufficientAddressCapacityException
I am not able to understand where all the management IP addresses are getting used up. I have given public IP range of 6 IPs, but all get used up. THey are not getting freed up. Below is the log trace: 2013-07-17 08:54:34,537 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Network id=201 is already implemented 2013-07-17 08:54:34,537 DEBUG [cloud.network.NetworkManagerImpl] (consoleproxy-1:null) Lock is released for network id 201 as a part of network implement 2013-07-17 08:54:34,561 DEBUG [db.Transaction.Transaction] (consoleproxy-1:null) Rolling back the transaction: Time = 1 Name = -SystemVmLoadScanner$1.run:71-Executors$ RunnableAdapter.call:471-FutureTask$Sync.innerRunAndReset:351-FutureTask.runAndReset:178-ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301:178-ScheduledThreadP oolExecutor$ScheduledFutureTask.run:293-ThreadPoolExecutor.runWorker:1110-ThreadPoolExecutor$Worker.run:603-Thread.run:722; called by -Transaction.rollback:887-DataCent erIpAddressDaoImpl.takeIpAddress:57-DatabaseCallback.intercept:34-DataCenterDaoImpl.allocatePrivateIpAddress:228-DatabaseCallback.intercept:34-PodBasedNetworkGuru.reser ve:119-NetworkManagerImpl.prepareNic:2143-NetworkManagerImpl.prepare:2113-VirtualMachineManagerImpl.advanceStart:752-VirtualMachineManagerImpl.start:472-VirtualMachineM anagerImpl.start:465-ConsoleProxyManagerImpl.startProxy:627 2013-07-17 08:54:34,561 INFO [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Insufficient capacity com.cloud.exception.InsufficientAddressCapacityException: Unable to get a management ip addressScope=interface com.cloud.dc.Pod; id=1 at com.cloud.network.guru.PodBasedNetworkGuru.reserve(PodBasedNetworkGuru.java:121) at com.cloud.network.NetworkManagerImpl.prepareNic(NetworkManagerImpl.java:2143) at com.cloud.network.NetworkManagerImpl.prepare(NetworkManagerImpl.java:2113) at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:752) at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:472) at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:465) at com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:627) at com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:1164) at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1981) at com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:173) at com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:113) at com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:34) at com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:83) at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:73) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:722) 2013-07-17 08:54:34,567 DEBUG [cloud.vm.VirtualMachineManagerImpl] (consoleproxy-1:null) Cleaning up resources for the vm VM[ConsoleProxy|v-6-VM] in Starting state 2013-07-17 08:54:34,570 DEBUG [agent.transport.Request] (consoleproxy-1:null) Seq 1-678428690: Waiting for Seq 678428689 Scheduling: { Cmd , MgmtId: 345051758635, via: 1, Ver: v1, Flags: 100111, [{"StopCommand":{"isProxy":false,"vmName":"v-6-VM","wait":0}}] } 2013-07-17 08:54:34,712 INFO [vmware.resource.VmwareResource] (DirectAgent-33:torvms04lx.sigmasys.net) VM s-8-VM is no longer in vSphere 2013-07-17 08:54:34,713 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-33:null) Seq 1-678428689: Response Received: 2013-07-17 08:54:34,713 DEBUG [agent.transport.Request] (DirectAgent-33:null) Seq 1-678428689: Processing: { Ans: , MgmtId: 345051758635, via: 1, Ver: v1, Flags: 110, [{"StopAnswer":{"vncPort":0,"result":true,"details":"VM s-8-VM is no longer in vSphere","wait":0}}] } 2013-07-17 08:54:34,714 DEBUG [agent.transport.Request] (secstorage-1:null) Seq 1-678428689: Received: { Ans: , MgmtId: 345051758635, via: 1, Ver: v1, Flags: 110, { St opAnswer } } 2013-07-17 08:54:34,714 DEBUG [agent.manager.AgentAttache] (DirectAgent-33:null) Seq 1-678428690: Sending now. is current sequence. : Regards, Asmita.