[ https://issues.apache.org/jira/browse/CLOUDSTACK-5774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Animesh Chaturvedi resolved CLOUDSTACK-5774. -------------------------------------------- Resolution: Cannot Reproduce > [Automation] VPCChecker failed to delete the VPC VR's Volume due to NPE > ----------------------------------------------------------------------- > > Key: CLOUDSTACK-5774 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-5774 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) > Components: Management Server > Affects Versions: 4.3.0 > Reporter: Chandan Purushothama > Assignee: Chandan Purushothama > Priority: Critical > Fix For: 4.3.0 > > > ================== > NullPointer Exception: > ================== > 2014-01-04 00:47:14,661 INFO [c.c.n.v.VpcManagerImpl] > (VpcChecker-1:ctx-4daa3c04) Found 1 removed VPCs to cleanup > 2014-01-04 00:47:14,662 DEBUG [c.c.n.v.VpcManagerImpl] > (VpcChecker-1:ctx-4daa3c04) Cleaning up [VPC [5-TestVPC-G9J5FX] > 2014-01-04 00:47:14,665 DEBUG [c.c.n.v.VpcManagerImpl] > (VpcChecker-1:ctx-4daa3c04) Destroying vpc [VPC [5-TestVPC-G9J5FX] > 2014-01-04 00:47:14,668 DEBUG [c.c.n.v.VpcManagerImpl] > (VpcChecker-1:ctx-4daa3c04) Shutting down vpc [VPC [5-TestVPC-G9J5FX] > 2014-01-04 00:47:14,677 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] > (VpcChecker-1:ctx-4daa3c04) Attempting to destroy router 77 > 2014-01-04 00:47:14,682 DEBUG [c.c.v.VirtualMachineManagerImpl] > (VpcChecker-1:ctx-4daa3c04) Stopped called on VM[DomainRouter|r-77-QA] but > the state is Expunging > 2014-01-04 00:47:14,684 DEBUG [c.c.c.CapacityManagerImpl] > (VpcChecker-1:ctx-4daa3c04) VM state transitted from :Expunging to Expunging > with event: ExpungeOperationvm's original host id: 1 new host id: 2 host id > before state transition: 2 > 2014-01-04 00:47:14,684 DEBUG [c.c.v.VirtualMachineManagerImpl] > (VpcChecker-1:ctx-4daa3c04) Destroying vm VM[DomainRouter|r-77-QA] > 2014-01-04 00:47:14,685 DEBUG [c.c.v.VirtualMachineManagerImpl] > (VpcChecker-1:ctx-4daa3c04) Cleaning up NICS > 2014-01-04 00:47:14,685 DEBUG [o.a.c.e.o.NetworkOrchestrator] > (VpcChecker-1:ctx-4daa3c04) Cleaning network for vm: 77 > 2014-01-04 00:47:14,686 DEBUG [c.c.v.VirtualMachineManagerImpl] > (VpcChecker-1:ctx-4daa3c04) Cleaning up hypervisor data structures (ex. SRs > in XenServer) for managed storage > 2014-01-04 00:47:14,688 DEBUG [c.c.a.m.DirectAgentAttache] > (DirectAgent-250:ctx-1c5db065) Seq 2-1933902599: Response Received: > 2014-01-04 00:47:14,689 DEBUG [c.c.a.t.Request] > (DirectAgent-250:ctx-1c5db065) Seq 2-1933902599: Processing: { Ans: , > MgmtId: 6631563722783, via: 2, Ver: v1, Flags: 10, > [{"com.cloud.agent.api.NetworkUsageAnswer":{"routerName":"r-13-QA","bytesSent":1440,"bytesReceived":0,"result":true,"details":"","wait":0}}] > } > 2014-01-04 00:47:14,689 DEBUG [c.c.a.t.Request] > (RouterMonitor-1:ctx-83046987) Seq 2-1933902599: Received: { Ans: , MgmtId: > 6631563722783, via: 2, Ver: v1, Flags: 10, { NetworkUsageAnswer } } > 2014-01-04 00:47:14,689 DEBUG [c.c.a.m.AgentManagerImpl] > (RouterMonitor-1:ctx-83046987) Details from executing class > com.cloud.agent.api.NetworkUsageCommand: > 2014-01-04 00:47:14,708 DEBUG [c.c.a.m.DirectAgentAttache] > (DirectAgent-146:ctx-4ab2a172) Seq 2-1933902600: Response Received: > 2014-01-04 00:47:14,709 DEBUG [c.c.a.t.Request] > (DirectAgent-146:ctx-4ab2a172) Seq 2-1933902600: Processing: { Ans: , > MgmtId: 6631563722783, via: 2, Ver: v1, Flags: 10, > [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}}] } > 2014-01-04 00:47:14,709 DEBUG [c.c.a.t.Request] > (AccountChecker-1:ctx-3dd8fde4) Seq 2-1933902600: Received: { Ans: , MgmtId: > 6631563722783, via: 2, Ver: v1, Flags: 10, { Answer } } > 2014-01-04 00:47:14,719 DEBUG [o.a.c.e.o.VolumeOrchestrator] > (VpcChecker-1:ctx-4daa3c04) Cleaning storage for vm: 77 > 2014-01-04 00:47:14,724 DEBUG [o.a.c.e.o.VolumeOrchestrator] > (VpcChecker-1:ctx-4daa3c04) Skipping destroy for the volume > Vol[83|vm=77|ROOT] as its in state Expunged > 2014-01-04 00:47:14,730 INFO [o.a.c.s.v.VolumeServiceImpl] > (AccountChecker-1:ctx-3dd8fde4) Volume 83 is not referred anywhere, remove it > from volumes table > 2014-01-04 00:47:14,751 DEBUG [c.c.v.VirtualMachineManagerImpl] > (AccountChecker-1:ctx-3dd8fde4) Expunged VM[DomainRouter|r-77-QA] > 2014-01-04 00:47:14,753 DEBUG [c.c.a.m.DirectAgentAttache] > (DirectAgent-154:ctx-9dc1ad33) Seq 2-1933902601: Executing request > 2014-01-04 00:47:14,779 DEBUG [c.c.n.v.VpcManagerImpl] > (AccountChecker-1:ctx-3dd8fde4) Vpc [VPC [5-TestVPC-G9J5FX] has been shutdown > succesfully > 2014-01-04 00:47:14,779 DEBUG [c.c.n.v.VpcManagerImpl] > (AccountChecker-1:ctx-3dd8fde4) Cleaning up resources for vpc id=5 > 2014-01-04 00:47:14,779 DEBUG [c.c.n.v.VpcManagerImpl] > (AccountChecker-1:ctx-3dd8fde4) Cleaning up existed site to site VPN > connections > 2014-01-04 00:47:14,786 DEBUG [c.c.n.v.VpcManagerImpl] > (AccountChecker-1:ctx-3dd8fde4) Cleaning up existed site to site VPN gateways > 2014-01-04 00:47:14,793 DEBUG [c.c.n.v.VpcManagerImpl] > (AccountChecker-1:ctx-3dd8fde4) Releasing ips for vpc id=5 as a part of vpc > cleanup > 2014-01-04 00:47:14,797 DEBUG [c.c.n.IpAddressManagerImpl] > (AccountChecker-1:ctx-3dd8fde4) Revoking all Firewallrules as a part of > public IP id=29 release... > 2014-01-04 00:47:14,817 DEBUG [c.c.n.f.FirewallManagerImpl] > (AccountChecker-1:ctx-3dd8fde4) Releasing 0 firewall rules for ip id=29 > 2014-01-04 00:47:14,821 DEBUG [c.c.n.f.FirewallManagerImpl] > (AccountChecker-1:ctx-3dd8fde4) There are no firewall rules to apply > 2014-01-04 00:47:14,827 DEBUG [c.c.s.s.SnapshotSchedulerImpl] > (SnapshotPollTask:ctx-aa249df6) Snapshot scheduler.poll is being called at > 2014-01-03 19:17:14 GMT > 2014-01-04 00:47:14,830 DEBUG [c.c.n.f.FirewallManagerImpl] > (AccountChecker-1:ctx-3dd8fde4) Successfully released firewall rules for ip > id=29 and # of rules now = 0 > 2014-01-04 00:47:14,831 DEBUG [c.c.u.d.T.Transaction] > (VpcChecker-1:ctx-4daa3c04) Rolling back the transaction: Time = 166 Name = > VpcChecker-1; called by > -TransactionLegacy.rollback:896-TransactionLegacy.removeUpTo:839-TransactionLegacy.close:663-Transaction.execute:41-VpcManagerImpl$VpcCleanupTask.runInContext:1991-ManagedContextRunnable$1.run:49-DefaultManagedContext$1.call:56-DefaultManagedContext.callWithContext:103-DefaultManagedContext.runWithContext:53-ManagedContextRunnable.run:46-Executors$RunnableAdapter.call:471-FutureTask$Sync.innerRunAndReset:351 > 2014-01-04 00:47:14,834 DEBUG [c.c.s.s.SnapshotSchedulerImpl] > (SnapshotPollTask:ctx-aa249df6) Got 0 snapshots to be executed at 2014-01-03 > 19:17:14 GMT > 2014-01-04 00:47:14,834 DEBUG [c.c.s.s.SnapshotSchedulerImpl] > (SnapshotPollTask:ctx-aa249df6) Got 0 snapshots to be executed at 2014-01-03 > 19:17:14 GMT > 2014-01-04 00:47:14,840 ERROR [c.c.n.v.VpcManagerImpl] > (VpcChecker-1:ctx-4daa3c04) Exception > java.lang.NullPointerException > at > org.apache.cloudstack.storage.volume.VolumeObject.getUuid(VolumeObject.java:113) > at > org.apache.cloudstack.storage.to.VolumeObjectTO.<init>(VolumeObjectTO.java:54) > at > org.apache.cloudstack.storage.volume.VolumeObject.getTO(VolumeObject.java:483) > at > org.apache.cloudstack.storage.datastore.driver.CloudStackPrimaryDataStoreDriverImpl.deleteAsync(CloudStackPrimaryDataStoreDriverImpl.java:179) > at > org.apache.cloudstack.storage.volume.VolumeServiceImpl.expungeVolumeAsync(VolumeServiceImpl.java:317) > at > org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.cleanupVolumes(VolumeOrchestrator.java:835) > at > com.cloud.vm.VirtualMachineManagerImpl.advanceExpunge(VirtualMachineManagerImpl.java:515) > at > com.cloud.vm.VirtualMachineManagerImpl.advanceExpunge(VirtualMachineManagerImpl.java:448) > at > com.cloud.vm.VirtualMachineManagerImpl.expunge(VirtualMachineManagerImpl.java:437) > at > com.cloud.network.router.VirtualNetworkApplianceManagerImpl.destroyRouter(VirtualNetworkApplianceManagerImpl.java:311) > at sun.reflect.GeneratedMethodAccessor566.invoke(Unknown Source) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:616) > at > org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) > at > org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) > at > org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) > at $Proxy240.destroyRouter(Unknown Source) > at > com.cloud.network.element.VpcVirtualRouterElement.shutdownVpc(VpcVirtualRouterElement.java:150) > at > com.cloud.network.vpc.VpcManagerImpl.shutdownVpc(VpcManagerImpl.java:1055) > at > com.cloud.network.vpc.VpcManagerImpl.destroyVpc(VpcManagerImpl.java:769) > at > com.cloud.network.vpc.VpcManagerImpl$VpcCleanupTask$1.doInTransactionWithoutResult(VpcManagerImpl.java:1999) > at > com.cloud.utils.db.TransactionCallbackWithExceptionNoReturn.doInTransaction(TransactionCallbackWithExceptionNoReturn.java:25) > at > com.cloud.utils.db.TransactionCallbackWithExceptionNoReturn.doInTransaction(TransactionCallbackWithExceptionNoReturn.java:21) > at com.cloud.utils.db.Transaction.execute(Transaction.java:37) > at > com.cloud.network.vpc.VpcManagerImpl$VpcCleanupTask.runInContext(VpcManagerImpl.java:1991) > at > org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) > at > org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at > java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351) > at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) > at java.lang.Thread.run(Thread.java:679) > 2014-01-04 00:47:14,847 DEBUG [c.c.n.IpAddressManagerImpl] > (AccountChecker-1:ctx-3dd8fde4) Revoking all PortForwarding/StaticNat rules > as a part of public IP id=29 release... -- This message was sent by Atlassian JIRA (v6.1.5#6160)