Amogh Vasekar created CLOUDSTACK-7357: -----------------------------------------
Summary: CLONE - [Automation] Failed to stop VPC router with NPE Key: CLOUDSTACK-7357 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-7357 Project: CloudStack Issue Type: Bug Security Level: Public (Anyone can view this level - this is the default.) Components: Virtual Router Affects Versions: 4.5.0 Reporter: Amogh Vasekar Assignee: Amogh Vasekar Priority: Blocker Fix For: 4.5.0 There are many VPC router stop cases failing in automation runs, VPC router stop fails with below NPE 2014-08-08 10:30:01,087 DEBUG [c.c.n.v.NetworkACLManagerImpl] (AccountChecker-1:ctx-13aaf529) Applying NetworkACL for network: 369 with Network ACL service provider 2014-08-08 10:30:01,090 DEBUG [c.c.n.e.VpcVirtualRouterElement] (AccountChecker-1:ctx-13aaf529) Virtual router elemnt doesn't need to apply firewall rules on the backend; virtual router doesn't exist in the network 369 2014-08-08 10:30:01,091 DEBUG [c.c.n.v.NetworkACLManagerImpl] (AccountChecker-1:ctx-13aaf529) Successfully released Network ACLs for network id=369 and # of rules now = 3 2014-08-08 10:30:01,092 DEBUG [c.c.n.r.RulesManagerImpl] (AccountChecker-1:ctx-13aaf529) Found 0 static nat rules to apply for network id 369 2014-08-08 10:30:01,098 DEBUG [c.c.n.e.VpcVirtualRouterElement] (AccountChecker-1:ctx-13aaf529) VpcVirtualRouter element doesn't need to associate ip addresses on the backend; VPC virtual router doesn't exist in the network 369 2014-08-08 10:30:01,099 DEBUG [o.a.c.e.o.NetworkOrchestrator] (AccountChecker-1:ctx-13aaf529) Sending network shutdown to VpcVirtualRouter 2014-08-08 10:30:01,110 DEBUG [c.c.n.NetworkModelImpl] (AccountChecker-1:ctx-13aaf529) Service SecurityGroup is not supported in the network id=369 2014-08-08 10:30:01,110 DEBUG [c.c.n.r.VpcVirtualNetworkApplianceManagerImpl] (AccountChecker-1:ctx-13aaf529) Router r-320-VM is in Stopped, so not sending setup guest network command to the backend 2014-08-08 10:30:01,115 WARN [o.a.c.e.o.NetworkOrchestrator] (AccountChecker-1:ctx-13aaf529) Unable to complete shutdown of the network elements due to element: VpcVirtualRouter java.lang.NullPointerException at com.cloud.hypervisor.KVMGuru.implement(KVMGuru.java:63) at com.cloud.vm.VirtualMachineManagerImpl.orchestrateRemoveVmFromNetwork(VirtualMachineManagerImpl.java:3024) at com.cloud.vm.VirtualMachineManagerImpl.removeVmFromNetwork(VirtualMachineManagerImpl.java:3009) at com.cloud.network.router.VpcVirtualNetworkApplianceManagerImpl.removeVpcRouterFromGuestNetwork(VpcVirtualNetworkApplianceManagerImpl.java:321) at sun.reflect.GeneratedMethodAccessor280.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) at com.sun.proxy.$Proxy189.removeVpcRouterFromGuestNetwork(Unknown Source) at com.cloud.network.element.VpcVirtualRouterElement.shutdown(VpcVirtualRouterElement.java:261) at org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.shutdownNetworkElementsAndResources(NetworkOrchestrator.java:2142) at org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.shutdownNetwork(NetworkOrchestrator.java:2044) at org.apache.cloudstack.engine.orchestration.NetworkOrchestrator.destroyNetwork(NetworkOrchestrator.java:2202) at com.cloud.user.AccountManagerImpl.cleanupAccount(AccountManagerImpl.java:793) at com.cloud.user.AccountManagerImpl$AccountCleanupTask.runInContext(AccountManagerImpl.java:1675) at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744) 2014-08-08 10:30:01,121 DEBUG [o.a.c.e.o.NetworkOrchestrator] (AccountChecker-1:ctx-13aaf529) Lock is released for network Ntwk[369|Guest|102] as a part of network shutdown 2014-08-08 10:30:01,122 DEBUG [o.a.c.e.o.NetworkOrchestrator] (AccountChecker-1:ctx-13aaf529) Network is not not in the correct state to be destroyed: Shutdown 2014-08-08 10:30:01,122 WARN [c.c.u.AccountManagerImpl] (AccountChecker-1:ctx-13aaf529) Unable to destroy network Ntwk[369|Guest|102] as a part of account id=231 cleanup. 2014-08-08 10:30:01,127 DEBUG [o.a.c.e.o.NetworkOrchestrator] (AccountChecker-1:ctx-13aaf529) Lock is acquired for network Ntwk[370|Guest|103] as a part of network shutdown 2014-08-08 10:30:01,131 DEBUG [o.a.c.e.o.NetworkOrchestrator] (AccountChecker-1:ctx-13aaf529) Releasing 0 port forwarding rules for network id=370 as a part of shutdownNetworkRules 2014-08-08 10:30:01,131 DEBUG [c.c.n.f.FirewallManagerImpl] (AccountChecker-1:ctx-13aaf529) There are no rules to forward to the network elements 2014-08-08 10:30:01,132 DEBUG [o.a.c.e.o.NetworkOrchestrator] (AccountChecker-1:ctx-13aaf529) Releasing 0 static nat rules for network id=370 as a part of shutdownNetworkRules 2014-08-08 10:30:01,132 DEBUG [c.c.n.f.FirewallManagerImpl] (AccountChecker-1:ctx-13aaf529) There are no rules to forward to the network elements -- This message was sent by Atlassian JIRA (v6.2#6252)