Sailaja Mada created CLOUDSTACK-1572:
----------------------------------------
Summary: createVPC failed with NPE
Key: CLOUDSTACK-1572
URL: https://issues.apache.org/jira/browse/CLOUDSTACK-1572
Project: CloudStack
Issue Type: Bug
Security Level: Public (Anyone can view this level - this is the default.)
Components: Management Server, Network Controller
Affects Versions: 4.2.0
Reporter: Sailaja Mada
Priority: Critical
Setup: Advanced Networking Zone
Steps :
1.Configure Advanced Networking zone
2. Tried to create VPC after system VM's are up & running.
Observed NPE with createVPC:
2013-03-07 13:07:03,316 DEBUG [agent.transport.Request]
(AgentManager-Handler-7:null) Seq 1-2123431998: Processing: { Ans: , MgmtId:
15875056796715, via: 1, Ver: v1, Flags: 110,
[{"StartAnswer":{"vm":{"id":3,"name":"r-3-VM","type":"DomainRouter","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":134217728,"maxRam":134217728,"arch":"x86_64","os":"Debian
GNU/Linux 5.0 (32-bit)","bootArgs":" vpccidr=10.0.0.0/00
domain=cs2cloud.internal dns1=10.103.128.15 template=domP name=r-3-VM
eth0ip=169.254.0.53 eth0mask=255.255.0.0 type=vpcrouter
disable_rp_filter=true","rebootOnCrash":false,"enableHA":true,"limitCpuUse":false,"vncPassword":"cf224b0cb00b26ae","vncAddr":"10.102.192.56","params":{},"uuid":"c85f2862-4ce3-4b6b-a846-d464d18dfe0c","disks":[{"id":3,"name":"ROOT-3","mountPoint":"/cpg_vol/sailaja/primary","path":"21eee851-2a18-4301-9304-deb822178ff2","size":725811200,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"7ed32481-a250-3a10-99ad-cec3de564f7a","deviceId":0}],"nics":[{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"95f559ab-2ee3-4607-b87d-43aa133f57d9","ip":"169.254.0.53","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:00:35","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false}]},"result":true,"wait":0}},{"check.CheckSshAnswer":{"result":true,"wait":0}},{"GetDomRVersionAnswer":{"templateVersion":"Cloudstack
Release 3.0 Mon Feb 6 15:10:04 PST
2012","scriptsVersion":"62601dc25e9daab45149b6040b04d107","result":true,"details":"Cloudstack
Release 3.0 Mon Feb 6 15:10:04 PST
2012&62601dc25e9daab45149b6040b04d107","wait":0}},{"NetworkUsageAnswer":{"routerName":"r-3-VM","bytesSent":0,"bytesReceived":0,"result":true,"wait":0}},{"PlugNicAnswer":{"result":true,"details":"success","wait":0}},{"routing.IpAssocAnswer":{"results":["10.102.197.225
-
success"],"result":true,"wait":0}},{"routing.SetSourceNatAnswer":{"result":true,"details":"success","wait":0}},{"NetworkUsageAnswer":{"routerName":"r-3-VM","bytesSent":0,"bytesReceived":0,"result":true,"wait":0}}]
}
2013-03-07 13:07:03,316 DEBUG [agent.transport.Request]
(Job-Executor-11:job-11) Seq 1-2123431998: Received: { Ans: , MgmtId:
15875056796715, via: 1, Ver: v1, Flags: 110, { StartAnswer, CheckSshAnswer,
GetDomRVersionAnswer, NetworkUsageAnswer, PlugNicAnswer, IpAssocAnswer,
SetSourceNatAnswer, NetworkUsageAnswer } }
2013-03-07 13:07:03,319 DEBUG [agent.manager.AgentAttache]
(AgentManager-Handler-7:null) Seq 1-2123431998: No more commands found
2013-03-07 13:07:03,358 DEBUG [cloud.capacity.CapacityManagerImpl]
(Job-Executor-11:job-11) VM state transitted from :Starting to Running with
event: OperationSucceededvm's original host id: 1 new host id: 1 host id before
state transition: 1
2013-03-07 13:07:03,358 DEBUG [cloud.vm.VirtualMachineManagerImpl]
(Job-Executor-11:job-11) Start completed for VM VM[DomainRouter|r-3-VM]
2013-03-07 13:07:03,365 DEBUG [network.vpc.VpcManagerImpl]
(Job-Executor-11:job-11) Vpc [VPC [1-VPC1] has started succesfully
2013-03-07 13:07:03,365 WARN [network.vpc.VpcManagerImpl]
(Job-Executor-11:job-11) Failed to start vpc [VPC [1-VPC1] due to
java.lang.NullPointerException
at
com.cloud.network.vpc.VpcManagerImpl.startVpc(VpcManagerImpl.java:971)
at
com.cloud.network.vpc.VpcManagerImpl.startVpc(VpcManagerImpl.java:944)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:319)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at
org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:80)
at
com.cloud.utils.db.TransactionContextBuilder.AroundAnyMethod(TransactionContextBuilder.java:40)
at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at
org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:621)
at
org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:610)
at
org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:65)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:90)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:202)
at $Proxy174.startVpc(Unknown Source)
at
org.apache.cloudstack.api.command.user.vpc.CreateVPCCmd.execute(CreateVPCCmd.java:137)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:163)
at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
at
org.springframework.aop.framework.Cglib2AopProxy$CglibMethodInvocation.invokeJoinpoint(Cglib2AopProxy.java:689)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at
org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:80)
at
com.cloud.utils.db.TransactionContextBuilder.AroundAnyMethod(TransactionContextBuilder.java:40)
at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at
org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:621)
at
org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:610)
at
org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:65)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:90)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at
org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:622)
at
com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:437)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
2013-03-07 13:07:03,372 DEBUG [network.vpc.VpcManagerImpl]
(Job-Executor-11:job-11) Destroying vpc [VPC [1-VPC1] that failed to start
2013-03-07 13:07:03,373 DEBUG [network.vpc.VpcManagerImpl]
(Job-Executor-11:job-11) Destroying vpc [VPC [1-VPC1]
2013-03-07 13:07:03,375 DEBUG [network.vpc.VpcManagerImpl]
(Job-Executor-11:job-11) Updating VPC [VPC [1-VPC1] with state Inactive as a
part of vpc delete
2013-03-07 13:07:03,392 DEBUG [network.vpc.VpcManagerImpl]
(Job-Executor-11:job-11) Shutting down vpc [VPC [1-VPC1]
2013-03-07 13:07:03,398 DEBUG
[network.router.VirtualNetworkApplianceManagerImpl] (Job-Executor-11:job-11)
Attempting to destroy router 3
2013-03-07 13:07:03,409 DEBUG [cloud.capacity.CapacityManagerImpl]
(Job-Executor-11:job-11) VM state transitted from :Running to Stopping with
event: StopRequestedvm's original host id: 1 new host id: 1 host id before
state transition: 1
2013-03-07 13:07:08,180 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-11:job-11) Cleaning network for vm: 3
2013-03-07 13:07:08,193 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-11:job-11) Removed nic id=8
2013-03-07 13:07:08,216 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-11:job-11) Removed nic 8 secondary ip addreses
2013-03-07 13:07:08,225 DEBUG [network.guru.PublicNetworkGuru]
(Job-Executor-11:job-11) public network deallocate network: networkId: 200, ip:
10.102.197.225
2013-03-07 13:07:08,227 DEBUG [network.guru.PublicNetworkGuru]
(Job-Executor-11:job-11) Deallocated nic: NicProfile[9-3-null-null-null
2013-03-07 13:07:08,241 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-11:job-11) Removed nic id=9
2013-03-07 13:07:08,242 DEBUG [cloud.network.NetworkManagerImpl]
(Job-Executor-11:job-11) Removed nic 9 secondary ip addreses
2013-03-07 13:07:08,243 DEBUG [cloud.storage.VolumeManagerImpl]
(Job-Executor-11:job-11) Cleaning storage for vm: 3
2013-03-07 13:07:08,287 DEBUG [agent.transport.Request]
(Job-Executor-11:job-11) Seq 1-2123432002: Sending { Cmd , MgmtId:
15875056796715, via: 1, Ver: v1, Flags: 100111,
[{"storage.DestroyCommand":{"volume":{"id":3,"name":"ROOT-3","mountPoint":"/cpg_vol/sailaja/primary","path":"21eee851-2a18-4301-9304-deb822178ff2","size":725811200,"type":"ROOT","storagePoolType":"NetworkFilesystem","storagePoolUuid":"7ed32481-a250-3a10-99ad-cec3de564f7a","deviceId":0},"wait":0}}]
}
2013-03-07 13:07:08,399 DEBUG [agent.transport.Request]
(AgentManager-Handler-12:null) Seq 1-2123432002: Processing: { Ans: , MgmtId:
15875056796715, via: 1, Ver: v1, Flags: 110,
[{"Answer":{"result":false,"details":"java.lang.NullPointerException\n\tat
com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:1467)\n\tat
com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1122)\n\tat
com.cloud.agent.Agent.processRequest(Agent.java:525)\n\tat
com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:852)\n\tat
com.cloud.utils.nio.Task.run(Task.java:83)\n\tat
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)\n\tat
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)\n\tat
java.lang.Thread.run(Thread.java:679)\n","wait":0}}] }
2013-03-07 13:07:08,399 DEBUG [agent.manager.AgentAttache]
(AgentManager-Handler-12:null) Seq 1-2123432002: No more commands found
2013-03-07 13:07:08,400 DEBUG [agent.transport.Request]
(Job-Executor-11:job-11) Seq 1-2123432002: Received: { Ans: , MgmtId:
15875056796715, via: 1, Ver: v1, Flags: 110, { Answer } }
2013-03-07 13:07:08,400 INFO
[datastore.driver.AncientPrimaryDataStoreDriverImpl] (Job-Executor-11:job-11)
Will retry delete of Vol[3|vm=3|ROOT] from 200
2013-03-07 13:07:08,408 DEBUG [cloud.vm.VirtualMachineManagerImpl]
(Job-Executor-11:job-11) Expunged VM[DomainRouter|r-3-VM]
2013-03-07 13:07:08,429 DEBUG [network.vpc.VpcManagerImpl]
(Job-Executor-11:job-11) Vpc [VPC [1-VPC1] has been shutdown succesfully
2013-03-07 13:07:08,430 ERROR [cloud.async.AsyncJobManagerImpl]
(Job-Executor-11:job-11) Unexpected exception while executing
org.apache.cloudstack.api.command.user.vpc.CreateVPCCmd
java.lang.NullPointerException
at
com.cloud.network.vpc.VpcManagerImpl.shutdownVpc(VpcManagerImpl.java:1005)
at
com.cloud.network.vpc.VpcManagerImpl.destroyVpc(VpcManagerImpl.java:720)
at
com.cloud.network.vpc.VpcManagerImpl.startVpc(VpcManagerImpl.java:955)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:319)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at
org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:80)
at
com.cloud.utils.db.TransactionContextBuilder.AroundAnyMethod(TransactionContextBuilder.java:40)
at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at
org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:621)
at
org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:610)
at
org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:65)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:90)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:202)
at $Proxy174.startVpc(Unknown Source)
at
org.apache.cloudstack.api.command.user.vpc.CreateVPCCmd.execute(CreateVPCCmd.java:137)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:163)
at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
at
org.springframework.aop.framework.Cglib2AopProxy$CglibMethodInvocation.invokeJoinpoint(Cglib2AopProxy.java:689)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at
org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:80)
at
com.cloud.utils.db.TransactionContextBuilder.AroundAnyMethod(TransactionContextBuilder.java:40)
at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:616)
at
org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:621)
at
org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:610)
at
org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:65)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:90)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at
org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:622)
at
com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:437)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
2013-03-07 13:07:08,432 DEBUG [cloud.async.AsyncJobManagerImpl]
(Job-Executor-11:job-11) Complete async job-11, jobStatus: 2, resultCode: 530,
result: Error Code: 530 Error text: null
2013-03-07 13:07:09,403 DEBUG [agent.manager.AgentManagerImpl]
(AgentManager-Handler-13:null) Ping from 4
2013-03-07 13:07:09,526 DEBUG [cloud.api.ApiServlet] (catalina-exec-3:null)
===START=== 10.144.7.13 -- GET
command=queryAsyncJobResult&jobId=bbb2ad89-3858-4796-bfc8-0536d0edd9a8&response=json&sessionkey=xnFS4ApqMe3v%2F0Xvt6mGD8eE2E0%3D&_=1362641904598
2013-03-07 13:07:09,550 DEBUG [cloud.async.AsyncJobManagerImpl]
(catalina-exec-3:null) Async job-11 completed
2013-03-07 13:07:09,555 DEBUG [cloud.api.ApiServlet] (catalina-exec-3:null)
===END=== 10.144.7.13 -- GET
command=queryAsyncJobResult&jobId=bbb2ad89-3858-4796-bfc8-0536d0edd9a8&response=json&sessionkey=xnFS4ApqMe3v%2F0Xvt6mGD8eE2E0%3D&_=1362641904598
2013-03-07 13:07:11,665 DEBUG [storage.secondary.SecondaryStorageManagerImpl]
(secstorage-1:null) Zone 1 is ready to launch secondary storage VM
2013-03-07 13:07:11,903 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl]
(consoleproxy-1:null) Zone 1 is ready to launch console proxy
2013-03-07 13:07:12,780 DEBUG
[network.router.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:null) Found 0 routers to update status.
2013-03-07 13:07:12,781 DEBUG
[network.router.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:null) Found 0 networks to update RvR status.
2013-03-07 13:07:12,906 DEBUG
[network.router.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:null) Found 0 routers to update status.
2013-03-07 13:07:12,907 DEBUG
[network.router.VirtualNetworkApplianceManagerImpl]
(RouterStatusMonitor-1:null) Found 0 networks to update RvR status.
2013-03-07 13:07:17,580 DEBUG [agent.transport.Request] (Timer-4:null) Seq
3-1836646723: Sending { Cmd , MgmtId: 15875056796715, via: 3, Ver: v1, Flags:
100011,
[{"storage.DownloadProgressCommand":{"jobId":"387bcbb7-1b01-41cf-b283-113672e4c00f","request":"GET_STATUS","hvm":false,"description":"CentOS
5.5(64-bit) no GUI
(KVM)","checksum":"ed0e788280ff2912ea40f7f91ca7a249","maxDownloadSizeInBytes":53687091200,"id":4,"resourceType":"TEMPLATE","url":"http://download.cloud.com/releases/2.2.0/eec2209b-9875-3c8d-92be-c001bd8a0faf.qcow2.bz2","format":"QCOW2","accountId":1,"name":"centos55-x86_64","secUrl":"nfs://10.102.192.100/cpg_vol/sailaja/secondary","wait":0}}]
}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
