[ https://issues.apache.org/jira/browse/CLOUDSTACK-1269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Fang Wang reassigned CLOUDSTACK-1269: ------------------------------------- Assignee: Sudha Ponnaganti (was: Fang Wang) This bug is not related to the new rpm package I built. The problem exists on the older existing rpm packages, for this 4.1 build. Please reassign. > Failed to start CPVM java.lang.NullPointerException Unable to start SSVM > -------------------------------------------------------------------------- > > Key: CLOUDSTACK-1269 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-1269 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) > Components: Management Server > Affects Versions: 4.1.0 > Environment: MS rhel6.3 10.223.195.114 build > CloudStack-non-OSS-23-rhel6.3.tar.gz > host rhel6.3 kvm 10.223.51.2 build > CloudStack-non-OSS-23-rhel6.3.tar.gz > 1. host installation: > build CloudStack-non-OSS-23-rhel6.3.tar.gz contains old version > qemu-img-0.12.1.2-3.209.el6.4.x86_64 > Due to 4.1 packaging, build does not have new qemu-img and qemu-kvm for > testing kvm 6.3 snapshot > manually replace qemu-img-0.12.1.2-3.209.el6.4.x86_64 with > qemu-img-0.12.1.2-3.295.el6.4.x86_64 > manually install qemu-kvm-0.12.1.2-3.295.el6.4.x86_64 > as part of above , had to remove libvirt-0.9.10-21.el6.x86_64, download > libvirt-0.9.10-21.el6.x86_64 > Here are some rpms that was reinstalled: > 1975468 Feb 13 20:56 libvirt-0.9.10-21.el6.x86_64.rpm > 1361029 Feb 13 20:32 > qemu-img-0.12.1.2-3.295.el6.10.x86_64.rpm > 10878235 Feb 13 20:33 > qemu-kvm-0.12.1.2-3.295.el6.10.x86_64.rpm > 375800 Feb 13 22:16 xnba-kvm-1.0.3-7.x86_64.rpm > 2. create advance zone isolation mode. > CPVM unable to start SSVM CPVM > Reporter: angeline shen > Assignee: Sudha Ponnaganti > Priority: Blocker > Fix For: 4.1.0 > > Attachments: management-server.log.gz, management-server.log.gz, > Screenshot-CloudStack - Mozilla Firefox.png, Screenshot-CloudStack - Mozilla > Firefox.png > > > 2013-02-13 17:10:25,656 DEBUG [agent.transport.Request] > (AgentManager-Handler-12:null) Seq 1-1481768980: Processing: { Ans: , > MgmtId: 6809771312912, via: 1, Ver: v1, Flags: 110, > [{"Answer":{"result":false,"details":"java.lang.Nul > lPointerException\n\tat > com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.cleanupVMNetworks(LibvirtComputingResource.java:4214)\n\tat > > com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.handleVmStartFailure(Libvirt > ComputingResource.java:2983)\n\tat > com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:3107)\n\tat > > com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtCompu > tingResource.java:1163)\n\tat > com.cloud.agent.Agent.processRequest(Agent.java:525)\n\tat > com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:852)\n\tat > com.cloud.utils.nio.Task.run(Task.java:83)\n\tat java.util.concurrent. > ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)\n\tat > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)\n\tat > > java.lang.Thread.run(Thread.java:679)\n","wait":0}},{"Answer":{"result":false," > details":"Stopped by previous failure","wait":0}}] } > 2013-02-13 17:10:25,657 DEBUG [agent.transport.Request] (secstorage-1:null) > Seq 1-1481768980: Received: { Ans: , MgmtId: 6809771312912, via: 1, Ver: v1, > Flags: 110, { Answer, Answer } } > 2013-02-13 17:10:25,657 DEBUG [agent.manager.AgentAttache] > (AgentManager-Handler-12:null) Seq 1-1481768981: Sending now. is current > sequence. > 2013-02-13 17:10:25,662 ERROR [cloud.vm.VirtualMachineManagerImpl] > (secstorage-1:null) Failed to start instance VM[SecondaryStorageVm|s-1-VM] > com.cloud.utils.exception.CloudRuntimeException: Unable to get answer that is > of class com.cloud.agent.api.StartAnswer > at com.cloud.agent.manager.Commands.getAnswer(Commands.java:80) > at > com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:777) > at > com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:466) > at > com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:459) > at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) > at > org.springframework.aop.framework.Cglib2AopProxy$CglibMethodInvocation.invokeJoinpoint(Cglib2AopProxy.java:689) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) > at > org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:80) > at > com.cloud.utils.db.TransactionContextBuilder.AroundAnyMethod(TransactionContextBuilder.java:43) > at sun.reflect.GeneratedMethodAccessor35.invoke(Unknown Source) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:616) > at > org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:621) > at > org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:610) > at > org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:65) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) > at > org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:90) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) > at > org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:622) > at > com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:264) > at > com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:689) > at > com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1300) > at > com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:121) > at > com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:52) > at > com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:104) > at > com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:33) > at > com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:81) > at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:72) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at > java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351) > at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) > at java.lang.Thread.run(Thread.java:679) > 2013-02-13 17:10:25,667 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (secstorage-1:null) Cleaning up resources for the vm > VM[SecondaryStorageVm|s-1-VM] in Starting state > 2013-02-13 17:10:25,668 DEBUG [agent.transport.Request] (secstorage-1:null) > Seq 1-1481768983: Waiting for Seq 1481768981 Scheduling: { Cmd , MgmtId: > 6809771312912, via: 1, Ver: v1, Flags: 100111, > [{"StopCommand":{"isProxy":false, > "vmName":"s-1-VM","wait":0}}] } > 2013-02-13 17:10:35,133 DEBUG [cloud.api.ApiServlet] (catalina-exec-10:null) > ===START=== 10.216.133.70 -- POST > command=createAccount&response=json&sessionkey=ZPNnO6ZVMdSYISIfi%2FUga%2FM9H9A%3D > 2013-02-13 17:10:35,154 DEBUG [cloud.user.AccountManagerImpl] > (catalina-exec-10:null) Access granted to Acct[2-admin] to Domain:2/d1/ by > DomainChecker > 2013-02-13 17:10:35,161 DEBUG [network.security.SecurityGroupManagerImpl] > (catalina-exec-10:null) Created security group > 2013-02-13 17:10:35,133 DEBUG [cloud.api.ApiServlet] (catalina-exec-10:null) > ===START=== 10.216.133.70 -- POST > command=createAccount&response=json&sessionkey=ZPNnO6ZVMdSYISIfi%2FUga%2FM9H9A%3D > 2013-02-13 17:10:35,154 DEBUG [cloud.user.AccountManagerImpl] > (catalina-exec-10:null) Access granted to Acct[2-admin] to Domain:2/d1/ by > DomainChecker > 2013-02-13 17:10:35,161 DEBUG [network.security.SecurityGroupManagerImpl] > (catalina-exec-10:null) Created security group > com.cloud.network.security.SecurityGroupVO$$EnhancerByCGLIB$$53628a27@753f827a > for account id=4 > 2013-02-13 17:10:35,163 DEBUG [cloud.user.AccountManagerImpl] > (catalina-exec-10:null) Creating user: d1domain, accountId: 4 > timezone:America/Los_Angeles > 2013-02-13 17:10:35,324 DEBUG [cloud.api.ApiServlet] (catalina-exec-10:null) > ===END=== 10.216.133.70 -- POST > command=createAccount&response=json&sessionkey=ZPNnO6ZVMdSYISIfi%2FUga%2FM9H9A%3D > 2013-02-13 17:10:36,326 DEBUG [agent.transport.Request] > (AgentManager-Handler-13:null) Seq 1-1481768981: Processing: { Ans: , > MgmtId: 6809771312912, via: 1, Ver: v1, Flags: 110, > [{"Answer":{"result":false,"details":"java.lang.NullPointerException\n\tat > com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.cleanupVMNetworks(LibvirtComputingResource.java:4214)\n\tat > > com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.handleVmStartFailure(LibvirtComputingResource.java:2983)\n\tat > > com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:3107)\n\tat > > com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1163)\n\tat > com.cloud.agent.Agent.processRequest(Agent.java:525)\n\tat > com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:852)\n\tat > com.cloud.utils.nio.Task.run(Task.java:83)\n\tat > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)\n\tat > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)\n\tat > > java.lang.Thread.run(Thread.java:679)\n","wait":0}},{"Answer":{"result":false,"details":"Stopped > by previous failure","wait":0}}] } > 2013-02-13 17:10:36,326 DEBUG [agent.manager.AgentAttache] > (AgentManager-Handler-13:null) Seq 1-1481768983: Sending now. is current > sequence. > 2013-02-13 17:10:36,326 DEBUG [agent.transport.Request] (consoleproxy-1:null) > Seq 1-1481768981: Received: { Ans: , MgmtId: 6809771312912, via: 1, Ver: v1, > Flags: 110, { Answer, Answer } } > 2013-02-13 17:10:36,339 ERROR [cloud.vm.VirtualMachineManagerImpl] > (consoleproxy-1:null) Failed to start instance VM[ConsoleProxy|v-2-VM] > com.cloud.utils.exception.CloudRuntimeException: Unable to get answer that is > of class com.cloud.agent.api.StartAnswer > at com.cloud.agent.manager.Commands.getAnswer(Commands.java:80) > at > com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:777) > at > com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:466) > at > com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:459) > at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204) > at > org.springframework.aop.framework.Cglib2AopProxy$CglibMethodInvocation.invokeJoinpoint(Cglib2AopProxy.java:689) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) > at > org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:80) > at > com.cloud.utils.db.TransactionContextBuilder.AroundAnyMethod(TransactionContextBuilder.java:43) > at sun.reflect.GeneratedMethodAccessor35.invoke(Unknown Source) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:616) > at > org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:621) > at > org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:610) > at > org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:65) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) > at > org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:90) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) > at > org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:622) > at > com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:630) > at > com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:1164) > at > com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1960) > at > com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:174) > at > com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:111) > at > com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:33) > at > com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:81) > at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:72) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at > java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351) > at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165) > at > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) > at java.lang.Thread.run(Thread.java:679) > 2013-02-13 17:10:36,343 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (consoleproxy-1:null) Cleaning up resources for the vm > VM[ConsoleProxy|v-2-VM] in Starting state > 2013-02-13 17:10:36,344 DEBUG [agent.transport.Request] (consoleproxy-1:null) > Seq 1-1481768984: Waiting for Seq 1481768983 Scheduling: { Cmd , MgmtId: > 6809771312912, via: 1, Ver: v1, Flags: 100111, > [{"StopCommand":{"isProxy":false,"vmName":"v-2-VM","wait":0}}] } > 2013-02-13 17:10:36,395 DEBUG [agent.transport.Request] > (AgentManager-Handler-14:null) Seq 1-1481768983: Processing: { Ans: , > MgmtId: 6809771312912, via: 1, Ver: v1, Flags: 110, > [{"StopAnswer":{"vncPort":0,"result":true,"wait":0}}] } > 2013-02-13 17:10:36,395 DEBUG [agent.manager.AgentAttache] > (AgentManager-Handler-14:null) Seq 1-1481768984: Sending now. is current > sequence. > 2013-02-13 17:10:36,395 DEBUG [agent.transport.Request] (secstorage-1:null) > Seq 1-1481768983: Received: { Ans: , MgmtId: 6809771312912, via: 1, Ver: v1, > Flags: 110, { StopAnswer } } -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira