Erik Weber created CLOUDSTACK-6484:
--------------------------------------
Summary: Unable to expunge VM
Key: CLOUDSTACK-6484
URL: https://issues.apache.org/jira/browse/CLOUDSTACK-6484
Project: CloudStack
Issue Type: Bug
Security Level: Public (Anyone can view this level - this is the default.)
Components: Management Server, XenServer
Affects Versions: 4.3.0
Environment: ACS 4.3, XenServer 6.2 SP1, NFS primary and secondary
storage
Reporter: Erik Weber
Priority: Minor
VM creation failed, and is now unable to expunge the stale vm.
Log excerpt:
2014-04-23 12:37:38,632 DEBUG [c.c.a.ApiServlet]
(catalina-exec-17:ctx-63a3ec65) ===START=== 172.30.86.24 -- GET
command=expungeVirtualMachine&id=05c7735f-43ab-4e75-b211-3791bceb77f9&response=json&sessionkey=OMJLVfWJLawkctDOi728%2B2sfpzI%3D&_=1398256658590
2014-04-23 12:37:38,664 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(catalina-exec-17:ctx-63a3ec65 ctx-fc4c0a3b) submit async job-827, details:
AsyncJobVO {id:827, userId: 2, accountId: 2, instanceType: VirtualMachine,
instanceId: 80, cmd: org.apache.cloudstack.api.command.admin.vm.ExpungeVMCmd,
cmdInfo:
{"id":"05c7735f-43ab-4e75-b211-3791bceb77f9","response":"json","sessionkey":"OMJLVfWJLawkctDOi728+2sfpzI\u003d","cmdEventType":"VM.EXPUNGE","ctxUserId":"2","httpmethod":"GET","_":"1398256658590","ctxAccountId":"2","ctxStartEventId":"3505"},
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result:
null, initMsid: 345049426471, completeMsid: null, lastUpdated: null,
lastPolled: null, created: null}
2014-04-23 12:37:38,667 INFO [o.a.c.f.j.i.AsyncJobMonitor]
(API-Job-Executor-6:job-827) Add job-827 into job monitoring
2014-04-23 12:37:38,667 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(API-Job-Executor-6:job-827) Executing AsyncJobVO {id:827, userId: 2,
accountId: 2, instanceType: VirtualMachine, instanceId: 80, cmd:
org.apache.cloudstack.api.command.admin.vm.ExpungeVMCmd, cmdInfo:
{"id":"05c7735f-43ab-4e75-b211-3791bceb77f9","response":"json","sessionkey":"OMJLVfWJLawkctDOi728+2sfpzI\u003d","cmdEventType":"VM.EXPUNGE","ctxUserId":"2","httpmethod":"GET","_":"1398256658590","ctxAccountId":"2","ctxStartEventId":"3505"},
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result:
null, initMsid: 345049426471, completeMsid: null, lastUpdated: null,
lastPolled: null, created: null}
2014-04-23 12:37:38,668 DEBUG [c.c.a.ApiServlet] (catalina-exec-17:ctx-63a3ec65
ctx-fc4c0a3b) ===END=== 172.30.86.24 -- GET
command=expungeVirtualMachine&id=05c7735f-43ab-4e75-b211-3791bceb77f9&response=json&sessionkey=OMJLVfWJLawkctDOi728%2B2sfpzI%3D&_=1398256658590
2014-04-23 12:37:38,719 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(API-Job-Executor-6:job-827 ctx-602236ef) Sync job-828 execution on object
VmWorkJobQueue.80
2014-04-23 12:37:38,724 WARN [c.c.u.d.Merovingian2]
(API-Job-Executor-6:job-827 ctx-602236ef) Was unable to find lock for the key
vm_instance80 and thread id 2057517175
2014-04-23 12:37:41,720 DEBUG [c.c.a.ApiServlet]
(catalina-exec-19:ctx-309c7bb0) ===START=== 172.30.86.24 -- GET
command=queryAsyncJobResult&jobId=849b6fb8-c20f-4362-8fc4-6877f36df874&response=json&sessionkey=OMJLVfWJLawkctDOi728%2B2sfpzI%3D&_=1398256661662
2014-04-23 12:37:41,753 DEBUG [c.c.a.ApiServlet] (catalina-exec-19:ctx-309c7bb0
ctx-51354ef7) ===END=== 172.30.86.24 -- GET
command=queryAsyncJobResult&jobId=849b6fb8-c20f-4362-8fc4-6877f36df874&response=json&sessionkey=OMJLVfWJLawkctDOi728%2B2sfpzI%3D&_=1398256661662
2014-04-23 12:37:41,821 DEBUG [c.c.c.CapacityManagerImpl]
(API-Job-Executor-6:job-827 ctx-602236ef) VM state transitted from :Expunging
to Expunging with event: ExpungeOperationvm's original host id: null new host
id: null host id before state transition: null
2014-04-23 12:37:41,823 DEBUG [c.c.v.VirtualMachineManagerImpl]
(API-Job-Executor-6:job-827 ctx-602236ef) Destroying vm VM[User|i-9-80-VM]
2014-04-23 12:37:41,824 DEBUG [c.c.v.VirtualMachineManagerImpl]
(API-Job-Executor-6:job-827 ctx-602236ef) Cleaning up NICS
2014-04-23 12:37:41,832 ERROR [c.c.a.ApiAsyncJobDispatcher]
(API-Job-Executor-6:job-827) Unexpected exception while executing
org.apache.cloudstack.api.command.admin.vm.ExpungeVMCmd
java.lang.NullPointerException
at
com.cloud.vm.VirtualMachineManagerImpl.advanceExpunge(VirtualMachineManagerImpl.java:489)
at
com.cloud.vm.VirtualMachineManagerImpl.advanceExpunge(VirtualMachineManagerImpl.java:455)
at com.cloud.vm.UserVmManagerImpl.expunge(UserVmManagerImpl.java:1739)
at com.cloud.vm.UserVmManagerImpl.expungeVm(UserVmManagerImpl.java:3855)
at com.cloud.vm.UserVmManagerImpl.expungeVm(UserVmManagerImpl.java:2134)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:622)
at
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at
com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:50)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at com.sun.proxy.$Proxy169.expungeVm(Unknown Source)
at
org.apache.cloudstack.api.command.admin.vm.ExpungeVMCmd.execute(ExpungeVMCmd.java:102)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:161)
at
com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:97)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:495)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:50)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:47)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:452)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:701)
2014-04-23 12:37:41,836 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(API-Job-Executor-6:job-827) Complete async job-827, jobStatus: FAILED,
resultCode: 530, result:
org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530}
2014-04-23 12:37:41,846 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(API-Job-Executor-6:job-827) Done executing
org.apache.cloudstack.api.command.admin.vm.ExpungeVMCmd for job-827
2014-04-23 12:37:41,851 INFO [o.a.c.f.j.i.AsyncJobMonitor]
(API-Job-Executor-6:job-827) Remove job-827 from job monitoring
--
This message was sent by Atlassian JIRA
(v6.2#6252)
