Girish Shilamkar created CLOUDSTACK-6966: --------------------------------------------
Summary: Attach volume causes unexpected exception intermittently Key: CLOUDSTACK-6966 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-6966 Project: CloudStack Issue Type: Bug Security Level: Public (Anyone can view this level - this is the default.) Reporter: Girish Shilamkar test_09_delete_detached_volume test fails sometimes while attaching the volume. Upon investigating it was found that unexpected exception is thrown by management server. Log: 2014-06-19 07:43:09,198 ERROR [c.c.a.ApiAsyncJobDispatcher] (API-Job-Executor-40:ctx-c775dc91 job-7728) Unexpected exception while executing org.apache.cloudstack.api. command.admin.volume.AttachVolumeCmdByAdmin java.lang.RuntimeException: Unexpected exception at com.cloud.storage.VolumeApiServiceImpl.attachVolumeToVM(VolumeApiServiceImpl.java:1045) at sun.reflect.GeneratedMethodAccessor669.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) at com.sun.proxy.$Proxy182.attachVolumeToVM(Unknown Source) at org.apache.cloudstack.api.command.admin.volume.AttachVolumeCmdByAdmin.execute(AttachVolumeCmdByAdmin.java:38) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:141) at com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:108) at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:503) at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46) at org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.run(AsyncJobManagerImpl.java:460) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744) Caused by: java.lang.RuntimeException: Job failed due to exception Failed to attach volume Test Volume to VM VM-43cf6765-bf73-4c3f-a1b3-24214d7dee93; org.libvirt.Libvi rtException: internal error unable to execute QEMU command '__com.redhat_drive_add': Duplicate ID 'drive-virtio-disk1' for drive ... 25 more 2014-06-19 07:43:09,199 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-40:ctx-c775dc91 job-7728) Complete async job-7728, jobStatus: FAILED, resultCode: 530 , result: org.apache.cloudstack.api.response.ExceptionResponse/null/ {"uuidList":[],"errorcode":530,"errortext":"Unexpected exception"} 2014-06-19 07:43:09,199 INFO [o.a.c.f.j.i.AsyncJobMonitor] (Work-Job-Executor-80:ctx-830fcb84 job-7728/job-7729) Remove job-7729 from job monitoring 2014-06-19 07:43:09,203 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] (API-Job-Executor-40:ctx-c775dc91 job-7728) Done executing org.apache.cloudstack.api.command.admin.volu me.AttachVolumeCmdByAdmin for job-7728 2014-06-19 07:43:09,207 INFO [o.a.c.f.j.i.AsyncJobMonitor] (API-Job-Executor-40:ctx-c775dc91 job-7728) Remove job-7728 from job monitoring 2014-06-19 07:43:09,655 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-6:null) SeqA 9-9704: Processing Seq 9-9704: { Cmd , MgmtId: -1, via: 9, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":80,"_loadInfo":" {\n \"connections\": []\n} ","wait":0}}] } 2014-06-19 07:43:09,659 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-6:null) SeqA 9-9704: Sending Seq 9-9704: { Ans: , MgmtId: 29066118877352, via: 9, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] } -- This message was sent by Atlassian JIRA (v6.2#6252)