[ https://issues.apache.org/jira/browse/CLOUDSTACK-5788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devdeep Singh reassigned CLOUDSTACK-5788: ----------------------------------------- Assignee: Devdeep Singh > [Hyper-V] Attaching an uploaded volume to a VM is failing because copyCommand > fails > ----------------------------------------------------------------------------------- > > Key: CLOUDSTACK-5788 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-5788 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) > Components: Hypervisor Controller, Management Server > Affects Versions: 4.3.0 > Environment: hyperv,4.3 > Reporter: Abhinav Roy > Assignee: Devdeep Singh > Priority: Critical > Labels: hyper-V,, hyper-v, hyperv > Fix For: 4.3.0 > > > Steps : > ===================== > 1. Deploy an advanced zone setup with hyperv. > 2. Create a VM. > 3. upload a volume. > 4. Attach the volume uploaded in step 3 to the VM created in step 2. > Expected behaviour: > ===================== > Attach volume should succeed. > Observed behaviour: > ===================== > Attach volume fails with : > MS logs : > ---------------------- > 2014-01-06 11:53:37,402 DEBUG [c.c.h.h.r.HypervDirectConnectResource] > (DirectAgent-380:ctx-674d76cf) POST response > is[{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"org.apache.cloudstack.storage.command.CopyCommand > failed on exception, Error getting value from 'FullFileName' on > 'HypervResource.VolumeObjectTO'.","newData":null,"contextMap":{}}}] > 2014-01-06 11:53:37,403 DEBUG [c.c.h.h.r.HypervDirectConnectResource] > (DirectAgent-380:ctx-674d76cf) executeRequest received response > [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"org.apache.cloudstack.storage.command.CopyCommand > failed on exception, Error getting value from \u0027FullFileName\u0027 on > \u0027HypervResource.VolumeObjectTO\u0027.","contextMap":{},"wait":0}}] > 2014-01-06 11:53:37,403 DEBUG [c.c.a.m.DirectAgentAttache] > (DirectAgent-380:ctx-674d76cf) Seq 1-849871246: Response Received: > 2014-01-06 11:53:37,403 DEBUG [c.c.a.t.Request] > (DirectAgent-380:ctx-674d76cf) Seq 1-849871246: Processing: { Ans: , MgmtId: > 280320865129348, via: 1, Ver: v1, Flags: 10, > [{"org.apache.cloudstack.storage.command.CopyCmdAnswer":{"result":false,"details":"org.apache.cloudstack.storage.command.CopyCommand > failed on exception, Error getting value from 'FullFileName' on > 'HypervResource.VolumeObjectTO'.","wait":0}}] } > 2014-01-06 11:53:37,403 DEBUG [c.c.a.t.Request] > (Job-Executor-115:ctx-46b175df ctx-9f2ec3a6) Seq 1-849871246: Received: { > Ans: , MgmtId: 280320865129348, via: 1, Ver: v1, Flags: 10, { CopyCmdAnswer } > } > 2014-01-06 11:53:37,421 DEBUG [o.a.c.e.o.VolumeOrchestrator] > (Job-Executor-115:ctx-46b175df ctx-9f2ec3a6) copy volume failed: > java.lang.NullPointerException > 2014-01-06 11:53:37,421 ERROR [c.c.v.VmWorkJobHandlerProxy] > (Job-Executor-115:ctx-46b175df ctx-9f2ec3a6) Invocation exception, caused by: > com.cloud.utils.exception.CloudRuntimeException: copy volume failed: > java.lang.NullPointerException > 2014-01-06 11:53:37,421 ERROR [c.c.v.VmWorkJobDispatcher] > (Job-Executor-115:ctx-46b175df ctx-9f2ec3a6) Unable to complete AsyncJobVO > {id:142, userId: 2, accountId: 2, instanceType: null, instanceId: null, cmd: > com.cloud.storage.VmWorkAttachVolume, cmdInfo: > rO0ABXNyACRjb20uY2xvdWQuc3RvcmFnZS5WbVdvcmtBdHRhY2hWb2x1bWUHra_5YYfiHAIAAkwACGRldmljZUlkdAAQTGphdmEvbGFuZy9Mb25nO0wACHZvbHVtZUlkcQB-AAF4cgATY29tLmNsb3VkLnZtLlZtV29ya5-ZtlbwJWdrAgAESgAJYWNjb3VudElkSgAGdXNlcklkSgAEdm1JZEwAC2hhbmRsZXJOYW1ldAASTGphdmEvbGFuZy9TdHJpbmc7eHAAAAAAAAAAAgAAAAAAAAACAAAAAAAAAAp0ABRWb2x1bWVBcGlTZXJ2aWNlSW1wbHBzcgAOamF2YS5sYW5nLkxvbmc7i-SQzI8j3wIAAUoABXZhbHVleHIAEGphdmEubGFuZy5OdW1iZXKGrJUdC5TgiwIAAHhwAAAAAAAAABM, > cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: > null, initMsid: 280320865129348, completeMsid: null, lastUpdated: null, > lastPolled: null, created: Mon Jan 06 11:53:27 IST 2014} > com.cloud.utils.exception.CloudRuntimeException: copy volume failed: > java.lang.NullPointerException > at > org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.copyVolumeFromSecToPrimary(VolumeOrchestrator.java:412) > at > org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.copyVolume(VolumeOrchestrator.java:718) > at > org.apache.cloudstack.engine.orchestration.VolumeOrchestrator.createVolumeOnPrimaryStorage(VolumeOrchestrator.java:747) > at > com.cloud.storage.VolumeApiServiceImpl.attachVolumeToVM(VolumeApiServiceImpl.java:1249) > at > com.cloud.storage.VolumeApiServiceImpl.orchestrateAttachVolumeToVM(VolumeApiServiceImpl.java:1127) > at > com.cloud.storage.VolumeApiServiceImpl.orchestrateAttachVolumeToVM(VolumeApiServiceImpl.java:2406) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:616) > at > com.cloud.vm.VmWorkJobHandlerProxy.handleVmWorkJob(VmWorkJobHandlerProxy.java:107) > at > com.cloud.storage.VolumeApiServiceImpl.handleVmWorkJob(VolumeApiServiceImpl.java:2437) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:616) > at > org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) > at > org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) > at > org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) > at $Proxy195.handleVmWorkJob(Unknown Source) > at > com.cloud.vm.VmWorkJobDispatcher.runJob(VmWorkJobDispatcher.java:99) > at > org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:524) > at > org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) > at > org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) > at java.lang.Thread.run(Thread.java:679) > 2014-01-06 11:53:37,430 INFO [c.c.v.VmWorkJobDispatcher] > (Job-Executor-115:ctx-46b175df ctx-9f2ec3a6) Serialize exception object into > json: > com.cloud.utils.exception.CloudRuntimeException/{"idList":[],"uuidList":[],"csErrorCode":4250,"detailMessage":"copy > volume failed: > java.lang.NullPointerException","cause":{"class":"com.cloud.utils.exception.CloudRuntimeException","msg":"copy > volume failed: > java.lang.NullPointerException"},"stackTrace":[{"declaringClass":"org.apache.cloudstack.engine.orchestration.VolumeOrchestrator","methodName":"copyVolumeFromSecToPrimary","fileName":"VolumeOrchestrator.java","lineNumber":412},{"declaringClass":"org.apache.cloudstack.engine.orchestration.VolumeOrchestrator","methodName":"copyVolume","fileName":"VolumeOrchestrator.java","lineNumber":718},{"declaringClass":"org.apache.cloudstack.engine.orchestration.VolumeOrchestrator","methodName":"createVolumeOnPrimaryStorage","fileName":"VolumeOrchestrator.java","lineNumber":747},{"declaringClass":"com.cloud.storage.VolumeApiServiceImpl","methodName":"attachVolumeToVM","fileName":"VolumeApiServiceImpl.java","lineNumber":1249},{"declaringClass":"com.cloud.storage.VolumeApiServiceImpl","methodName":"orchestrateAttachVolumeToVM","fileName":"VolumeApiServiceImpl.java","lineNumber":1127},{"declaringClass":"com.cloud.storage.VolumeApiServiceImpl","methodName":"orchestrateAttachVolumeToVM","fileName":"VolumeApiServiceImpl.java","lineNumber":2406},{"declaringClass":"sun.reflect.NativeMethodAccessorImpl","methodName":"invoke0","fileName":"NativeMethodAccessorImpl.java","lineNumber":-2},{"declaringClass":"sun.reflect.NativeMethodAccessorImpl","methodName":"invoke","fileName":"NativeMethodAccessorImpl.java","lineNumber":57},{"declaringClass":"sun.reflect.DelegatingMethodAccessorImpl","methodName":"invoke","fileName":"DelegatingMethodAccessorImpl.java","lineNumber":43},{"declaringClass":"java.lang.reflect.Method","methodName":"invoke","fileName":"Method.java","lineNumber":616},{"declaringClass":"com.cloud.vm.VmWorkJobHandlerProxy","methodName":"handleVmWorkJob","fileName":"VmWorkJobHandlerProxy.java","lineNumber":107},{"declaringClass":"com.cloud.storage.VolumeApiServiceImpl","methodName":"handleVmWorkJob","fileName":"VolumeApiServiceImpl.java","lineNumber":2437},{"declaringClass":"sun.reflect.NativeMethodAccessorImpl","methodName":"invoke0","fileName":"NativeMethodAccessorImpl.java","lineNumber":-2},{"declaringClass":"sun.reflect.NativeMethodAccessorImpl","methodName":"invoke","fileName":"NativeMethodAccessorImpl.java","lineNumber":57},{"declaringClass":"sun.reflect.DelegatingMethodAccessorImpl","methodName":"invoke","fileName":"DelegatingMethodAccessorImpl.java","lineNumber":43},{"declaringClass":"java.lang.reflect.Method","methodName":"invoke","fileName":"Method.java","lineNumber":616},{"declaringClass":"org.springframework.aop.support.AopUtils","methodName":"invokeJoinpointUsingReflection","fileName":"AopUtils.java","lineNumber":317},{"declaringClass":"org.springframework.aop.framework.ReflectiveMethodInvocation","methodName":"invokeJoinpoint","fileName":"ReflectiveMethodInvocation.java","lineNumber":183},{"declaringClass":"org.springframework.aop.framework.ReflectiveMethodInvocation","methodName":"proceed","fileName":"ReflectiveMethodInvocation.java","lineNumber":150},{"declaringClass":"org.springframework.aop.interceptor.ExposeInvocationInterceptor","methodName":"invoke","fileName":"ExposeInvocationInterceptor.java","lineNumber":91},{"declaringClass":"org.springframework.aop.framework.ReflectiveMethodInvocation","methodName":"proceed","fileName":"ReflectiveMethodInvocation.java","lineNumber":172},{"declaringClass":"org.springframework.aop.framework.JdkDynamicAopProxy","methodName":"invoke","fileName":"JdkDynamicAopProxy.java","lineNumber":204},{"declaringClass":"$Proxy195","methodName":"handleVmWorkJob","lineNumber":-1},{"declaringClass":"com.cloud.vm.VmWorkJobDispatcher","methodName":"runJob","fileName":"VmWorkJobDispatcher.java","lineNumber":99},{"declaringClass":"org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5","methodName":"runInContext","fileName":"AsyncJobManagerImpl.java","lineNumber":524},{"declaringClass":"org.apache.cloudstack.managed.context.ManagedContextRunnable$1","methodName":"run","fileName":"ManagedContextRunnable.java","lineNumber":49},{"declaringClass":"org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1","methodName":"call","fileName":"DefaultManagedContext.java","lineNumber":56},{"declaringClass":"org.apache.cloudstack.managed.context.impl.DefaultManagedContext","methodName":"callWithContext","fileName":"DefaultManagedContext.java","lineNumber":103},{"declaringClass":"org.apache.cloudstack.managed.context.impl.DefaultManagedContext","methodName":"runWithContext","fileName":"DefaultManagedContext.java","lineNumber":53},{"declaringClass":"org.apache.cloudstack.managed.context.ManagedContextRunnable","methodName":"run","fileName":"ManagedContextRunnable.java","lineNumber":46},{"declaringClass":"java.util.concurrent.Executors$RunnableAdapter","methodName":"call","fileName":"Executors.java","lineNumber":471},{"declaringClass":"java.util.concurrent.FutureTask$Sync","methodName":"innerRun","fileName":"FutureTask.java","lineNumber":334},{"declaringClass":"java.util.concurrent.FutureTask","methodName":"run","fileName":"FutureTask.java","lineNumber":166},{"declaringClass":"java.util.concurrent.ThreadPoolExecutor","methodName":"runWorker","fileName":"ThreadPoolExecutor.java","lineNumber":1110},{"declaringClass":"java.util.concurrent.ThreadPoolExecutor$Worker","methodName":"run","fileName":"ThreadPoolExecutor.java","lineNumber":603},{"declaringClass":"java.lang.Thread","methodName":"run","fileName":"Thread.java","lineNumber":679}]} > 2014-01-06 11:53:37,430 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] > (Job-Executor-115:ctx-46b175df ctx-9f2ec3a6) Complete async job-142, > jobStatus: FAILED, resultCode: 0, result: > com.cloud.utils.exception.CloudRuntimeException/{"idList":[],"uuidList":[],"csErrorCode":4250,"detailMessage":"copy > volume failed: > java.lang.NullPointerException","cause":{"class":"com.cloud.utils.exception.CloudRuntimeException","msg":"copy > volume failed: > java.lang.NullPointerException"},"stackTrace":[{"declaringClass":"org.apache.cloudstack.engine.orchestration.VolumeOrchestrator","methodName":"copyVolumeFromSecToPrimary","fileName":"VolumeOrchestrator.java","lineNumber":412},{"declaringClass":"org.apache.cloudstack.engine.orchestration.VolumeOrchestrator","methodName":"copyVolume","fileName":"VolumeOrchestrator.java","lineNumber":718},{"declaringClass":"org.apache.cloudstack.engine.orchestration.VolumeOrchestrator","methodName":"createVolumeOnPrimaryStorage","fileName":"VolumeOrchestrator.java","lineNumber":747},{"declaringClass":"com.cloud.storage.VolumeApiServiceImpl","methodName":"attachVolumeToVM","fileName":"VolumeApiServiceImpl.java","lineNumber":1249},{"declaringClass":"com.cloud.storage.VolumeApiServiceImpl","methodName":"orchestrateAttachVolumeToVM","fileName":"VolumeApiServiceImpl.java","lineNumber":1127},{"declaringClass":"com.cloud.storage.VolumeApiServiceImpl","methodName":"orchestrateAttachVolumeToVM","fileName":"VolumeApiServiceImpl.java","lineNumber":2406},{"declaringClass":"sun.reflect.NativeMethodAccessorImpl","methodName":"invoke0","fileName":"NativeMethodAccessorImpl.java","lineNumber":-2},{"declaringClass":"sun.reflect.NativeMethodAccessorImpl","methodName":"invoke","fileName":"NativeMethodAccessorImpl.java","lineNumber":57},{"declaringClass":"sun.reflect.DelegatingMethodAccessorImpl","methodName":"invoke","fileName":"DelegatingMethodAccessorImpl.java","lineNumber":43},{"declaringClass":"java.lang.reflect.Method","methodName":"invoke","fileName":"Method.java","lineNumber":616},{"declaringClass":"com.cloud.vm.VmWorkJobHandlerProxy","methodName":"handleVmWorkJob","fileName":"VmWorkJobHandlerProxy.java","lineNumber":107},{"declaringClass":"com.cloud.storage.VolumeApiServiceImpl","methodName":"handleVmWorkJob","fileName":"VolumeApiServiceImpl.java","lineNumber":2437},{"declaringClass":"sun.reflect.NativeMethodAccessorImpl","methodName":"invoke0","fileName":"NativeMethodAccessorImpl.java","lineNumber":-2},{"declaringClass":"sun.reflect.NativeMethodAccessorImpl","methodName":"invoke","fileName":"NativeMethodAccessorImpl.java","lineNumber":57},{"declaringClass":"sun.reflect.DelegatingMethodAccessorImpl","methodName":"invoke","fileName":"DelegatingMethodAccessorImpl.java","lineNumber":43},{"declaringClass":"java.lang.reflect.Method","methodName":"invoke","fileName":"Method.java","lineNumber":616},{"declaringClass":"org.springframework.aop.support.AopUtils","methodName":"invokeJoinpointUsingReflection","fileName":"AopUtils.java","lineNumber":317},{"declaringClass":"org.springframework.aop.framework.ReflectiveMethodInvocation","methodName":"invokeJoinpoint","fileName":"ReflectiveMethodInvocation.java","lineNumber":183},{"declaringClass":"org.springframework.aop.framework.ReflectiveMethodInvocation","methodName":"proceed","fileName":"ReflectiveMethodInvocation.java","lineNumber":150},{"declaringClass":"org.springframework.aop.interceptor.ExposeInvocationInterceptor","methodName":"invoke","fileName":"ExposeInvocationInterceptor.java","lineNumber":91},{"declaringClass":"org.springframework.aop.framework.ReflectiveMethodInvocation","methodName":"proceed","fileName":"ReflectiveMethodInvocation.java","lineNumber":172},{"declaringClass":"org.springframework.aop.framework.JdkDynamicAopProxy","methodName":"invoke","fileName":"JdkDynamicAopProxy.java","lineNumber":204},{"declaringClass":"$Proxy195","methodName":"handleVmWorkJob","lineNumber":-1},{"declaringClass":"com.cloud.vm.VmWorkJobDispatcher","methodName":"runJob","fileName":"VmWorkJobDispatcher.java","lineNumber":99},{"declaringClass":"org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5","methodName":"runInContext","fileName":"AsyncJobManagerImpl.java","lineNumber":524},{"declaringClass":"org.apache.cloudstack.managed.context.ManagedContextRunnable$1","methodName":"run","fileName":"ManagedContextRunnable.java","lineNumber":49},{"declaringClass":"org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1","methodName":"call","fileName":"DefaultManagedContext.java","lineNumber":56},{"declaringClass":"org.apache.cloudstack.managed.context.impl.DefaultManagedContext","methodName":"callWithContext","fileName":"DefaultManagedContext.java","lineNumber":103},{"declaringClass":"org.apache.cloudstack.managed.context.impl.DefaultManagedContext","methodName":"runWithContext","fileName":"DefaultManagedContext.java","lineNumber":53},{"declaringClass":"org.apache.cloudstack.managed.context.ManagedContextRunnable","methodName":"run","fileName":"ManagedContextRunnable.java","lineNumber":46},{"declaringClass":"java.util.concurrent.Executors$RunnableAdapter","methodName":"call","fileName":"Executors.java","lineNumber":471},{"declaringClass":"java.util.concurrent.FutureTask$Sync","methodName":"innerRun","fileName":"FutureTask.java","lineNumber":334},{"declaringClass":"java.util.concurrent.FutureTask","methodName":"run","fileName":"FutureTask.java","lineNumber":166},{"declaringClass":"java.util.concurrent.ThreadPoolExecutor","methodName":"runWorker","fileName":"ThreadPoolExecutor.java","lineNumber":1110},{"declaringClass":"java.util.concurrent.ThreadPoolExecutor$Worker","methodName":"run","fileName":"ThreadPoolExecutor.java","lineNumber":603},{"declaringClass":"java.lang.Thread","methodName":"run","fileName":"Thread.java","lineNumber":679}]} > 2014-01-06 11:53:37,437 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] > (Job-Executor-115:ctx-46b175df) Done executing > com.cloud.storage.VmWorkAttachVolume for job-142 > 2014-01-06 11:53:37,441 INFO [o.a.c.f.j.i.AsyncJobMonitor] > (Job-Executor-116:ctx-9f6a5f51) Add job-141 into job monitoring > 2014-01-06 11:53:37,441 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] > (Job-Executor-116:ctx-9f6a5f51) Executing AsyncJobVO {id:141, userId: 2, > accountId: 2, instanceType: Volume, instanceId: 19, cmd: > org.apache.cloudstack.api.command.user.volume.AttachVolumeCmd, cmdInfo: > {"response":"json","id":"4d5e35e3-2a67-4d1e-8758-7c6b283866cd","sessionkey":"5ODiLDmKehMbGznMVT9sutQQg7U\u003d","cmdEventType":"VOLUME.ATTACH","ctxUserId":"2","virtualMachineId":"62064ead-e49e-4bb7-86e7-7422f33e3f75","httpmethod":"GET","_":"1388989738235","ctxAccountId":"2","ctxStartEventId":"332"}, > cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: > null, initMsid: 280320865129348, completeMsid: null, lastUpdated: null, > lastPolled: Mon Jan 06 11:53:36 IST 2014, created: Mon Jan 06 11:53:27 IST > 2014} > 2014-01-06 11:53:37,447 DEBUG [o.a.c.f.j.i.SyncQueueManagerImpl] > (Job-Executor-115:ctx-46b175df) Sync queue (21) is currently empty > 2014-01-06 11:53:37,448 INFO [o.a.c.f.j.i.AsyncJobMonitor] > (Job-Executor-115:ctx-46b175df) Remove job-142 from job monitoring > 2014-01-06 11:53:37,447 ERROR [c.c.a.ApiAsyncJobDispatcher] > (Job-Executor-114:ctx-035abfcd) Unexpected exception while executing > org.apache.cloudstack.api.command.user.volume.AttachVolumeCmd > com.cloud.utils.exception.CloudRuntimeException: Unable to serialize: > com.cloud.utils.exception.CloudRuntimeException/{"idList":[],"uuidList":[],"csErrorCode":4250,"detailMessage":"copy > volume failed: > java.lang.NullPointerException","cause":{"class":"com.cloud.utils.exception.CloudRuntimeException","msg":"copy > volume failed: > java.lang.NullPointerException"},"stackTrace":[{"declaringClass":"org.apache.cloudstack.engine.orchestration.VolumeOrchestrator","methodName":"copyVolumeFromSecToPrimary","fileName":"VolumeOrchestrator.java","lineNumber":412},{"declaringClass":"org.apache.cloudstack.engine.orchestration.VolumeOrchestrator","methodName":"copyVolume","fileName":"VolumeOrchestrator.java","lineNumber":718},{"declaringClass":"org.apache.cloudstack.engine.orchestration.VolumeOrchestrator","methodName":"createVolumeOnPrimaryStorage","fileName":"VolumeOrchestrator.java","lineNumber":747},{"declaringClass":"com.cloud.storage.VolumeApiServiceImpl","methodName":"attachVolumeToVM","fileName":"VolumeApiServiceImpl.java","lineNumber":1249},{"declaringClass":"com.cloud.storage.VolumeApiServiceImpl","methodName":"orchestrateAttachVolumeToVM","fileName":"VolumeApiServiceImpl.java","lineNumber":1127},{"declaringClass":"com.cloud.storage.VolumeApiServiceImpl","methodName":"orchestrateAttachVolumeToVM","fileName":"VolumeApiServiceImpl.java","lineNumber":2406},{"declaringClass":"sun.reflect.NativeMethodAccessorImpl","methodName":"invoke0","fileName":"NativeMethodAccessorImpl.java","lineNumber":-2},{"declaringClass":"sun.reflect.NativeMethodAccessorImpl","methodName":"invoke","fileName":"NativeMethodAccessorImpl.java","lineNumber":57},{"declaringClass":"sun.reflect.DelegatingMethodAccessorImpl","methodName":"invoke","fileName":"DelegatingMethodAccessorImpl.java","lineNumber":43},{"declaringClass":"java.lang.reflect.Method","methodName":"invoke","fileName":"Method.java","lineNumber":616},{"declaringClass":"com.cloud.vm.VmWorkJobHandlerProxy","methodName":"handleVmWorkJob","fileName":"VmWorkJobHandlerProxy.java","lineNumber":107},{"declaringClass":"com.cloud.storage.VolumeApiServiceImpl","methodName":"handleVmWorkJob","fileName":"VolumeApiServiceImpl.java","lineNumber":2437},{"declaringClass":"sun.reflect.NativeMethodAccessorImpl","methodName":"invoke0","fileName":"NativeMethodAccessorImpl.java","lineNumber":-2},{"declaringClass":"sun.reflect.NativeMethodAccessorImpl","methodName":"invoke","fileName":"NativeMethodAccessorImpl.java","lineNumber":57},{"declaringClass":"sun.reflect.DelegatingMethodAccessorImpl","methodName":"invoke","fileName":"DelegatingMethodAccessorImpl.java","lineNumber":43},{"declaringClass":"java.lang.reflect.Method","methodName":"invoke","fileName":"Method.java","lineNumber":616},{"declaringClass":"org.springframework.aop.support.AopUtils","methodName":"invokeJoinpointUsingReflection","fileName":"AopUtils.java","lineNumber":317},{"declaringClass":"org.springframework.aop.framework.ReflectiveMethodInvocation","methodName":"invokeJoinpoint","fileName":"ReflectiveMethodInvocation.java","lineNumber":183},{"declaringClass":"org.springframework.aop.framework.ReflectiveMethodInvocation","methodName":"proceed","fileName":"ReflectiveMethodInvocation.java","lineNumber":150},{"declaringClass":"org.springframework.aop.interceptor.ExposeInvocationInterceptor","methodName":"invoke","fileName":"ExposeInvocationInterceptor.java","lineNumber":91},{"declaringClass":"org.springframework.aop.framework.ReflectiveMethodInvocation","methodName":"proceed","fileName":"ReflectiveMethodInvocation.java","lineNumber":172},{"declaringClass":"org.springframework.aop.framework.JdkDynamicAopProxy","methodName":"invoke","fileName":"JdkDynamicAopProxy.java","lineNumber":204},{"declaringClass":"$Proxy195","methodName":"handleVmWorkJob","lineNumber":-1},{"declaringClass":"com.cloud.vm.VmWorkJobDispatcher","methodName":"runJob","fileName":"VmWorkJobDispatcher.java","lineNumber":99},{"declaringClass":"org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5","methodName":"runInContext","fileName":"AsyncJobManagerImpl.java","lineNumber":524},{"declaringClass":"org.apache.cloudstack.managed.context.ManagedContextRunnable$1","methodName":"run","fileName":"ManagedContextRunnable.java","lineNumber":49},{"declaringClass":"org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1","methodName":"call","fileName":"DefaultManagedContext.java","lineNumber":56},{"declaringClass":"org.apache.cloudstack.managed.context.impl.DefaultManagedContext","methodName":"callWithContext","fileName":"DefaultManagedContext.java","lineNumber":103},{"declaringClass":"org.apache.cloudstack.managed.context.impl.DefaultManagedContext","methodName":"runWithContext","fileName":"DefaultManagedContext.java","lineNumber":53},{"declaringClass":"org.apache.cloudstack.managed.context.ManagedContextRunnable","methodName":"run","fileName":"ManagedContextRunnable.java","lineNumber":46},{"declaringClass":"java.util.concurrent.Executors$RunnableAdapter","methodName":"call","fileName":"Executors.java","lineNumber":471},{"declaringClass":"java.util.concurrent.FutureTask$Sync","methodName":"innerRun","fileName":"FutureTask.java","lineNumber":334},{"declaringClass":"java.util.concurrent.FutureTask","methodName":"run","fileName":"FutureTask.java","lineNumber":166},{"declaringClass":"java.util.concurrent.ThreadPoolExecutor","methodName":"runWorker","fileName":"ThreadPoolExecutor.java","lineNumber":1110},{"declaringClass":"java.util.concurrent.ThreadPoolExecutor$Worker","methodName":"run","fileName":"ThreadPoolExecutor.java","lineNumber":603},{"declaringClass":"java.lang.Thread","methodName":"run","fileName":"Thread.java","lineNumber":679}]} > at > org.apache.cloudstack.framework.jobs.impl.JobSerializerHelper.fromObjectSerializedString(JobSerializerHelper.java:135) > at > org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl.unmarshallResultObject(AsyncJobManagerImpl.java:669) > at > com.cloud.storage.VolumeApiServiceImpl.attachVolumeToVM(VolumeApiServiceImpl.java:1115) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:616) > at > org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) > at > org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91) > at > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) > at > org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) > at $Proxy195.attachVolumeToVM(Unknown Source) > at > org.apache.cloudstack.api.command.user.volume.AttachVolumeCmd.execute(AttachVolumeCmd.java:123) > at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:161) > at > com.cloud.api.ApiAsyncJobDispatcher.runJobInContext(ApiAsyncJobDispatcher.java:109) > at > com.cloud.api.ApiAsyncJobDispatcher$1.run(ApiAsyncJobDispatcher.java:66) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) > at > com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:63) > at > org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:524) > at > org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) > at > org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) > at java.lang.Thread.run(Thread.java:679) > Caused by: java.io.StreamCorruptedException: invalid stream header: 72899C96 > at > java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:800) > at java.io.ObjectInputStream.<init>(ObjectInputStream.java:297) > at > org.apache.cloudstack.framework.jobs.impl.JobSerializerHelper.fromObjectSerializedString(JobSerializerHelper.java:129) > ... 33 more > 2014-01-06 11:53:37,457 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] > (Job-Executor-114:ctx-035abfcd) Complete async job-141, jobStatus: FAILED, > resultCode: 530, result: > org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Unable > to serialize: > com.cloud.utils.exception.CloudRuntimeException/{\"idList\":[],\"uuidList\":[],\"csErrorCode\":4250,\"detailMessage\":\"copy > volume failed: > java.lang.NullPointerException\",\"cause\":{\"class\":\"com.cloud.utils.exception.CloudRuntimeException\",\"msg\":\"copy > volume failed: > java.lang.NullPointerException\"},\"stackTrace\":[{\"declaringClass\":\"org.apache.cloudstack.engine.orchestration.VolumeOrchestrator\",\"methodName\":\"copyVolumeFromSecToPrimary\",\"fileName\":\"VolumeOrchestrator.java\",\"lineNumber\":412},{\"declaringClass\":\"org.apache.cloudstack.engine.orchestration.VolumeOrchestrator\",\"methodName\":\"copyVolume\",\"fileName\":\"VolumeOrchestrator.java\",\"lineNumber\":718},{\"declaringClass\":\"org.apache.cloudstack.engine.orchestration.VolumeOrchestrator\",\"methodName\":\"createVolumeOnPrimaryStorage\",\"fileName\":\"VolumeOrchestrator.java\",\"lineNumber\":747},{\"declaringClass\":\"com.cloud.storage.VolumeApiServiceImpl\",\"methodName\":\"attachVolumeToVM\",\"fileName\":\"VolumeApiServiceImpl.java\",\"lineNumber\":1249},{\"declaringClass\":\"com.cloud.storage.VolumeApiServiceImpl\",\"methodName\":\"orchestrateAttachVolumeToVM\",\"fileName\":\"VolumeApiServiceImpl.java\",\"lineNumber\":1127},{\"declaringClass\":\"com.cloud.storage.VolumeApiServiceImpl\",\"methodName\":\"orchestrateAttachVolumeToVM\",\"fileName\":\"VolumeApiServiceImpl.java\",\"lineNumber\":2406},{\"declaringClass\":\"sun.reflect.NativeMethodAccessorImpl\",\"methodName\":\"invoke0\",\"fileName\":\"NativeMethodAccessorImpl.java\",\"lineNumber\":-2},{\"declaringClass\":\"sun.reflect.NativeMethodAccessorImpl\",\"methodName\":\"invoke\",\"fileName\":\"NativeMethodAccessorImpl.java\",\"lineNumber\":57},{\"declaringClass\":\"sun.reflect.DelegatingMethodAccessorImpl\",\"methodName\":\"invoke\",\"fileName\":\"DelegatingMethodAccessorImpl.java\",\"lineNumber\":43},{\"declaringClass\":\"java.lang.reflect.Method\",\"methodName\":\"invoke\",\"fileName\":\"Method.java\",\"lineNumber\":616},{\"declaringClass\":\"com.cloud.vm.VmWorkJobHandlerProxy\",\"methodName\":\"handleVmWorkJob\",\"fileName\":\"VmWorkJobHandlerProxy.java\",\"lineNumber\":107},{\"declaringClass\":\"com.cloud.storage.VolumeApiServiceImpl\",\"methodName\":\"handleVmWorkJob\",\"fileName\":\"VolumeApiServiceImpl.java\",\"lineNumber\":2437},{\"declaringClass\":\"sun.reflect.NativeMethodAccessorImpl\",\"methodName\":\"invoke0\",\"fileName\":\"NativeMethodAccessorImpl.java\",\"lineNumber\":-2},{\"declaringClass\":\"sun.reflect.NativeMethodAccessorImpl\",\"methodName\":\"invoke\",\"fileName\":\"NativeMethodAccessorImpl.java\",\"lineNumber\":57},{\"declaringClass\":\"sun.reflect.DelegatingMethodAccessorImpl\",\"methodName\":\"invoke\",\"fileName\":\"DelegatingMethodAccessorImpl.java\",\"lineNumber\":43},{\"declaringClass\":\"java.lang.reflect.Method\",\"methodName\":\"invoke\",\"fileName\":\"Method.java\",\"lineNumber\":616},{\"declaringClass\":\"org.springframework.aop.support.AopUtils\",\"methodName\":\"invokeJoinpointUsingReflection\",\"fileName\":\"AopUtils.java\",\"lineNumber\":317},{\"declaringClass\":\"org.springframework.aop.framework.ReflectiveMethodInvocation\",\"methodName\":\"invokeJoinpoint\",\"fileName\":\"ReflectiveMethodInvocation.java\",\"lineNumber\":183},{\"declaringClass\":\"org.springframework.aop.framework.ReflectiveMethodInvocation\",\"methodName\":\"proceed\",\"fileName\":\"ReflectiveMethodInvocation.java\",\"lineNumber\":150},{\"declaringClass\":\"org.springframework.aop.interceptor.ExposeInvocationInterceptor\",\"methodName\":\"invoke\",\"fileName\":\"ExposeInvocationInterceptor.java\",\"lineNumber\":91},{\"declaringClass\":\"org.springframework.aop.framework.ReflectiveMethodInvocation\",\"methodName\":\"proceed\",\"fileName\":\"ReflectiveMethodInvocation.java\",\"lineNumber\":172},{\"declaringClass\":\"org.springframework.aop.framework.JdkDynamicAopProxy\",\"methodName\":\"invoke\",\"fileName\":\"JdkDynamicAopProxy.java\",\"lineNumber\":204},{\"declaringClass\":\"$Proxy195\",\"methodName\":\"handleVmWorkJob\",\"lineNumber\":-1},{\"declaringClass\":\"com.cloud.vm.VmWorkJobDispatcher\",\"methodName\":\"runJob\",\"fileName\":\"VmWorkJobDispatcher.java\",\"lineNumber\":99},{\"declaringClass\":\"org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5\",\"methodName\":\"runInContext\",\"fileName\":\"AsyncJobManagerImpl.java\",\"lineNumber\":524},{\"declaringClass\":\"org.apache.cloudstack.managed.context.ManagedContextRunnable$1\",\"methodName\":\"run\",\"fileName\":\"ManagedContextRunnable.java\",\"lineNumber\":49},{\"declaringClass\":\"org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1\",\"methodName\":\"call\",\"fileName\":\"DefaultManagedContext.java\",\"lineNumber\":56},{\"declaringClass\":\"org.apache.cloudstack.managed.context.impl.DefaultManagedContext\",\"methodName\":\"callWithContext\",\"fileName\":\"DefaultManagedContext.java\",\"lineNumber\":103},{\"declaringClass\":\"org.apache.cloudstack.managed.context.impl.DefaultManagedContext\",\"methodName\":\"runWithContext\",\"fileName\":\"DefaultManagedContext.java\",\"lineNumber\":53},{\"declaringClass\":\"org.apache.cloudstack.managed.context.ManagedContextRunnable\",\"methodName\":\"run\",\"fileName\":\"ManagedContextRunnable.java\",\"lineNumber\":46},{\"declaringClass\":\"java.util.concurrent.Executors$RunnableAdapter\",\"methodName\":\"call\",\"fileName\":\"Executors.java\",\"lineNumber\":471},{\"declaringClass\":\"java.util.concurrent.FutureTask$Sync\",\"methodName\":\"innerRun\",\"fileName\":\"FutureTask.java\",\"lineNumber\":334},{\"declaringClass\":\"java.util.concurrent.FutureTask\",\"methodName\":\"run\",\"fileName\":\"FutureTask.java\",\"lineNumber\":166},{\"declaringClass\":\"java.util.concurrent.ThreadPoolExecutor\",\"methodName\":\"runWorker\",\"fileName\":\"ThreadPoolExecutor.java\",\"lineNumber\":1110},{\"declaringClass\":\"java.util.concurrent.ThreadPoolExecutor$Worker\",\"methodName\":\"run\",\"fileName\":\"ThreadPoolExecutor.java\",\"lineNumber\":603},{\"declaringClass\":\"java.lang.Thread\",\"methodName\":\"run\",\"fileName\":\"Thread.java\",\"lineNumber\":679}]}"} > nagedContext$1.call(DefaultManagedContext.java:56) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) > at > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) > at > org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) > at java.lang.Thread.run(Thread.java:679) > Caused by: java.io.StreamCorruptedException: invalid stream header: 72899C96 > at > java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:800) > at java.io.ObjectInputStream.<init>(ObjectInputStream.java:297) > at > org.apache.cloudstack.framework.jobs.impl.JobSerializerHelper.fromObjectSerializedString(JobSerializerHelper.java:129) > ... 33 more > 2014-01-06 11:53:37,457 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] > (Job-Executor-114:ctx-035abfcd) Complete async job-141, jobStatus: FAILED, > resultCode: 530, result: > org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Unable > to serialize: > com.cloud.utils.exception.CloudRuntimeException/{\"idList\":[],\"uuidList\":[],\"csErrorCode\":4250,\"detailMessage\":\"copy > volume failed: > java.lang.NullPointerException\",\"cause\":{\"class\":\"com.cloud.utils.exception.CloudRuntimeException\",\"msg\":\"copy > volume failed: > java.lang.NullPointerException\"},\"stackTrace\":[{\"declaringClass\":\"org.apache.cloudstack.engine.orchestration.VolumeOrchestrator\",\"methodName\":\"copyVolumeFromSecToPrimary\",\"fileName\":\"VolumeOrchestrator.java\",\"lineNumber\":412},{\"declaringClass\":\"org.apache.cloudstack.engine.orchestration.VolumeOrchestrator\",\"methodName\":\"copyVolume\",\"fileName\":\"VolumeOrchestrator.java\",\"lineNumber\":718},{\"declaringClass\":\"org.apache.cloudstack.engine.orchestration.VolumeOrchestrator\",\"methodName\":\"createVolumeOnPrimaryStorage\",\"fileName\":\"VolumeOrchestrator.java\",\"lineNumber\":747},{\"declaringClass\":\"com.cloud.storage.VolumeApiServiceImpl\",\"methodName\":\"attachVolumeToVM\",\"fileName\":\"VolumeApiServiceImpl.java\",\"lineNumber\":1249},{\"declaringClass\":\"com.cloud.storage.VolumeApiServiceImpl\",\"methodName\":\"orchestrateAttachVolumeToVM\",\"fileName\":\"VolumeApiServiceImpl.java\",\"lineNumber\":1127},{\"declaringClass\":\"com.cloud.storage.VolumeApiServiceImpl\",\"methodName\":\"orchestrateAttachVolumeToVM\",\"fileName\":\"VolumeApiServiceImpl.java\",\"lineNumber\":2406},{\"declaringClass\":\"sun.reflect.NativeMethodAccessorImpl\",\"methodName\":\"invoke0\",\"fileName\":\"NativeMethodAccessorImpl.java\",\"lineNumber\":-2},{\"declaringClass\":\"sun.reflect.NativeMethodAccessorImpl\",\"methodName\":\"invoke\",\"fileName\":\"NativeMethodAccessorImpl.java\",\"lineNumber\":57},{\"declaringClass\":\"sun.reflect.DelegatingMethodAccessorImpl\",\"methodName\":\"invoke\",\"fileName\":\"DelegatingMethodAccessorImpl.java\",\"lineNumber\":43},{\"declaringClass\":\"java.lang.reflect.Method\",\"methodName\":\"invoke\",\"fileName\":\"Method.java\",\"lineNumber\":616},{\"declaringClass\":\"com.cloud.vm.VmWorkJobHandlerProxy\",\"methodName\":\"handleVmWorkJob\",\"fileName\":\"VmWorkJobHandlerProxy.java\",\"lineNumber\":107},{\"declaringClass\":\"com.cloud.storage.VolumeApiServiceImpl\",\"methodName\":\"handleVmWorkJob\",\"fileName\":\"VolumeApiServiceImpl.java\",\"lineNumber\":2437},{\"declaringClass\":\"sun.reflect.NativeMethodAccessorImpl\",\"methodName\":\"invoke0\",\"fileName\":\"NativeMethodAccessorImpl.java\",\"lineNumber\":-2},{\"declaringClass\":\"sun.reflect.NativeMethodAccessorImpl\",\"methodName\":\"invoke\",\"fileName\":\"NativeMethodAccessorImpl.java\",\"lineNumber\":57},{\"declaringClass\":\"sun.reflect.DelegatingMethodAccessorImpl\",\"methodName\":\"invoke\",\"fileName\":\"DelegatingMethodAccessorImpl.java\",\"lineNumber\":43},{\"declaringClass\":\"java.lang.reflect.Method\",\"methodName\":\"invoke\",\"fileName\":\"Method.java\",\"lineNumber\":616},{\"declaringClass\":\"org.springframework.aop.support.AopUtils\",\"methodName\":\"invokeJoinpointUsingReflection\",\"fileName\":\"AopUtils.java\",\"lineNumber\":317},{\"declaringClass\":\"org.springframework.aop.framework.ReflectiveMethodInvocation\",\"methodName\":\"invokeJoinpoint\",\"fileName\":\"ReflectiveMethodInvocation.java\",\"lineNumber\":183},{\"declaringClass\":\"org.springframework.aop.framework.ReflectiveMethodInvocation\",\"methodName\":\"proceed\",\"fileName\":\"ReflectiveMethodInvocation.java\",\"lineNumber\":150},{\"declaringClass\":\"org.springframework.aop.interceptor.ExposeInvocationInterceptor\",\"methodName\":\"invoke\",\"fileName\":\"ExposeInvocationInterceptor.java\",\"lineNumber\":91},{\"declaringClass\":\"org.springframework.aop.framework.ReflectiveMethodInvocation\",\"methodName\":\"proceed\",\"fileName\":\"ReflectiveMethodInvocation.java\",\"lineNumber\":172},{\"declaringClass\":\"org.springframework.aop.framework.JdkDynamicAopProxy\",\"methodName\":\"invoke\",\"fileName\":\"JdkDynamicAopProxy.java\",\"lineNumber\":204},{\"declaringClass\":\"$Proxy195\",\"methodName\":\"handleVmWorkJob\",\"lineNumber\":-1},{\"declaringClass\":\"com.cloud.vm.VmWorkJobDispatcher\",\"methodName\":\"runJob\",\"fileName\":\"VmWorkJobDispatcher.java\",\"lineNumber\":99},{\"declaringClass\":\"org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5\",\"methodName\":\"runInContext\",\"fileName\":\"AsyncJobManagerImpl.java\",\"lineNumber\":524},{\"declaringClass\":\"org.apache.cloudstack.managed.context.ManagedContextRunnable$1\",\"methodName\":\"run\",\"fileName\":\"ManagedContextRunnable.java\",\"lineNumber\":49},{\"declaringClass\":\"org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1\",\"methodName\":\"call\",\"fileName\":\"DefaultManagedContext.java\",\"lineNumber\":56},{\"declaringClass\":\"org.apache.cloudstack.managed.context.impl.DefaultManagedContext\",\"methodName\":\"callWithContext\",\"fileName\":\"DefaultManagedContext.java\",\"lineNumber\":103},{\"declaringClass\":\"org.apache.cloudstack.managed.context.impl.DefaultManagedContext\",\"methodName\":\"runWithContext\",\"fileName\":\"DefaultManagedContext.java\",\"lineNumber\":53},{\"declaringClass\":\"org.apache.cloudstack.managed.context.ManagedContextRunnable\",\"methodName\":\"run\",\"fileName\":\"ManagedContextRunnable.java\",\"lineNumber\":46},{\"declaringClass\":\"java.util.concurrent.Executors$RunnableAdapter\",\"methodName\":\"call\",\"fileName\":\"Executors.java\",\"lineNumber\":471},{\"declaringClass\":\"java.util.concurrent.FutureTask$Sync\",\"methodName\":\"innerRun\",\"fileName\":\"FutureTask.java\",\"lineNumber\":334},{\"declaringClass\":\"java.util.concurrent.FutureTask\",\"methodName\":\"run\",\"fileName\":\"FutureTask.java\",\"lineNumber\":166},{\"declaringClass\":\"java.util.concurrent.ThreadPoolExecutor\",\"methodName\":\"runWorker\",\"fileName\":\"ThreadPoolExecutor.java\",\"lineNumber\":1110},{\"declaringClass\":\"java.util.concurrent.ThreadPoolExecutor$Worker\",\"methodName\":\"run\",\"fileName\":\"ThreadPoolExecutor.java\",\"lineNumber\":603},{\"declaringClass\":\"java.lang.Thread\",\"methodName\":\"run\",\"fileName\":\"Thread.java\",\"lineNumber\":679}]}"} > 2014-01-06 11:53:37,454 WARN [o.a.c.f.j.i.AsyncJobManagerImpl] > (Job-Executor-116:ctx-9f6a5f51) job-141 is scheduled for wakeup run, but > there is no joining info anymore > 2014-01-06 11:53:37,461 ERROR [o.a.c.f.j.i.AsyncJobManagerImpl] > (Job-Executor-116:ctx-9f6a5f51) Unable to find a wakeup dispatcher from the > joined job: AsyncJobVO {id:141, userId: 2, accountId: 2, instanceType: > Volume, instanceId: 19, cmd: > org.apache.cloudstack.api.command.user.volume.AttachVolumeCmd, cmdInfo: > {"response":"json","id":"4d5e35e3-2a67-4d1e-8758-7c6b283866cd","sessionkey":"5ODiLDmKehMbGznMVT9sutQQg7U\u003d","cmdEventType":"VOLUME.ATTACH","ctxUserId":"2","virtualMachineId":"62064ead-e49e-4bb7-86e7-7422f33e3f75","httpmethod":"GET","_":"1388989738235","ctxAccountId":"2","ctxStartEventId":"332"}, > cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result: > null, initMsid: 280320865129348, completeMsid: null, lastUpdated: null, > lastPolled: Mon Jan 06 11:53:36 IST 2014, created: Mon Jan 06 11:53:27 IST > 2014} > 2014-01-06 11:53:37,461 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] > (Job-Executor-116:ctx-9f6a5f51) Done executing > org.apache.cloudstack.api.command.user.volume.AttachVolumeCmd for job-141 > 2014-01-06 11:53:37,465 INFO [o.a.c.f.j.i.AsyncJobMonitor] > (Job-Executor-116:ctx-9f6a5f51) Remove job-141 from job monitoring > 2014-01-06 11:53:37,468 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl] > (Job-Executor-114:ctx-035abfcd) Done executing > org.apache.cloudstack.api.command.user.volume.AttachVolumeCmd for job-141 > Agent logs : > ------------------------------------ > 2014-01-06 07:06:11,293 [24] INFO HypervResource.HypervResourceController > [ee43f27c-cfea-4abc-b715-4114af3bc691] - > org.apache.cloudstack.storage.command.CopyCommand{ > "srcTO": { > "org.apache.cloudstack.storage.to.VolumeObjectTO": { > "uuid": "88a1e01c-105b-4c6a-a443-513ad65d0447", > "volumeType": "DATADISK", > "dataStore": { > "com.cloud.agent.api.to.NfsTO": { > "_url": > "cifs://10.102.192.19/hyperv-share/abhinav-hyperv-ss1?user=abhinavroy&password=freebsd@123&domain=BLR", > "_role": "Image" > } > }, > "name": "av-upload2", > "size": 5368709120, > "path": "volumes/2/26/93f17813-1e10-324e-b276-47ec9ed813c0.vhd", > "volumeId": 26, > "accountId": 2, > "format": "VHD", > "id": 26, > "hypervisorType": "Hyperv" > } > }, > "destTO": { > "org.apache.cloudstack.storage.to.VolumeObjectTO": { > "uuid": "88a1e01c-105b-4c6a-a443-513ad65d0447", > "volumeType": "DATADISK", > "dataStore": { > "org.apache.cloudstack.storage.to.PrimaryDataStoreTO": { > "uuid": "088db467-32e3-3d0a-bca0-20e3382fe902", > "id": 1, > "poolType": "NetworkFilesystem", > "host": "SMB19", > "path": > "/hyperv-share/abhinav-hyperv-ps1?user=abhinavroy&password=freebsd@123&domain=BLR", > "port": 445, > "url": > "NetworkFilesystem://SMB19//hyperv-share/abhinav-hyperv-ps1?user=abhinavroy&password=freebsd@123&domain=BLR/?ROLE=Primary&STOREUUID=088db467-32e3-3d0a-bca0-20e3382fe902" > } > }, > "name": "av-upload2", > "size": 5368709120, > "volumeId": 26, > "accountId": 2, > "format": "VHD", > "id": 26, > "hypervisorType": "Hyperv" > } > }, > "executeInSequence": false, > "options": {}, > "contextMap": {}, > "wait": 10800 > } > 2014-01-06 07:06:31,215 [22] INFO HypervResource.HypervResourceController > [fb446b9b-fe66-41e6-a652-fa149475526e] - > com.cloud.agent.api.GetHostStatsCommand{ > "hostGuid": "23ca5fe2-a504-3bac-83a5-519315d0bc3d-HypervResource", > "hostName": "10.102.192.14", > "hostId": 5, > "contextMap": {}, > "wait": 0 > } > 2014-01-06 07:06:31,574 [22] INFO HypervResource.HypervResourceController > [fb446b9b-fe66-41e6-a652-fa149475526e] - { > "com.cloud.agent.api.GetHostStatsAnswer": { > "result": true, > "hostStats": { > "hostId": 5, > "entityType": "host", > "cpuUtilization": 5.0, > "networkReadKBs": 0.0, > "networkWriteKBs": 0.0, > "totalMemoryKBs": 16763980.0, > "freeMemoryKBs": 13853540.0 > }, > "details": null, > "contextMap": {} > } > } > 2014-01-06 07:06:33,871 [24] ERROR HypervResource.VolumeObjectTO > [ee43f27c-cfea-4abc-b715-4114af3bc691] - Invalid dataStore in VolumeObjectTO > spec > 2014-01-06 07:06:33,871 [24] ERROR HypervResource.HypervResourceController > [ee43f27c-cfea-4abc-b715-4114af3bc691] - > org.apache.cloudstack.storage.command.CopyCommand failed on exception, Error > getting value from 'FullFileName' on 'HypervResource.VolumeObjectTO'. > Newtonsoft.Json.JsonSerializationException: Error getting value from > 'FullFileName' on 'HypervResource.VolumeObjectTO'. ---> > System.IO.InvalidDataException: Invalid dataStore in VolumeObjectTO spec > at HypervResource.VolumeObjectTO.get_FullFileName() > at GetFullFileName(Object ) > at Newtonsoft.Json.Serialization.DynamicValueProvider.GetValue(Object > target) > --- End of inner exception stack trace --- > at Newtonsoft.Json.Serialization.DynamicValueProvider.GetValue(Object > target) > at > Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.CalculatePropertyValues(JsonWriter > writer, Object value, JsonContainerContract contract, JsonProperty member, > JsonProperty property, JsonContract& memberContract, Object& memberValue) > at > Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.SerializeObject(JsonWriter > writer, Object value, JsonObjectContract contract, JsonProperty member, > JsonContainerContract collectionContract, JsonProperty containerProperty) > at > Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.SerializeValue(JsonWriter > writer, Object value, JsonContract valueContract, JsonProperty member, > JsonContainerContract containerContract, JsonProperty containerProperty) > at > Newtonsoft.Json.Serialization.JsonSerializerInternalWriter.Serialize(JsonWriter > jsonWriter, Object value) > at Newtonsoft.Json.JsonSerializer.SerializeInternal(JsonWriter jsonWriter, > Object value) > at Newtonsoft.Json.Linq.JToken.FromObjectInternal(Object o, JsonSerializer > jsonSerializer) > at Newtonsoft.Json.Linq.JToken.FromObject(Object o) > at HypervResource.Utils.CreateCloudStackObject(String objType, Object > objValue) > at HypervResource.HypervResourceController.CopyCommand(Object cmd) > 2014-01-06 07:06:33,871 [24] INFO HypervResource.HypervResourceController > [ee43f27c-cfea-4abc-b715-4114af3bc691] - { > "org.apache.cloudstack.storage.command.CopyCmdAnswer": { > "result": false, > "details": "org.apache.cloudstack.storage.command.CopyCommand failed on > exception, Error getting value from 'FullFileName' on > 'HypervResource.VolumeObjectTO'.", > "newData": null, > "contextMap": {} > } > } -- This message was sent by Atlassian JIRA (v6.1.5#6160)