shweta agarwal created CLOUDSTACK-5054:
------------------------------------------
Summary: vm migration involving storage migration fails with
exception " The object has already been deleted or has not been completely
created "
Key: CLOUDSTACK-5054
URL: https://issues.apache.org/jira/browse/CLOUDSTACK-5054
Project: CloudStack
Issue Type: Bug
Security Level: Public (Anyone can view this level - this is the default.)
Components: Upgrade, VMware
Affects Versions: 4.2.1
Environment: upgraded from 3.0.6 patch E to 4.2.1 with one advance
vmware zone (EXI5.1) and two cluster . Each cluster is n different VCenter
Reporter: shweta agarwal
Priority: Critical
Repro steps:
Created A VM
trying Vm migariton involving storage migration
BUg:
VM migrations fails with exception :
2013-11-06 14:46:43,790 WARN [vmware.resource.VmwareResource]
(DirectAgent-164:10.147.40.24) MigrationCommand failed due to Exception:
javax.xml.ws.soap.SOAPFaultException
Message: The object has already been deleted or has not been completely created
javax.xml.ws.soap.SOAPFaultException: The object has already been deleted or
has not been completely created
at
com.sun.xml.internal.ws.fault.SOAP11Fault.getProtocolException(SOAP11Fault.java:178)
at
com.sun.xml.internal.ws.fault.SOAPFaultBuilder.createException(SOAPFaultBuilder.java:119)
at
com.sun.xml.internal.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:108)
at
com.sun.xml.internal.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:78)
at com.sun.xml.internal.ws.client.sei.SEIStub.invoke(SEIStub.java:107)
at sun.proxy.$Proxy90.retrieveProperties(Unknown Source)
at
com.cloud.hypervisor.vmware.mo.DatacenterMO.getOwnerDatacenter(DatacenterMO.java:311)
at
com.cloud.hypervisor.vmware.mo.HostMO.getHyperHostDatacenter(HostMO.java:215)
at
com.cloud.hypervisor.vmware.resource.VmwareResource.execute(VmwareResource.java:4215)
at
com.cloud.hypervisor.vmware.resource.VmwareResource.executeRequest(VmwareResource.java:461)
at
com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:679)
2013-11-06 14:46:43,798 DEBUG [agent.manager.DirectAgentAttache]
(DirectAgent-164:null) Seq 4-951522009: Response Received:
2013-11-06 14:46:43,799 DEBUG [agent.transport.Request] (DirectAgent-164:null)
Seq 4-951522009: Processing: { Ans: , MgmtId: 6709611331648, via: 4, Ver: v1,
Flags: 110,
[{"com.cloud.agent.api.MigrateWithStorageAnswer":{"result":false,"details":"Exception:
javax.xml.ws.soap.SOAPFaultException\nMessage: The object has already been
deleted or has not been completely created\nStack:
javax.xml.ws.soap.SOAPFaultException: The object has already been deleted or
has not been completely created\n\tat
com.sun.xml.internal.ws.fault.SOAP11Fault.getProtocolException(SOAP11Fault.java:178)\n\tat
com.sun.xml.internal.ws.fault.SOAPFaultBuilder.createException(SOAPFaultBuilder.java:119)\n\tat
com.sun.xml.internal.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:108)\n\tat
com.sun.xml.internal.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:78)\n\tat
com.sun.xml.internal.ws.client.sei.SEIStub.invoke(SEIStub.java:107)\n\tat
sun.proxy.$Proxy90.retrieveProperties(Unknown Source)\n\tat
com.cloud.hypervisor.vmware.mo.DatacenterMO.getOwnerDatacenter(DatacenterMO.java:311)\n\tat
com.cloud.hypervisor.vmware.mo.HostMO.getHyperHostDatacenter(HostMO.java:215)\n\tat
com.cloud.hypervisor.vmware.resource.VmwareResource.execute(VmwareResource.java:4215)\n\tat
com.cloud.hypervisor.vmware.resource.VmwareResource.executeRequest(VmwareResource.java:461)\n\tat
com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186)\n\tat
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)\n\tat
java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)\n\tat
java.util.concurrent.FutureTask.run(FutureTask.java:166)\n\tat
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)\n\tat
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)\n\tat
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)\n\tat
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)\n\tat
java.lang.Thread.run(Thread.java:679)\n","wait":0}}] }
2013-11-06 14:46:43,799 DEBUG [agent.transport.Request]
(Job-Executor-83:job-137 = [ db8c2f69-e9ca-4e58-a376-fafd064167ad ]) Seq
4-951522009: Received: { Ans: , MgmtId: 6709611331648, via: 4, Ver: v1, Flags:
110, { MigrateWithStorageAnswer } }
2013-11-06 14:46:43,799 ERROR [storage.motion.VmwareStorageMotionStrategy]
(Job-Executor-83:job-137 = [ db8c2f69-e9ca-4e58-a376-fafd064167ad ]) Migration
with storage of vm VM[User|882a475a-a9f0-4ec6-a7cc-5e2899d4b3a7] failed.
Details: Exception: javax.xml.ws.soap.SOAPFaultException
Message: The object has already been deleted or has not been completely created
Stack: javax.xml.ws.soap.SOAPFaultException: The object has already been
deleted or has not been completely created
at
com.sun.xml.internal.ws.fault.SOAP11Fault.getProtocolException(SOAP11Fault.java:178)
at
com.sun.xml.internal.ws.fault.SOAPFaultBuilder.createException(SOAPFaultBuilder.java:119)
at
com.sun.xml.internal.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:108)
at
com.sun.xml.internal.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:78)
at com.sun.xml.internal.ws.client.sei.SEIStub.invoke(SEIStub.java:107)
at sun.proxy.$Proxy90.retrieveProperties(Unknown Source)
at
com.cloud.hypervisor.vmware.mo.DatacenterMO.getOwnerDatacenter(DatacenterMO.java:311)
at
com.cloud.hypervisor.vmware.mo.HostMO.getHyperHostDatacenter(HostMO.java:215)
at
com.cloud.hypervisor.vmware.resource.VmwareResource.execute(VmwareResource.java:4215)
at
com.cloud.hypervisor.vmware.resource.VmwareResource.executeRequest(VmwareResource.java:461)
at
com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:679)
2013-11-06 14:46:43,801 ERROR [storage.motion.VmwareStorageMotionStrategy]
(Job-Executor-83:job-137 = [ db8c2f69-e9ca-4e58-a376-fafd064167ad ]) copy failed
com.cloud.utils.exception.CloudRuntimeException: Error while migrating the vm
VM[User|882a475a-a9f0-4ec6-a7cc-5e2899d4b3a7] to host Host[-1-Routing].
Exception: javax.xml.ws.soap.SOAPFaultException
Message: The object has already been deleted or has not been completely created
Stack: javax.xml.ws.soap.SOAPFaultException: The object has already been
deleted or has not been completely created
at
com.sun.xml.internal.ws.fault.SOAP11Fault.getProtocolException(SOAP11Fault.java:178)
at
com.sun.xml.internal.ws.fault.SOAPFaultBuilder.createException(SOAPFaultBuilder.java:119)
at
com.sun.xml.internal.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:108)
at
com.sun.xml.internal.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:78)
at com.sun.xml.internal.ws.client.sei.SEIStub.invoke(SEIStub.java:107)
at sun.proxy.$Proxy90.retrieveProperties(Unknown Source)
at
com.cloud.hypervisor.vmware.mo.DatacenterMO.getOwnerDatacenter(DatacenterMO.java:311)
at
com.cloud.hypervisor.vmware.mo.HostMO.getHyperHostDatacenter(HostMO.java:215)
at
com.cloud.hypervisor.vmware.resource.VmwareResource.execute(VmwareResource.java:4215)
at
com.cloud.hypervisor.vmware.resource.VmwareResource.executeRequest(VmwareResource.java:461)
at
com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
--
This message was sent by Atlassian JIRA
(v6.1#6144)
