Rayees Namathponnan created CLOUDSTACK-6842: -----------------------------------------------
Summary: [Automation] Detach volume fails with LibvirtException: Storage pool not found: no storage pool with matching uuid Key: CLOUDSTACK-6842 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-6842 Project: CloudStack Issue Type: Bug Security Level: Public (Anyone can view this level - this is the default.) Components: KVM, Volumes Affects Versions: 4.4.0 Environment: KVM - RHEL 6.3 Branch - 4.4-forward Reporter: Rayees Namathponnan Priority: Blocker Fix For: 4.4.0 This issue is observed during KVM automation run, test cases failed during detach volume operation below exception 2014-06-03 22:51:27,825 DEBUG [c.c.n.NetworkModelImpl] (Network-Scavenger-1:ctx-355fa5da) Network id=221 is not ready for GC as it has vms that are Starting at the moment 2014-06-03 22:51:27,878 DEBUG [c.c.a.ApiServlet] (catalina-exec-18:ctx-673fdee8) ===START=== 10.223.240.194 -- GET jobid=18 3bb2f8-adac-4577-a19c-a7df2a31b0b6&apiKey=fRS2dHRVFlXSTC9bs2rBKXwD0FNnpHk-Dz_2XI8fgFZii_P6Tx5eLyzluOx8lvuonsbqknPHnIFYT5xNhEv UEA&command=queryAsyncJobResult&response=json&signature=PNHiNNyW76saC8ZAnPwgL89sx9w%3D 2014-06-03 22:51:27,893 DEBUG [c.c.a.ApiServlet] (catalina-exec-18:ctx-673fdee8 ctx-2f4bea09 ctx-49740006) ===END=== 10.223. 240.194 -- GET jobid=183bb2f8-adac-4577-a19c-a7df2a31b0b6&apiKey=fRS2dHRVFlXSTC9bs2rBKXwD0FNnpHk-Dz_2XI8fgFZii_P6Tx5eLyzluOx 8lvuonsbqknPHnIFYT5xNhEvUEA&command=queryAsyncJobResult&response=json&signature=PNHiNNyW76saC8ZAnPwgL89sx9w%3D 2014-06-03 22:51:28,502 DEBUG [c.c.a.t.Request] (AgentManager-Handler-12:null) Seq 1-7390406988514984214: Processing: { Ans: , MgmtId: 29066118877352, via: 1, Ver: v1, Flags: 10, [{"com.cloud.agent.api.Answer":{"result":false,"details":"com.cloud.ut ils.exception.CloudRuntimeException: org.libvirt.LibvirtException: Storage pool not found: no storage pool with matching uuid \n\tat com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.getStoragePool(LibvirtStorageAdaptor.java:389)\n\tat com.cloud. hypervisor.kvm.storage.KVMStoragePoolManager.disconnectPhysicalDisk(KVMStoragePoolManager.java:291)\n\tat com.cloud.hyperviso r.kvm.storage.KVMStorageProcessor.dettachVolume(KVMStorageProcessor.java:1032)\n\tat com.cloud.storage.resource.StorageSubsys temCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:147)\n\tat com.cloud.storage.resource.StorageSubsystemC ommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:60)\n\tat com.cloud.hypervisor.kvm.resource.L ibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1357)\n\tat com.cloud.agent.Agent.processRequest(Agent.j ava:501)\n\tat com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:808)\n\tat com.cloud.utils.nio.Task.run(Task.java: 84)\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)\n\tat java.util.concurrent.ThreadPo olExecutor$Worker.run(ThreadPoolExecutor.java:603)\n\tat java.lang.Thread.run(Thread.java:722)\nCaused by: org.libvirt.Libvir tException: Storage pool not found: no storage pool with matching uuid\n\tat org.libvirt.ErrorHandler.processError(Unknown So urce)\n\tat org.libvirt.Connect.processError(Unknown Source)\n\tat org.libvirt.StoragePool.processError(Unknown Source)\n\tat org.libvirt.StoragePool.getInfo(Unknown Source)\n\tat com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.getStoragePool( LibvirtStorageAdaptor.java:382)\n\t... 11 more\n","wait":0}}] } 2014-06-03 22:51:28,502 DEBUG [c.c.a.t.Request] (Work-Job-Executor-39:ctx-de2c749a job-164/job-165 ctx-82508c0e) Seq 1-7390406988514984214: Received: { Ans: , MgmtId: 29066118877352, via: 1, Ver: v1, Flags: 10, { Answer } } 2014-06-03 22:51:28,502 ERROR [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-39:ctx-de2c749a job-164/job-165 ctx-82508c0e) Invocation exception, caused by: com.cloud.utils.exception.CloudRuntimeException: Failed to detach volume Test Volume from VM QA-19a2e3f6-1ce7-4ed0-9e2e-c436c41a68c1; com.cloud.utils.exception.CloudRuntimeException: org.libvirt.LibvirtException: Storage pool not found: no storage pool with matching uuid at com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.getStoragePool(LibvirtStorageAdaptor.java:389) at com.cloud.hypervisor.kvm.storage.KVMStoragePoolManager.disconnectPhysicalDisk(KVMStoragePoolManager.java:291) at com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.dettachVolume(KVMStorageProcessor.java:1032) at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:147) at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:60) at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1357) at com.cloud.agent.Agent.processRequest(Agent.java:501) at com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:808) at com.cloud.utils.nio.Task.run(Task.java:84) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:722) Caused by: org.libvirt.LibvirtException: Storage pool not found: no storage pool with matching uuid at org.libvirt.ErrorHandler.processError(Unknown Source) at org.libvirt.Connect.processError(Unknown Source) at org.libvirt.StoragePool.processError(Unknown Source) at org.libvirt.StoragePool.getInfo(Unknown Source) at com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.getStoragePool(LibvirtStorageAdaptor.java:382) ... 11 more 2014-06-03 22:51:28,503 INFO [c.c.v.VmWorkJobHandlerProxy] (Work-Job-Executor-39:ctx-de2c749a job-164/job-165 ctx-82508c0e) Rethrow exception com.cloud.utils.exception.CloudRuntimeException: Failed to detach volume Test Volume from VM QA-19a2e3f6-1ce7-4ed0-9e2e-c436c41a68c1; com.cloud.utils.exception.CloudRuntimeException: org.libvirt.LibvirtException: Storage pool not found: no storage pool with matching uuid at com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.getStoragePool(LibvirtStorageAdaptor.java:389) at com.cloud.hypervisor.kvm.storage.KVMStoragePoolManager.disconnectPhysicalDisk(KVMStoragePoolManager.java:291) at com.cloud.hypervisor.kvm.storage.KVMStorageProcessor.dettachVolume(KVMStorageProcessor.java:1032) at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.execute(StorageSubsystemCommandHandlerBase.java:147) at com.cloud.storage.resource.StorageSubsystemCommandHandlerBase.handleStorageCommands(StorageSubsystemCommandHandlerBase.java:60) at com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1357) at com.cloud.agent.Agent.processRequest(Agent.java:501) -- This message was sent by Atlassian JIRA (v6.2#6252)