Rayees Namathponnan created CLOUDSTACK-4768: -----------------------------------------------
Summary: [Automation] Race condition; delete the template and create VM at same time; deployment failed with libvirt error Key: CLOUDSTACK-4768 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-4768 Project: CloudStack Issue Type: Bug Security Level: Public (Anyone can view this level - this is the default.) Components: KVM Affects Versions: 4.2.1 Environment: KVM (RHEL 6.3) branch - 4.2-forward Reporter: Rayees Namathponnan Assignee: edison su Fix For: 4.2.1 This issue observed during regression automation run, few vm deployment failed due to some race condition; this issue observed while template delete and deploy vm command issued at same time Observed below error in MS log; attached full logs with this defect 2013-09-27 19:39:36,490 DEBUG [agent.manager.AgentManagerImpl] (AgentManager-Handler-4:null) Ping from 9 2013-09-27 19:39:36,678 DEBUG [agent.transport.Request] (AgentManager-Handler-10:null) Seq 2-1251542761: Processing: { Ans: , MgmtId: 29066118877352, via: 2, Ver: v1, Flags: 110, [{"com.cloud.agent.api.StartAnswer":{"vm":{"id":247,"name":"i-192-247-QA","type":"User","cpus":1,"minSpeed":100,"maxSpeed":100,"minRam":134217728,"maxRam":134217728,"arch ":"x86_64","os":"CentOS 5.5 (64-bit)","bootArgs":"","rebootOnCrash":false,"enableHA":false,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"992293216169b56" ,"vncAddr":"10.223.50.67","params":{"Message.ReservedCapacityFreed.Flag":"false"},"uuid":"590048c7-682c-4dd5-be5e-b0ea9203d181","disks":[{"data":{"org.apache.cloudstack.storag e.to.VolumeObjectTO":{"uuid":"a7b372d9-8cb4-4549-9ce1-6b4b2b249472","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"41b632b5-40 b3-3024-a38b-ea259c72579f","id":2,"poolType":"NetworkFilesystem","host":"10.223.110.232","path":"/export/home/rayees/SC_QA_AUTO4/primary2","port":2049}},"name":"ROOT-247","siz e":8589934592,"path":"35083f24-8882-4754-b29f-6ce8025df305","volumeId":271,"vmName":"i-192-247-QA","accountId":192,"format":"QCOW2","id":271,"hypervisorType":"KVM"}},"diskSeq" :0,"type":"ROOT"},{"data":{"org.apache.cloudstack.storage.to.TemplateObjectTO":{"id":0,"format":"ISO","accountId":0,"hvm":false}},"diskSeq":3,"type":"ISO"}],"nics":[{"deviceId ":0,"networkRateMbps":200,"defaultNic":true,"uuid":"b10db69f-b7f6-419f-872a-feaa31cab581","ip":"10.1.1.221","netmask":"255.255.255.0","gateway":"10.1.1.1","mac":"02:00:5a:16:0 0:02","dns1":"8.8.8.8","broadcastType":"Vlan","type":"Guest","broadcastUri":"vlan://2340","isolationUri":"vlan://2340","isSecurityGroupEnabled":false}]},"result":false,"detail s":"unable to set user and group to '0:0' on '/mnt/41b632b5-40b3-3024-a38b-ea259c72579f/ddeac719-b362-4462-b905-6b07578108de': No such file or directory","wait":0}}] } 2013-09-27 19:39:36,679 DEBUG [agent.manager.AgentAttache] (AgentManager-Handler-10:null) Seq 2-1251542761: No more commands found 2013-09-27 19:39:36,679 DEBUG [agent.transport.Request] (Job-Executor-139:job-1077 = [ f7164e6a-544f-4c8d-8dc6-45d74ace2094 ]) Seq 2-1251542761: Received: { Ans: , MgmtId: 29 066118877352, via: 2, Ver: v1, Flags: 110, { StartAnswer } } 2013-09-27 19:39:36,683 INFO [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-139:job-1077 = [ f7164e6a-544f-4c8d-8dc6-45d74ace2094 ]) Unable to start VM on Host[-2-Routing ] due to unable to set user and group to '0:0' on '/mnt/41b632b5-40b3-3024-a38b-ea259c72579f/ddeac719-b362-4462-b905-6b07578108de': No such file or directory 2013-09-27 19:39:36,686 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-139:job-1077 = [ f7164e6a-544f-4c8d-8dc6-45d74ace2094 ]) Cleaning up resources for the vm VM[U ser|590048c7-682c-4dd5-be5e-b0ea9203d181] in Starting state 2013-09-27 19:39:36,687 DEBUG [agent.transport.Request] (Job-Executor-139:job-1077 = [ f7164e6a-544f-4c8d-8dc6-45d74ace2094 ]) Seq 2-1251542762: Sending { Cmd , MgmtId: 29066 118877352, via: 2, Ver: v1, Flags: 100111, [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":true,"vmName":"i-192-247-QA","wait":0}}] } 2013-09-27 19:39:36,884 DEBUG [agent.transport.Request] (AgentManager-Handler-11:null) Seq 2-1251542762: Processing: { Ans: , MgmtId: 29066118877352, via: 2, Ver: v1, Flags: 110, [{"com.cloud.agent.api.StopAnswer":{"vncPort":0,"result":true,"wait":0}}] } -- This message was sent by Atlassian JIRA (v6.1#6144)