[ https://issues.apache.org/jira/browse/CLOUDSTACK-2330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13661821#comment-13661821 ]
Rajesh Battala commented on CLOUDSTACK-2330: -------------------------------------------- Rayees, After you had filed the bug, next automation run show the router tests was successful and in this run it got failed. Can you please share the logs from the location I had mention in the above comment. >From prasanna comment it looks like there was no issue. from the latest tests(running today) of test_routers tests were passing well and the job triggered by kvm, centos63 http://jenkins.buildacloud.org/job/test-smoke-matrix/suite=test_routers/291/console Started by upstream project "test-matrix/distro=centos63,hypervisor=kvm,profile=kvm-centos63" build number 286 originally caused by: Started by upstream project "test-matrix" build number 286 restarting libvirtd service is resolving the issue, am changing from Blocker to critical > [Automation] Failed to deploy VR in KVM > ---------------------------------------- > > Key: CLOUDSTACK-2330 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-2330 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) > Components: Management Server > Affects Versions: 4.2.0 > Environment: KVM, > Master build > Reporter: Rayees Namathponnan > Assignee: Rajesh Battala > Priority: Blocker > Fix For: 4.2.0 > > Attachments: CLOUDSTACK-2330.rar > > > Automation running on KVM with advanced zone,VR deployment failing during > automation run > Observed below error in MS log, attaching MS and agent log > 2013-05-04 13:43:13,032 DEBUG > [network.router.VirtualNetworkApplianceManagerImpl] (Job-Executor-99:job-369) > Reapplying vm data (userData and metaData) entries as a part of domR > VM[DomainRouter|r-155-VM] start... > 2013-05-04 13:43:13,040 DEBUG [agent.transport.Request] > (Job-Executor-99:job-369) Seq 4-98894092: Sending { Cmd , MgmtId: > 29066118877352, via: 4, Ver: v1, Flags: 100111, [{"Sta > rtCommand":{"vm":{"id":155,"name":"r-155-VM","type":"DomainRouter","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":134217728,"maxRam":134217728,"arch":"x86_64","os":"Debian > GNU/ > Linux 5.0 (32-bit)","bootArgs":" template=domP name=r-155-VM > eth2ip=10.223.122.89 eth2mask=255.255.255.192 gateway=10.223.122.65 > eth0ip=10.1.1.1 eth0mask=255.255.255.0 domain=cs > 2auto.advanced dhcprange=10.1.1.1 eth1ip=169.254.3.220 eth1mask=255.255.0.0 > type=router disable_rp_filter=true > dns1=72.52.126.11","rebootOnCrash":false,"enableHA":true,"limitCpu > Use":false,"vncPassword":"a3b0c243e954e90e","params":{},"uuid":"f114bcc5-1f3f-4fcb-85f7-3ed9d40467dc","disks":[{"id":155,"name":"ROOT-155","size":741212160,"type":"ROOT","storag > ePoolType":"NetworkFilesystem","storagePoolUuid":"fff90cb5-06dd-33b3-8815-d78c08ca01d9","deviceId":0}],"nics":[{"deviceId":2,"networkRateMbps":200,"defaultNic":true,"uuid":"1dee > a081-1ca4-4af5-ba98-bdac0dac722f","ip":"10.223.122.89","netmask":"255.255.255.192","gateway":"10.223.122.65","mac":"06:31:6c:00:00:52","dns1":"72.52.126.11","broadcastType":"Vla > n","type":"Public","broadcastUri":"vlan://1221","isolationUri":"vlan://1221","isSecurityGroupEnabled":false},{"deviceId":0,"networkRateMbps":200,"defaultNic":false,"uuid":"abb44 > 284-bbc9-41e6-a1d5-53b2a9256ee6","ip":"10.1.1.1","netmask":"255.255.255.0","mac":"02:00:71:47:00:02","dns1":"72.52.126.11","broadcastType":"Vlan","type":"Guest","broadcastUri":" > vlan://2354","isolationUri":"vlan://2354","isSecurityGroupEnabled":false},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"uuid":"8b060664-4c4f-4f0f-bffc-87871cbab662","ip > ":"169.254.3.220","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:03:dc","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false}]},"hostI > p":"10.223.50.66","wait":0}},{"check.CheckSshCommand":{"ip":"169.254.3.220","port":3922,"interval":6,"retries":100,"name":"r-155-VM","wait":0}},{"GetDomRVersionCmd":{"accessDeta > ils":{"router.ip":"169.254.3.220","router.name":"r-155-VM"},"wait":0}},{},{"routing.IpAssocCommand":{"ipAddresses":[{"accountId":2,"publicIp":"10.223.122.89","sourceNat":true,"a > dd":true,"oneToOneNat":false,"firstIP":true,"vlanId":"1221","vlanGateway":"10.223.122.65","vlanNetmask":"255.255.255.192","vifMacAddress":"06:bb:60:00:00:52","networkRate":200," > trafficType":"Public"}],"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.3.220","router.name":"r-155-VM"},"wait":0}}] > } > 2013-05-04 13:43:13,306 DEBUG [agent.transport.Request] > (AgentManager-Handler-10:null) Seq 4-98894092: Processing: { Ans: , MgmtId: > 29066118877352, via: 4, Ver: v1, Flags: 110, > > [{"Answer":{"result":false,"details":"com.cloud.utils.exception.CloudRuntimeException: > org.libvirt.LibvirtException: invalid argument: > virStorageVolLookupByName\n\tat com.cloud > .hypervisor.kvm.storage.LibvirtStorageAdaptor.getVolume(LibvirtStorageAdaptor.java:95)\n\tat > > com.cloud.hypervisor.kvm.storage.LibvirtStorageAdaptor.getPhysicalDisk(LibvirtStorag > eAdaptor.java:390)\n\tat > com.cloud.hypervisor.kvm.storage.LibvirtStoragePool.getPhysicalDisk(LibvirtStoragePool.java:123)\n\tat > com.cloud.hypervisor.kvm.resource.LibvirtComputin > gResource.createVbd(LibvirtComputingResource.java:3323)\n\tat > com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:3214)\n\tat > com.cl > oud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1172)\n\tat > com.cloud.agent.Agent.processRequest(Agent.java:525)\n\tat com.clou > d.agent.Agent$AgentRequestHandler.doTask(Agent.java:852)\n\tat > com.cloud.utils.nio.Task.run(Task.java:83)\n\tat > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecu > tor.java:1110)\n\tat > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)\n\tat > java.lang.Thread.run(Thread.java:679)\n","wait":0}},{"Answer":{"result > ":false,"details":"Stopped by previous > failure","wait":0}},{"Answer":{"result":false,"details":"Stopped by previous > failure","wait":0}},{"Answer":{"result":false,"details":"Stop > ped by previous > failure","wait":0}},{"Answer":{"result":false,"details":"Stopped by previous > failure","wait":0}}] } > 2013-05-04 13:43:13,306 DEBUG [agent.manager.AgentAttache] > (AgentManager-Handler-10:null) Seq 4-98894092: No more commands found > 2013-05-04 13:43:13,306 DEBUG [agent.transport.Request] > (Job-Executor-99:job-369) Seq 4-98894092: Received: { Ans: , MgmtId: > 29066118877352, via: 4, Ver: v1, Flags: 110, { Answ > er, Answer, Answer, Answer, Answer } } > 2013-05-04 13:43:13,311 ERROR [cloud.vm.VirtualMachineManagerImpl] > (Job-Executor-99:job-369) Failed to start instance VM[DomainRouter|r-155-VM] > com.cloud.utils.exception.CloudRuntimeException: Unable to get answer that is > of class com.cloud.agent.api.StartAnswer > at com.cloud.agent.manager.Commands.getAnswer(Commands.java:80) > at > com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:841) > at > com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:529) > at > com.cloud.network.router.VirtualNetworkApplianceManagerImpl.start(VirtualNetworkApplianceManagerImpl.java:2641) > at > com.cloud.network.router.VirtualNetworkApplianceManagerImpl.startVirtualRouter(VirtualNetworkApplianceManagerImpl.java:1850) > at > com.cloud.network.router.VirtualNetworkApplianceManagerImpl.startRouters(VirtualNetworkApplianceManagerImpl.java:1950) > at > com.cloud.network.router.VirtualNetworkApplianceManagerImpl.deployVirtualRouterInGuestNetwork(VirtualNetworkApplianceManagerImpl.java:1928) > at > com.cloud.network.element.VirtualRouterElement.implement(VirtualRouterElement.java:176) > at > com.cloud.network.NetworkManagerImpl.implementNetworkElementsAndResources(NetworkManagerImpl.java:1576) > at > com.cloud.network.NetworkManagerImpl.implementNetwork(NetworkManagerImpl.java:1481) > at > com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125) > Note : > ------ > 1) This is observed in automation environment, multiple time > 2) In automation we are running, multiple test cases concurrently -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira