Hey all,
i currently evaluate the usage of multiple hypervisors in one CS advanced zone: I tried to create a template from a volume which was created an Vsphere. The secondary Storage is working. I can create Templates for XenServer, for KVM, I can launch Instances on all three kinds of hypervisors, I can upload ISOs / Templates. The SecStorage is mounted on the VSphere host, I can browse the datastore, I can create files. BUT I still get the following error if I try to create a template from a root disk which was created with VSphere: There are no error message in vcenter. 013-12-06 12:07:49,901 DEBUG [cloud.network.NetworkUsageManagerImpl] (Cluster-Worker-9:null) Disconnected called on 9 with status Alert 2013-12-06 12:07:49,902 DEBUG [agent.manager.AgentManagerImpl] (Cluster-Worker-9:null) Sending Disconnect to listener: com.cloud.consoleproxy.ConsoleProxyListener 2013-12-06 12:07:49,900 DEBUG [cloudstack.storage.RemoteHostEndPoint] (Job-Executor-1:job-35 = [ d7108061-c9ff-479e-9855-40ed6faae9bf ]) Failed to send command, due to Agent:5, com.cloud.exception.OperationTimedoutException: Commands 1351352351 to Host 9 timed out after 21600 2013-12-06 12:07:49,902 DEBUG [storage.motion.AncientDataMotionStrategy] (Job-Executor-1:job-35 = [ d7108061-c9ff-479e-9855-40ed6faae9bf ]) copy object failed: com.cloud.utils.exception.CloudRuntimeException: Failed to send command, due to Agent:5, com.cloud.exception.OperationTimedoutException: Commands 1351352351 to Host 9 timed out after 21600 at org.apache.cloudstack.storage.RemoteHostEndPoint.sendMessage(RemoteHostEndPo int.java:104) at org.apache.cloudstack.storage.motion.AncientDataMotionStrategy.copyObject(An cientDataMotionStrategy.java:196) at org.apache.cloudstack.storage.motion.AncientDataMotionStrategy.copyAsync(Anc ientDataMotionStrategy.java:397) at org.apache.cloudstack.storage.motion.DataMotionServiceImpl.copyAsync(DataMot ionServiceImpl.java:58) at org.apache.cloudstack.storage.image.TemplateServiceImpl.copyAsync(TemplateSe rviceImpl.java:594) at org.apache.cloudstack.storage.image.TemplateServiceImpl.createTemplateFromVo lumeAsync(TemplateServiceImpl.java:607) at com.cloud.template.TemplateManagerImpl.createPrivateTemplate(TemplateManager Impl.java:1385) at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDis patcher.intercept(ComponentInstantiationPostProcessor.java:125) at org.apache.cloudstack.api.command.user.template.CreateTemplateCmd.execute(Cr eateTemplateCmd.java:263) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158) at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:11 46) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:6 15) at java.lang.Thread.run(Thread.java:701) 2013-12-06 12:07:49,903 DEBUG [storage.motion.AncientDataMotionStrategy] (Job-Executor-1:job-35 = [ d7108061-c9ff-479e-9855-40ed6faae9bf ]) copy failed com.cloud.utils.exception.CloudRuntimeException: com.cloud.utils.exception.CloudRuntimeException: Failed to send command, due to Agent:5, com.cloud.exception.OperationTimedoutException: Commands 1351352351 to Host 9 timed out after 21600 at org.apache.cloudstack.storage.motion.AncientDataMotionStrategy.copyObject(An cientDataMotionStrategy.java:217) at org.apache.cloudstack.storage.motion.AncientDataMotionStrategy.copyAsync(Anc ientDataMotionStrategy.java:397) at org.apache.cloudstack.storage.motion.DataMotionServiceImpl.copyAsync(DataMot ionServiceImpl.java:58) at org.apache.cloudstack.storage.image.TemplateServiceImpl.copyAsync(TemplateSe rviceImpl.java:594) at org.apache.cloudstack.storage.image.TemplateServiceImpl.createTemplateFromVo lumeAsync(TemplateServiceImpl.java:607) at com.cloud.template.TemplateManagerImpl.createPrivateTemplate(TemplateManager Impl.java:1385) at com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDis patcher.intercept(ComponentInstantiationPostProcessor.java:125) at org.apache.cloudstack.api.command.user.template.CreateTemplateCmd.execute(Cr eateTemplateCmd.java:263) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158) at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:11 46) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:6 15) CS complains that Host with ID=9 (secstorage VM) is not reachable. But the SSVM is reachable, as I said, it works for all other SecStorage related tasks, it only fails for the Template creation of a VSphere root disk. All Datastores are NFS. The interesting thing is, if I set the global parameter system.vm.default.hypervisor to vmware and I destroy the SSVM so that she is created on VMWare. Everything works. I still have the feeling that multiple hypervisors are leading to problems. Whats your experience with that? Is there a way to use three Secstorage VMs? For example one for vsphere one for XEN and one for KVM?