Hi Guys,
Few weeks ago, I installed cloudsack management on one machine and KVM on other machine. Both were using CentOS 6. All is working fine with these two machines. Now, I installed ubuntu and KVM on third machine and wanted to add it to the cluster but I never seem to be able to do it. I always get "failed adding host" message. I followed http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/4.9/hypervisor/kvm.htmlfor KVM installation on ubuntu. The only difference is that, I don't have eth0 interface. The only ethernet interface showing in my machine is enso1. So I replaced every occurance of eth0 with enso1? I don't know if that might be creating problem? And the following seems to be the relevant portion from management-server.log 2017-04-18 20:56:50,340 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Done executing cpu/ram capacity update 2017-04-18 20:56:50,340 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Executing storage capacity update 2017-04-18 20:56:50,343 DEBUG [c.c.s.StorageManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Found storage pool Primary 1 of type NetworkFilesystem with overprovisioning factor 2 2017-04-18 20:56:50,343 DEBUG [c.c.s.StorageManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Total over provisioned capacity calculated is 2 * 52710866944 2017-04-18 20:56:50,343 DEBUG [c.c.s.StorageManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Total over provisioned capacity of the pool Primary 1 id: 1 is 105421733888 2017-04-18 20:56:50,407 DEBUG [c.c.s.StorageManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Successfully set Capacity - 105421733888 for capacity type - 3 , DataCenterId - 1, HostOrPoolId - 1, PodId null 2017-04-18 20:56:50,407 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Done executing storage capacity update 2017-04-18 20:56:50,407 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Executing capacity updates for public ip and Vlans 2017-04-18 20:56:50,409 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Done capacity updates for public ip and Vlans 2017-04-18 20:56:50,409 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Executing capacity updates for private ip 2017-04-18 20:56:50,410 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Done executing capacity updates for private ip 2017-04-18 20:56:50,410 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Done recalculating system capacity 2017-04-18 20:56:50,416 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Done running Capacity Checker ... 2017-04-18 20:56:50,617 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-bc905976) (logid:e7d551f4) Found 0 routers to update status. 2017-04-18 20:56:50,619 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-bc905976) (logid:e7d551f4) Found 0 VPC networks to update Redundant State. 2017-04-18 20:56:50,621 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-bc905976) (logid:e7d551f4) Found 0 networks to update RvR status. 2017-04-18 20:56:50,990 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) SeqA 5-478: Processing Seq 5-478: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] } 2017-04-18 20:56:51,057 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) SeqA 5-478: Sending Seq 5-478: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] } 2017-04-18 20:56:59,715 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-e043b5e1) (logid:0203bb00) Begin cleanup expired async-jobs 2017-04-18 20:56:59,717 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-e043b5e1) (logid:0203bb00) End cleanup expired async-jobs 2017-04-18 20:56:59,963 DEBUG [c.c.h.k.d.LibvirtServerDiscoverer] (catalina-exec-24:ctx-3ccb74dd ctx-f60b0a5d) (logid:e0df5842) Timeout, to wait for the host connecting to mgt svr, assuming it is failed 2017-04-18 20:56:59,963 WARN [c.c.r.ResourceManagerImpl] (catalina-exec-24:ctx-3ccb74dd ctx-f60b0a5d) (logid:e0df5842) Unable to find the server resources at http://10.0.0.5 2017-04-18 20:56:59,964 INFO [c.c.u.e.CSExceptionErrorCode] (catalina-exec-24:ctx-3ccb74dd ctx-f60b0a5d) (logid:e0df5842) Could not find exception: com.cloud.exception.DiscoveryException in error code list for exceptions 2017-04-18 20:56:59,964 WARN [o.a.c.a.c.a.h.AddHostCmd] (catalina-exec-24:ctx-3ccb74dd ctx-f60b0a5d) (logid:e0df5842) Exception: com.cloud.exception.DiscoveryException: Unable to add the host at com.cloud.resource.ResourceManagerImpl.discoverHostsFull(ResourceManagerImpl.java:806) at com.cloud.resource.ResourceManagerImpl.discoverHosts(ResourceManagerImpl.java:598) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) at com.sun.proxy.$Proxy160.discoverHosts(Unknown Source) at org.apache.cloudstack.api.command.admin.host.AddHostCmd.execute(AddHostCmd.java:142) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150) at com.cloud.api.ApiServer.queueCommand(ApiServer.java:709) at com.cloud.api.ApiServer.handleRequest(ApiServer.java:533) at com.cloud.api.ApiServlet.processRequestInContext(ApiServlet.java:299) at com.cloud.api.ApiServlet$1.run(ApiServlet.java:129) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:126) at com.cloud.api.ApiServlet.doPost(ApiServlet.java:93) at javax.servlet.http.HttpServlet.service(HttpServlet.java:643) at javax.servlet.http.HttpServlet.service(HttpServlet.java:723) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:299) at org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:896) at org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:732) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2277) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) 2017-04-18 20:56:59,964 INFO [c.c.a.ApiServer] (catalina-exec-24:ctx-3ccb74dd ctx-f60b0a5d) (logid:e0df5842) Unable to add the host 2017-04-18 20:56:59,965 DEBUG [c.c.a.ApiServlet] (catalina-exec-24:ctx-3ccb74dd ctx-f60b0a5d) (logid:e0df5842) ===END=== 10.0.0.2 -- POST command=addHost&response=json 2017-04-18 20:57:00,988 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-14:null) (logid:) SeqA 5-479: Processing Seq 5-479: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] } 2017-04-18 20:57:01,074 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-14:null) (logid:) SeqA 5-479: Sending Seq 5-479: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] } 2017-04-18 20:57:09,465 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-15:null) (logid:) Ping from 5(v-6-VM) 2017-04-18 20:57:09,647 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-1:null) (logid:) Ping from 3(s-2-VM) 2017-04-18 20:57:09,719 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-b38b767a) (logid:5b5de7b7) Begin cleanup expired async-jobs 2017-04-18 20:57:09,725 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-b38b767a) (logid:5b5de7b7) End cleanup expired async-jobs 2017-04-18 20:57:10,928 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-db45f56a) (logid:a742d33f) Zone 1 is ready to launch secondary storage VM 2017-04-18 20:57:10,999 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-892e3eec) (logid:739e8590) Zone 1 is ready to launch console proxy 2017-04-18 20:57:11,030 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-9:null) (logid:) SeqA 5-481: Processing Seq 5-481: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] } 2017-04-18 20:57:11,150 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-9:null) (logid:) SeqA 5-481: Sending Seq 5-481: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] } 2017-04-18 20:57:15,992 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-2:null) (logid:) SeqA 5-482: Processing Seq 5-482: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] } 2017-04-18 20:57:16,067 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-2:null) (logid:) SeqA 5-482: Sending Seq 5-482: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] } 2017-04-18 20:57:19,719 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-0d968653) (logid:74a5d87b) Begin cleanup expired async-jobs 2017-04-18 20:57:19,725 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-0d968653) (logid:74a5d87b) End cleanup expired async-jobs 2017-04-18 20:57:19,944 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-80589e90) (logid:80d37fa8) Found 0 routers to update status. 2017-04-18 20:57:19,946 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-80589e90) (logid:80d37fa8) Found 0 VPC networks to update Redundant State. Is there a way, we can check if a host is ready to be added to cluster before adding it from cloudstack management UI? Regards Adeel Host KVM Installation — Apache CloudStack Installation ...<http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/4.9/hypervisor/kvm.html> docs.cloudstack.apache.org KVM Installation Overview¶ If you want to use the Linux Kernel Virtual Machine (KVM) hypervisor to run guest virtual machines, install KVM on the host(s) in your cloud.
