And do we need to create /export/primary /export/secondary for KVM hosts as well?
________________________________ From: Muhammad Adeel Zahid <16030...@lums.edu.pk> Sent: Wednesday, April 19, 2017 4:34:22 AM To: users@cloudstack.apache.org Subject: Re: Trouble Adding Ubuntu-KVM hosts on Cloudstack And following is how agent logs look like on KVM host I am trying to add. I think, its having some problem with storage pool and it is receiving sig-kill too often 2017-04-19 02:56:49,432 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Proccess agent startup answer, agent id = 0 2017-04-19 02:56:49,433 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Set agent id 0 2017-04-19 02:56:49,433 INFO [cloud.agent.Agent] (AgentShutdownThread:null) (logid:) Stopping the agent: Reason = sig.kill 2017-04-19 02:56:49,459 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Startup Response Received: agent id = 0 2017-04-19 02:58:16,014 INFO [cloud.agent.AgentShell] (main:null) (logid:) Agent started 2017-04-19 02:58:16,015 INFO [cloud.agent.AgentShell] (main:null) (logid:) Implementation Version is 4.9.2.0 2017-04-19 02:58:16,016 INFO [cloud.agent.AgentShell] (main:null) (logid:) agent.properties found at /etc/cloudstack/agent/agent.properties 2017-04-19 02:58:16,019 INFO [cloud.agent.AgentShell] (main:null) (logid:) Defaulting to using properties file for storage 2017-04-19 02:58:16,020 INFO [cloud.agent.AgentShell] (main:null) (logid:) Defaulting to the constant time backoff algorithm 2017-04-19 02:58:16,028 INFO [cloud.utils.LogUtils] (main:null) (logid:) log4j configuration found at /etc/cloudstack/agent/log4j-cloud.xml 2017-04-19 02:58:16,037 INFO [cloud.agent.AgentShell] (main:null) (logid:) Using default Java settings for IPv6 preference for agent connection 2017-04-19 02:58:16,070 INFO [cloud.agent.Agent] (main:null) (logid:) id is 0 2017-04-19 02:58:16,091 INFO [kvm.resource.LibvirtConnection] (main:null) (logid:) No existing libvirtd connection found. Opening a new one 2017-04-19 02:58:16,306 INFO [org.reflections.Reflections] (main:null) (logid:) Reflections took 52 ms to scan 1 urls, producing 7 keys and 10 values 2017-04-19 02:58:16,362 INFO [kvm.resource.LibvirtComputingResource] (main:null) (logid:) No libvirt.vif.driver specified. Defaults to BridgeVifDriver. 2017-04-19 02:58:16,375 INFO [cloud.agent.Agent] (main:null) (logid:) Agent [id = 0 : type = LibvirtComputingResource : zone = 1 : pod = 1 : workers = 5 : host = 10.0.0.2 : port = 8250 2017-04-19 02:58:16,377 INFO [utils.nio.NioClient] (main:null) (logid:) Connecting to 10.0.0.2:8250 2017-04-19 02:58:16,557 INFO [utils.nio.NioClient] (main:null) (logid:) SSL: Handshake done 2017-04-19 02:58:16,558 INFO [utils.nio.NioClient] (main:null) (logid:) Connected to 10.0.0.2:8250 2017-04-19 02:58:16,589 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Attempting to create storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 (Filesystem) in libvirt 2017-04-19 02:58:16,593 WARN [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 was not found running in libvirt. Need to create it. 2017-04-19 02:58:16,593 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Didn't find an existing storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 by UUID, checking for pools with duplicate paths 2017-04-19 02:58:16,595 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Trying to fetch storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 from libvirt 2017-04-19 02:58:16,633 INFO [cloud.serializer.GsonHelper] (Agent-Handler-1:null) (logid:) Default Builder inited. 2017-04-19 02:58:19,448 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Proccess agent startup answer, agent id = 0 2017-04-19 02:58:19,448 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Set agent id 0 2017-04-19 02:58:19,448 INFO [cloud.agent.Agent] (AgentShutdownThread:null) (logid:) Stopping the agent: Reason = sig.kill 2017-04-19 02:58:19,452 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Startup Response Received: agent id = 0 2017-04-19 04:13:46,596 INFO [cloud.agent.AgentShell] (main:null) (logid:) Agent started 2017-04-19 04:13:46,630 INFO [cloud.agent.AgentShell] (main:null) (logid:) Implementation Version is 4.9.2.0 2017-04-19 04:13:46,631 INFO [cloud.agent.AgentShell] (main:null) (logid:) agent.properties found at /etc/cloudstack/agent/agent.properties 2017-04-19 04:13:46,634 INFO [cloud.agent.AgentShell] (main:null) (logid:) Defaulting to using properties file for storage 2017-04-19 04:13:46,635 INFO [cloud.agent.AgentShell] (main:null) (logid:) Defaulting to the constant time backoff algorithm 2017-04-19 04:13:46,654 INFO [cloud.utils.LogUtils] (main:null) (logid:) log4j configuration found at /etc/cloudstack/agent/log4j-cloud.xml 2017-04-19 04:13:46,662 INFO [cloud.agent.AgentShell] (main:null) (logid:) Using default Java settings for IPv6 preference for agent connection 2017-04-19 04:13:46,821 INFO [cloud.agent.Agent] (main:null) (logid:) id is 0 2017-04-19 04:13:47,013 INFO [kvm.resource.LibvirtConnection] (main:null) (logid:) No existing libvirtd connection found. Opening a new one 2017-04-19 04:13:48,061 INFO [org.reflections.Reflections] (main:null) (logid:) Reflections took 162 ms to scan 1 urls, producing 7 keys and 10 values 2017-04-19 04:13:48,449 INFO [kvm.resource.LibvirtComputingResource] (main:null) (logid:) No libvirt.vif.driver specified. Defaults to BridgeVifDriver. 2017-04-19 04:13:48,473 INFO [cloud.agent.Agent] (main:null) (logid:) Agent [id = 0 : type = LibvirtComputingResource : zone = 1 : pod = 1 : workers = 5 : host = 10.0.0.2 : port = 8250 2017-04-19 04:13:48,478 INFO [utils.nio.NioClient] (main:null) (logid:) Connecting to 10.0.0.2:8250 2017-04-19 04:13:48,913 INFO [utils.nio.NioClient] (main:null) (logid:) SSL: Handshake done 2017-04-19 04:13:48,913 INFO [utils.nio.NioClient] (main:null) (logid:) Connected to 10.0.0.2:8250 2017-04-19 04:13:49,127 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Attempting to create storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 (Filesystem) in libvirt 2017-04-19 04:13:49,167 WARN [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 was not found running in libvirt. Need to create it. 2017-04-19 04:13:49,167 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Didn't find an existing storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 by UUID, checking for pools with duplicate paths 2017-04-19 04:13:49,284 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Trying to fetch storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 from libvirt 2017-04-19 04:13:49,431 INFO [cloud.serializer.GsonHelper] (Agent-Handler-1:null) (logid:) Default Builder inited. 2017-04-19 04:13:54,999 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Proccess agent startup answer, agent id = 0 2017-04-19 04:13:54,999 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Set agent id 0 2017-04-19 04:13:55,001 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Startup Response Received: agent id = 0 2017-04-19 04:13:55,005 INFO [cloud.agent.Agent] (AgentShutdownThread:null) (logid:) Stopping the agent: Reason = sig.kill 2017-04-19 04:15:14,373 INFO [cloud.agent.AgentShell] (main:null) (logid:) Agent started 2017-04-19 04:15:14,374 INFO [cloud.agent.AgentShell] (main:null) (logid:) Implementation Version is 4.9.2.0 2017-04-19 04:15:14,375 INFO [cloud.agent.AgentShell] (main:null) (logid:) agent.properties found at /etc/cloudstack/agent/agent.properties 2017-04-19 04:15:14,378 INFO [cloud.agent.AgentShell] (main:null) (logid:) Defaulting to using properties file for storage 2017-04-19 04:15:14,379 INFO [cloud.agent.AgentShell] (main:null) (logid:) Defaulting to the constant time backoff algorithm 2017-04-19 04:15:14,387 INFO [cloud.utils.LogUtils] (main:null) (logid:) log4j configuration found at /etc/cloudstack/agent/log4j-cloud.xml 2017-04-19 04:15:14,396 INFO [cloud.agent.AgentShell] (main:null) (logid:) Using default Java settings for IPv6 preference for agent connection 2017-04-19 04:15:14,430 INFO [cloud.agent.Agent] (main:null) (logid:) id is 0 2017-04-19 04:15:14,450 INFO [kvm.resource.LibvirtConnection] (main:null) (logid:) No existing libvirtd connection found. Opening a new one 2017-04-19 04:15:14,669 INFO [org.reflections.Reflections] (main:null) (logid:) Reflections took 52 ms to scan 1 urls, producing 7 keys and 10 values 2017-04-19 04:15:14,725 INFO [kvm.resource.LibvirtComputingResource] (main:null) (logid:) No libvirt.vif.driver specified. Defaults to BridgeVifDriver. 2017-04-19 04:15:14,738 INFO [cloud.agent.Agent] (main:null) (logid:) Agent [id = 0 : type = LibvirtComputingResource : zone = 1 : pod = 1 : workers = 5 : host = 10.0.0.2 : port = 8250 2017-04-19 04:15:14,741 INFO [utils.nio.NioClient] (main:null) (logid:) Connecting to 10.0.0.2:8250 2017-04-19 04:15:14,919 INFO [utils.nio.NioClient] (main:null) (logid:) SSL: Handshake done 2017-04-19 04:15:14,919 INFO [utils.nio.NioClient] (main:null) (logid:) Connected to 10.0.0.2:8250 2017-04-19 04:15:14,949 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Attempting to create storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 (Filesystem) in libvirt 2017-04-19 04:15:14,953 WARN [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 was not found running in libvirt. Need to create it. 2017-04-19 04:15:14,953 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Didn't find an existing storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 by UUID, checking for pools with duplicate paths 2017-04-19 04:15:14,955 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Trying to fetch storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 from libvirt 2017-04-19 04:15:14,992 INFO [cloud.serializer.GsonHelper] (Agent-Handler-1:null) (logid:) Default Builder inited. 2017-04-19 04:15:15,875 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Proccess agent startup answer, agent id = 0 2017-04-19 04:15:15,875 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Set agent id 0 2017-04-19 04:15:15,876 INFO [cloud.agent.Agent] (AgentShutdownThread:null) (logid:) Stopping the agent: Reason = sig.kill 2017-04-19 04:15:15,880 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Startup Response Received: agent id = 0 2017-04-19 04:30:21,032 INFO [cloud.agent.AgentShell] (main:null) (logid:) Agent started 2017-04-19 04:30:21,033 INFO [cloud.agent.AgentShell] (main:null) (logid:) Implementation Version is 4.9.2.0 2017-04-19 04:30:21,034 INFO [cloud.agent.AgentShell] (main:null) (logid:) agent.properties found at /etc/cloudstack/agent/agent.properties 2017-04-19 04:30:21,037 INFO [cloud.agent.AgentShell] (main:null) (logid:) Defaulting to using properties file for storage 2017-04-19 04:30:21,037 INFO [cloud.agent.AgentShell] (main:null) (logid:) Defaulting to the constant time backoff algorithm 2017-04-19 04:30:21,046 INFO [cloud.utils.LogUtils] (main:null) (logid:) log4j configuration found at /etc/cloudstack/agent/log4j-cloud.xml 2017-04-19 04:30:21,054 INFO [cloud.agent.AgentShell] (main:null) (logid:) Using default Java settings for IPv6 preference for agent connection 2017-04-19 04:30:21,088 INFO [cloud.agent.Agent] (main:null) (logid:) id is 0 2017-04-19 04:30:21,109 INFO [kvm.resource.LibvirtConnection] (main:null) (logid:) No existing libvirtd connection found. Opening a new one 2017-04-19 04:30:21,287 INFO [org.reflections.Reflections] (main:null) (logid:) Reflections took 52 ms to scan 1 urls, producing 7 keys and 10 values 2017-04-19 04:30:21,342 INFO [kvm.resource.LibvirtComputingResource] (main:null) (logid:) No libvirt.vif.driver specified. Defaults to BridgeVifDriver. 2017-04-19 04:30:21,355 INFO [cloud.agent.Agent] (main:null) (logid:) Agent [id = 0 : type = LibvirtComputingResource : zone = 1 : pod = 1 : workers = 5 : host = 10.0.0.2 : port = 8250 2017-04-19 04:30:21,357 INFO [utils.nio.NioClient] (main:null) (logid:) Connecting to 10.0.0.2:8250 2017-04-19 04:30:21,535 INFO [utils.nio.NioClient] (main:null) (logid:) SSL: Handshake done 2017-04-19 04:30:21,535 INFO [utils.nio.NioClient] (main:null) (logid:) Connected to 10.0.0.2:8250 2017-04-19 04:30:21,565 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Attempting to create storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 (Filesystem) in libvirt 2017-04-19 04:30:21,568 WARN [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 was not found running in libvirt. Need to create it. 2017-04-19 04:30:21,568 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Didn't find an existing storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 by UUID, checking for pools with duplicate paths 2017-04-19 04:30:21,571 INFO [kvm.storage.LibvirtStorageAdaptor] (Agent-Handler-1:null) (logid:) Trying to fetch storage pool 79f0dc80-61d6-4d7f-9cf2-050c353889f5 from libvirt 2017-04-19 04:30:21,608 INFO [cloud.serializer.GsonHelper] (Agent-Handler-1:null) (logid:) Default Builder inited. 2017-04-19 04:30:26,638 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Proccess agent startup answer, agent id = 0 2017-04-19 04:30:26,638 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Set agent id 0 2017-04-19 04:30:26,639 INFO [cloud.agent.Agent] (AgentShutdownThread:null) (logid:) Stopping the agent: Reason = sig.kill 2017-04-19 04:30:26,644 INFO [cloud.agent.Agent] (Agent-Handler-2:null) (logid:) Startup Response Received: agent id = 0 Regards Adeel ________________________________ From: Muhammad Adeel Zahid <16030...@lums.edu.pk> Sent: Tuesday, April 18, 2017 9:14:37 PM To: users@cloudstack.apache.org Subject: Trouble Adding Ubuntu-KVM hosts on Cloudstack Hi Guys, Few weeks ago, I installed cloudsack management on one machine and KVM on other machine. Both were using CentOS 6. All is working fine with these two machines. Now, I installed ubuntu and KVM on third machine and wanted to add it to the cluster but I never seem to be able to do it. I always get "failed adding host" message. I followed http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/4.9/hypervisor/kvm.htmlfor KVM installation on ubuntu. The only difference is that, I don't have eth0 interface. The only ethernet interface showing in my machine is enso1. So I replaced every occurance of eth0 with enso1? I don't know if that might be creating problem? And the following seems to be the relevant portion from management-server.log 2017-04-18 20:56:50,340 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Done executing cpu/ram capacity update 2017-04-18 20:56:50,340 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Executing storage capacity update 2017-04-18 20:56:50,343 DEBUG [c.c.s.StorageManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Found storage pool Primary 1 of type NetworkFilesystem with overprovisioning factor 2 2017-04-18 20:56:50,343 DEBUG [c.c.s.StorageManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Total over provisioned capacity calculated is 2 * 52710866944 2017-04-18 20:56:50,343 DEBUG [c.c.s.StorageManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Total over provisioned capacity of the pool Primary 1 id: 1 is 105421733888 2017-04-18 20:56:50,407 DEBUG [c.c.s.StorageManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Successfully set Capacity - 105421733888 for capacity type - 3 , DataCenterId - 1, HostOrPoolId - 1, PodId null 2017-04-18 20:56:50,407 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Done executing storage capacity update 2017-04-18 20:56:50,407 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Executing capacity updates for public ip and Vlans 2017-04-18 20:56:50,409 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Done capacity updates for public ip and Vlans 2017-04-18 20:56:50,409 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Executing capacity updates for private ip 2017-04-18 20:56:50,410 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Done executing capacity updates for private ip 2017-04-18 20:56:50,410 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Done recalculating system capacity 2017-04-18 20:56:50,416 DEBUG [c.c.a.AlertManagerImpl] (CapacityChecker:ctx-cdce63c4) (logid:3e29aad9) Done running Capacity Checker ... 2017-04-18 20:56:50,617 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-bc905976) (logid:e7d551f4) Found 0 routers to update status. 2017-04-18 20:56:50,619 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-bc905976) (logid:e7d551f4) Found 0 VPC networks to update Redundant State. 2017-04-18 20:56:50,621 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-bc905976) (logid:e7d551f4) Found 0 networks to update RvR status. 2017-04-18 20:56:50,990 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) SeqA 5-478: Processing Seq 5-478: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] } 2017-04-18 20:56:51,057 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-13:null) (logid:) SeqA 5-478: Sending Seq 5-478: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] } 2017-04-18 20:56:59,715 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-e043b5e1) (logid:0203bb00) Begin cleanup expired async-jobs 2017-04-18 20:56:59,717 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-e043b5e1) (logid:0203bb00) End cleanup expired async-jobs 2017-04-18 20:56:59,963 DEBUG [c.c.h.k.d.LibvirtServerDiscoverer] (catalina-exec-24:ctx-3ccb74dd ctx-f60b0a5d) (logid:e0df5842) Timeout, to wait for the host connecting to mgt svr, assuming it is failed 2017-04-18 20:56:59,963 WARN [c.c.r.ResourceManagerImpl] (catalina-exec-24:ctx-3ccb74dd ctx-f60b0a5d) (logid:e0df5842) Unable to find the server resources at http://10.0.0.5 2017-04-18 20:56:59,964 INFO [c.c.u.e.CSExceptionErrorCode] (catalina-exec-24:ctx-3ccb74dd ctx-f60b0a5d) (logid:e0df5842) Could not find exception: com.cloud.exception.DiscoveryException in error code list for exceptions 2017-04-18 20:56:59,964 WARN [o.a.c.a.c.a.h.AddHostCmd] (catalina-exec-24:ctx-3ccb74dd ctx-f60b0a5d) (logid:e0df5842) Exception: com.cloud.exception.DiscoveryException: Unable to add the host at com.cloud.resource.ResourceManagerImpl.discoverHostsFull(ResourceManagerImpl.java:806) at com.cloud.resource.ResourceManagerImpl.discoverHosts(ResourceManagerImpl.java:598) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204) at com.sun.proxy.$Proxy160.discoverHosts(Unknown Source) at org.apache.cloudstack.api.command.admin.host.AddHostCmd.execute(AddHostCmd.java:142) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:150) at com.cloud.api.ApiServer.queueCommand(ApiServer.java:709) at com.cloud.api.ApiServer.handleRequest(ApiServer.java:533) at com.cloud.api.ApiServlet.processRequestInContext(ApiServlet.java:299) at com.cloud.api.ApiServlet$1.run(ApiServlet.java:129) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:126) at com.cloud.api.ApiServlet.doPost(ApiServlet.java:93) at javax.servlet.http.HttpServlet.service(HttpServlet.java:643) at javax.servlet.http.HttpServlet.service(HttpServlet.java:723) at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127) at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555) at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:299) at org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:896) at org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:732) at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2277) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) 2017-04-18 20:56:59,964 INFO [c.c.a.ApiServer] (catalina-exec-24:ctx-3ccb74dd ctx-f60b0a5d) (logid:e0df5842) Unable to add the host 2017-04-18 20:56:59,965 DEBUG [c.c.a.ApiServlet] (catalina-exec-24:ctx-3ccb74dd ctx-f60b0a5d) (logid:e0df5842) ===END=== 10.0.0.2 -- POST command=addHost&response=json 2017-04-18 20:57:00,988 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-14:null) (logid:) SeqA 5-479: Processing Seq 5-479: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] } 2017-04-18 20:57:01,074 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-14:null) (logid:) SeqA 5-479: Sending Seq 5-479: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] } 2017-04-18 20:57:09,465 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-15:null) (logid:) Ping from 5(v-6-VM) 2017-04-18 20:57:09,647 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-1:null) (logid:) Ping from 3(s-2-VM) 2017-04-18 20:57:09,719 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-b38b767a) (logid:5b5de7b7) Begin cleanup expired async-jobs 2017-04-18 20:57:09,725 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-b38b767a) (logid:5b5de7b7) End cleanup expired async-jobs 2017-04-18 20:57:10,928 DEBUG [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-db45f56a) (logid:a742d33f) Zone 1 is ready to launch secondary storage VM 2017-04-18 20:57:10,999 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-892e3eec) (logid:739e8590) Zone 1 is ready to launch console proxy 2017-04-18 20:57:11,030 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-9:null) (logid:) SeqA 5-481: Processing Seq 5-481: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] } 2017-04-18 20:57:11,150 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-9:null) (logid:) SeqA 5-481: Sending Seq 5-481: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] } 2017-04-18 20:57:15,992 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-2:null) (logid:) SeqA 5-482: Processing Seq 5-482: { Cmd , MgmtId: -1, via: 5, Ver: v1, Flags: 11, [{"com.cloud.agent.api.ConsoleProxyLoadReportCommand":{"_proxyVmId":6,"_loadInfo":"{\n \"connections\": []\n}","wait":0}}] } 2017-04-18 20:57:16,067 DEBUG [c.c.a.m.AgentManagerImpl] (AgentManager-Handler-2:null) (logid:) SeqA 5-482: Sending Seq 5-482: { Ans: , MgmtId: 187757519710468, via: 5, Ver: v1, Flags: 100010, [{"com.cloud.agent.api.AgentControlAnswer":{"result":true,"wait":0}}] } 2017-04-18 20:57:19,719 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-0d968653) (logid:74a5d87b) Begin cleanup expired async-jobs 2017-04-18 20:57:19,725 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-0d968653) (logid:74a5d87b) End cleanup expired async-jobs 2017-04-18 20:57:19,944 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-80589e90) (logid:80d37fa8) Found 0 routers to update status. 2017-04-18 20:57:19,946 DEBUG [c.c.n.r.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:ctx-80589e90) (logid:80d37fa8) Found 0 VPC networks to update Redundant State. Is there a way, we can check if a host is ready to be added to cluster before adding it from cloudstack management UI? Regards Adeel Host KVM Installation — Apache CloudStack Installation ...<http://docs.cloudstack.apache.org/projects/cloudstack-installation/en/4.9/hypervisor/kvm.html> docs.cloudstack.apache.org KVM Installation Overview¶ If you want to use the Linux Kernel Virtual Machine (KVM) hypervisor to run guest virtual machines, install KVM on the host(s) in your cloud.