Hello, I am trying to setup a new advanced zone on a fresh cloudstack management installation with a fresh KVM host. I get above error during zone setup. I have configured everything exactly as mentioned in documentation. This is my second cloudstack deployment. I have configured firewall, nfs (for secondary storage) and firewall as well. Following is relevant log entries:
Please advise Thank ==== LOG ======== 2019-07-16 17:49:28,545 DEBUG [c.c.a.ApiServlet] (qtp2114650936-15:ctx-4a6253b3) (logid:9602d64a) ===START=== 137.74.35.102 -- GET command=updateConfiguration&name=system.vm.use.local.storage&value=true&zoneid=d550c869-b032-453a-9aa2-b9392e88c7e8&response=json&_=1563289836973 2019-07-16 17:49:28,555 DEBUG [c.c.a.ApiServer] (qtp2114650936-15:ctx-4a6253b3 ctx-4d70c46a) (logid:9602d64a) CIDRs from which account 'Acct[e5d9b8e5-a728-11e9-a6d1-d05099d22dfa-admin]' is allowed to perform API calls: 0.0.0.0/0,::/0 2019-07-16 17:49:28,565 WARN [c.c.c.ConfigurationManagerImpl] (qtp2114650936-15:ctx-4a6253b3 ctx-4d70c46a) (logid:9602d64a) Did not find configuration system.vm.use.local.storage in Config.java. Perhaps moved to ConfigDepot 2019-07-16 17:49:28,585 DEBUG [c.c.a.ApiServlet] (qtp2114650936-15:ctx-4a6253b3 ctx-4d70c46a) (logid:9602d64a) ===END=== 137.74.35.102 -- GET command=updateConfiguration&name=system.vm.use.local.storage&value=true&zoneid=d550c869-b032-453a-9aa2-b9392e88c7e8&response=json&_=1563289836973 2019-07-16 17:49:28,725 DEBUG [c.c.a.ApiServlet] (qtp2114650936-22:ctx-737ecab0) (logid:2a3b979e) ===START=== 137.74.35.102 -- POST command=addHost&response=json 2019-07-16 17:49:28,733 DEBUG [c.c.a.ApiServer] (qtp2114650936-22:ctx-737ecab0 ctx-5f99d489) (logid:2a3b979e) CIDRs from which account 'Acct[e5d9b8e5-a728-11e9-a6d1-d05099d22dfa-admin]' is allowed to perform API calls: 0.0.0.0/0,::/0 2019-07-16 17:49:28,745 WARN [c.c.a.d.ParamGenericValidationWorker] (qtp2114650936-22:ctx-737ecab0 ctx-5f99d489) (logid:2a3b979e) Received unknown parameters for command addHost. Unknown parameters : clustertype 2019-07-16 17:49:28,751 INFO [c.c.r.ResourceManagerImpl] (qtp2114650936-22:ctx-737ecab0 ctx-5f99d489) (logid:2a3b979e) Trying to add a new host at http://51.91.31.227 in data center 1 2019-07-16 17:49:28,754 WARN [c.c.h.k.d.LibvirtServerDiscoverer] (qtp2114650936-22:ctx-737ecab0 ctx-5f99d489) (logid:2a3b979e) can't setup agent, due to java.io.IOException: There was a problem while connecting to 51.91.31.227:22 - There was a problem while connecting to 51.91.31.227:22 2019-07-16 17:49:28,755 WARN [c.c.r.ResourceManagerImpl] (qtp2114650936-22:ctx-737ecab0 ctx-5f99d489) (logid:2a3b979e) Unable to find the server resources at http://51.91.31.227 2019-07-16 17:49:28,755 INFO [c.c.u.e.CSExceptionErrorCode] (qtp2114650936-22:ctx-737ecab0 ctx-5f99d489) (logid:2a3b979e) Could not find exception: com.cloud.exception.DiscoveryException in error code list for exceptions 2019-07-16 17:49:28,755 WARN [o.a.c.a.c.a.h.AddHostCmd] (qtp2114650936-22:ctx-737ecab0 ctx-5f99d489) (logid:2a3b979e) Exception: com.cloud.exception.DiscoveryException: Unable to add the host at com.cloud.resource.ResourceManagerImpl.discoverHostsFull(ResourceManagerImpl.java:824) at com.cloud.resource.ResourceManagerImpl.discoverHosts(ResourceManagerImpl.java:610) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:338) at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:197) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:92) at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185) at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) at com.sun.proxy.$Proxy174.discoverHosts(Unknown Source) at org.apache.cloudstack.api.command.admin.host.AddHostCmd.execute(AddHostCmd.java:142) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:156) at com.cloud.api.ApiServer.queueCommand(ApiServer.java:758) at com.cloud.api.ApiServer.handleRequest(ApiServer.java:582) at com.cloud.api.ApiServlet.processRequestInContext(ApiServlet.java:310) at com.cloud.api.ApiServlet$1.run(ApiServlet.java:130) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:127) at com.cloud.api.ApiServlet.doPost(ApiServlet.java:94) at javax.servlet.http.HttpServlet.service(HttpServlet.java:706) at javax.servlet.http.HttpServlet.service(HttpServlet.java:791) at org.eclipse.jetty.servlet.ServletHolder.handle(ServletHolder.java:852) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:535) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:190) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595) at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:168) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564) at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:166) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:527) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:126) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) at org.eclipse.jetty.server.Server.handle(Server.java:530) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:347) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:256) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102) at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:247) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:140) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:382) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748) 2019-07-16 17:49:28,757 INFO [c.c.a.ApiServer] (qtp2114650936-22:ctx-737ecab0 ctx-5f99d489) (logid:2a3b979e) Unable to add the host 2019-07-16 17:49:28,760 DEBUG [c.c.a.ApiServlet] (qtp2114650936-22:ctx-737ecab0 ctx-5f99d489) (logid:2a3b979e) ===END=== 137.74.35.102 -- POST command=addHost&response=json 2019-07-16 17:49:29,588 ERROR [c.c.u.n.Link] (AgentManager-SSLHandshakeHandler-1:null) (logid:) SSL error caught during wrap data: null cert chain, for local address=/127.0.0.1:8250, remote address=/127.0.0.1:34654. 2019-07-16 17:49:29,792 DEBUG [c.c.s.StatsCollector] (StatsCollector-5:ctx-997c8319) (logid:067c37c3) AutoScaling Monitor is running... 2019-07-16 17:49:29,934 DEBUG [c.c.s.StatsCollector] (StatsCollector-6:ctx-b1b5e7ab) (logid:d5f0c500) StorageCollector is running... 2019-07-16 17:49:29,935 DEBUG [c.c.s.StatsCollector] (StatsCollector-4:ctx-b0125b3d) (logid:ebe59923) HostStatsCollector is running... 2019-07-16 17:49:34,497 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-10411fc1) (logid:9ee1c670) Begin cleanup expired async-jobs 2019-07-16 17:49:34,505 INFO [o.a.c.f.j.i.AsyncJobManagerImpl] (AsyncJobMgr-Heartbeat-1:ctx-10411fc1) (logid:9ee1c670) End cleanup expired async-jobs 2019-07-16 17:49:34,605 ERROR [c.c.u.n.Link] (AgentManager-SSLHandshakeHandler-1:null) (logid:) SSL error caught during wrap data: null cert chain, for local address=/127.0.0.1:8250, remote address=/127.0.0.1:34656. 2019-07-16 17:49:39,622 ERROR [c.c.u.n.Link] (AgentManager-SSLHandshakeHandler-1:null) (logid:) SSL error caught during wrap data: null cert chain, for local address=/127.0.0.1:8250, remote address=/127.0.0.1:34658. 2019-07-16 17:49:40,407 DEBUG [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-f9b93bfe) (logid:37cd4484) Skip capacity scan as there is no Primary Storage in 'Up' state
