If it was urgent, you would probably want to answer Vivek's question about mysql connector, which probably got upgraded to 8.x.y and broke the whole thing
Secondly, as you mention a recent yum update as a suspect, its worth investigating what was updated and revert accordingly... just saying... On Sun, 19 Apr 2020, 23:40 Fariborz Navidan, <mdvlinqu...@gmail.com> wrote: > Now I get this error from my browser: > > The following error was encountered while trying to retrieve the URL: > http://51.91.247.86:8080/client > > *Access Denied.* > > Access control configuration prevents your request from being allowed at > this time. Please contact your service provider if you feel this is > incorrect. > > Your cache administrator is root > > <root?subject=CacheErrorInfo%20-%20ERR_ACCESS_DENIED&body=CacheHost%3A%20losangeles-s07%0D%0AErrPage%3A%20ERR_ACCESS_DENIED%0D%0AErr%3A%20%5Bnone%5D%0D%0ATimeStamp%3A%20Sun,%2019%20Apr%202020%2021%3A37%3A38%20GMT%0D%0A%0D%0AClientIP%3A%202.190.128.180%0D%0A%0D%0AHTTP%20Request%3A%0D%0AGET%20%2Fclient%20HTTP%2F1.1%0AProxy-Connection%3A%20keep-alive%0D%0AUpgrade-Insecure-Requests%3A%201%0D%0AUser-Agent%3A%20Mozilla%2F5.0%20(Windows%20NT%2010.0%3B%20Win64%3B%20x64)%20AppleWebKit%2F537.36%20(KHTML,%20like%20Gecko)%20Chrome%2F80.0.3987.163%20Safari%2F537.36%0D%0AAccept%3A%20text%2Fhtml,application%2Fxhtml+xml,application%2Fxml%3Bq%3D0.9,image%2Fwebp,image%2Fapng,*%2F*%3Bq%3D0.8,application%2Fsigned-exchange%3Bv%3Db3%3Bq%3D0.9%0D%0APurpose%3A%20prefetch%0D%0AAccept-Encoding%3A%20gzip,%20deflate%0D%0AAccept-Language%3A%20en-US,en%3Bq%3D0.9,fa%3Bq%3D0.8%0D%0ACookie%3A%20lang%3Den%3B%20JSESSIONID%3Dnode0oxm4cqpk08gtd779fdbnwhm674.node0%3B%20sessionkey%3DTkejihkV3hvf8jEwetyRmlshJXM%3B%20account%3Dadmin%3B%20username%3Dadmin%3B%20domainid%3Dc1e5f4a3-ca75-11e9-8212-d05099d38681%3B%20role%3D1%3B%20timezone%3DUTC%3B%20timezoneoffset%3D0.0%3B%20userfullname%3Dadmin%2520cloud%3B%20userid%3D6e7ca980-ca77-11e9-8212-d05099d38681%0D%0AHost%3A%2051.91.247.86%3A8080%0D%0A%0D%0A%0D%0A> > . > > On Mon, Apr 20, 2020 at 1:52 AM Fariborz Navidan <mdvlinqu...@gmail.com> > wrote: > > > Any idea? It's really critical > > > > > > On Mon, Apr 20, 2020 at 1:19 AM Fariborz Navidan <mdvlinqu...@gmail.com> > > wrote: > > > >> Just set OS timezone to UTC and rebooted the OS. Now management server > is > >> running still UI throws ERROR 503 and I have following exceptions in > >> management-server.log. > >> > >> 2020-04-19 20:41:21,737 ERROR [c.c.u.PropertiesUtil] (main:null) > (logid:) > >> Unable to find properties file: commands.properties > >> 2020-04-19 20:41:25,389 WARN [o.e.j.w.WebAppContext] (main:null) > >> (logid:) Failed startup of context o.e.j.w.WebAppContext@646be2c3 > >> > {/client,file:///usr/share/cloudstack-management/webapp/,UNAVAILABLE}{/usr/share/cloudstack-management/webapp} > >> com.cloud.utils.exception.CloudRuntimeException: Problem with getting > the > >> ec attribute > >> at com.cloud.utils.db.GenericDaoBase.persist(GenericDaoBase.java:1454) > >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > >> at > >> > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > >> at > >> > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > >> at java.lang.reflect.Method.invoke(Method.java:498) > >> at > >> > org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:338) > >> at > >> > org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:197) > >> at > >> > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) > >> at > >> > com.cloud.utils.db.TransactionContextInterceptor.invoke(TransactionContextInterceptor.java:34) > >> at > >> > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:174) > >> at > >> > org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:92) > >> at > >> > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185) > >> at > >> > org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) > >> at com.sun.proxy.$Proxy206.persist(Unknown Source) > >> at > >> > com.cloud.cluster.ClusterManagerImpl$6.doInTransaction(ClusterManagerImpl.java:965) > >> at > >> > com.cloud.cluster.ClusterManagerImpl$6.doInTransaction(ClusterManagerImpl.java:944) > >> at com.cloud.utils.db.Transaction$2.doInTransaction(Transaction.java:50) > >> at com.cloud.utils.db.Transaction.execute(Transaction.java:40) > >> at com.cloud.utils.db.Transaction.execute(Transaction.java:47) > >> at > com.cloud.cluster.ClusterManagerImpl.start(ClusterManagerImpl.java:944) > >> at > >> > org.apache.cloudstack.spring.lifecycle.CloudStackExtendedLifeCycle$1.with(CloudStackExtendedLifeCycle.java:75) > >> at > >> > org.apache.cloudstack.spring.lifecycle.CloudStackExtendedLifeCycle.with(CloudStackExtendedLifeCycle.java:154) > >> at > >> > org.apache.cloudstack.spring.lifecycle.CloudStackExtendedLifeCycle.startBeans(CloudStackExtendedLifeCycle.java:72) > >> at > >> > org.apache.cloudstack.spring.lifecycle.CloudStackExtendedLifeCycleStart.run(CloudStackExtendedLifeCycleStart.java:46) > >> at > >> > org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet$1.with(DefaultModuleDefinitionSet.java:105) > >> at > >> > org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:245) > >> at > >> > org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:250) > >> at > >> > org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:250) > >> at > >> > org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:233) > >> at > >> > org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.startContexts(DefaultModuleDefinitionSet.java:97) > >> at > >> > org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.load(DefaultModuleDefinitionSet.java:80) > >> at > >> > org.apache.cloudstack.spring.module.factory.ModuleBasedContextFactory.loadModules(ModuleBasedContextFactory.java:37) > >> at > >> > org.apache.cloudstack.spring.module.factory.CloudStackSpringContext.init(CloudStackSpringContext.java:71) > >> at > >> > org.apache.cloudstack.spring.module.factory.CloudStackSpringContext.<init>(CloudStackSpringContext.java:58) > >> at > >> > org.apache.cloudstack.spring.module.factory.CloudStackSpringContext.<init>(CloudStackSpringContext.java:62) > >> at > >> > org.apache.cloudstack.spring.module.web.CloudStackContextLoaderListener.contextInitialized(CloudStackContextLoaderListener.java:52) > >> at > >> > org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:890) > >> at > >> > org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:532) > >> at > >> > org.eclipse.jetty.server.handler.ContextHandler.startContext(ContextHandler.java:853) > >> at > >> > org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:344) > >> at > >> > org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1515) > >> at > >> > org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1477) > >> at > >> > org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:785) > >> at > >> > org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:261) > >> at > org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:545) > >> at > >> > org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) > >> at > >> > org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:133) > >> at > >> > org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:107) > >> at > >> > org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:113) > >> at > >> > org.eclipse.jetty.server.handler.gzip.GzipHandler.doStart(GzipHandler.java:273) > >> at > >> > org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) > >> at > >> > org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:133) > >> at > >> > org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:115) > >> at > >> > org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:113) > >> at > >> > org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) > >> at > >> > org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:133) > >> at org.eclipse.jetty.server.Server.start(Server.java:418) > >> at > >> > org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:107) > >> at > >> > org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:113) > >> at org.eclipse.jetty.server.Server.doStart(Server.java:385) > >> at > >> > org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) > >> at org.apache.cloudstack.ServerDaemon.start(ServerDaemon.java:186) > >> at org.apache.cloudstack.ServerDaemon.main(ServerDaemon.java:103) > >> Caused by: java.lang.IllegalArgumentException: Can not set long field > >> com.cloud.cluster.ManagementServerHostVO.id to java.math.BigInteger > >> at > >> > sun.reflect.UnsafeFieldAccessorImpl.throwSetIllegalArgumentException(UnsafeFieldAccessorImpl.java:167) > >> at > >> > sun.reflect.UnsafeFieldAccessorImpl.throwSetIllegalArgumentException(UnsafeFieldAccessorImpl.java:171) > >> at > >> > sun.reflect.UnsafeLongFieldAccessorImpl.set(UnsafeLongFieldAccessorImpl.java:102) > >> ... 64 more > >> > >> 2020-04-19 20:42:20,947 WARN [c.c.v.SystemVmLoadScanner] > >> (consoleproxy-1:ctx-065dc434) (logid:4529ac89) Unexpected exception > Problem > >> with getting the ec attribute > >> com.cloud.utils.exception.CloudRuntimeException: Problem with getting > the > >> ec attribute > >> at com.cloud.utils.db.GenericDaoBase.persist(GenericDaoBase.java:1454) > >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > >> at > >> > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) > >> at > >> > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > >> at java.lang.reflect.Method.invoke(Method.java:498) > >> at > >> > org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:338) > >> at > >> > org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:197) > >> at > >> > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163) > >> at > >> > com.cloud.utils.db.TransactionContextInterceptor.invoke(TransactionContextInterceptor.java:34) > >> at > >> > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:174) > >> at > >> > org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:92) > >> at > >> > org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:185) > >> at > >> > org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212) > >> at com.sun.proxy.$Proxy185.persist(Unknown Source) > >> at > >> > org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl.getPseudoJob(AsyncJobManagerImpl.java:184) > >> at > >> org.apache.cloudstack.framework.jobs > .AsyncJobExecutionContext.registerPseudoExecutionContext(AsyncJobExecutionContext.java:194) > >> at > >> > com.cloud.vm.SystemVmLoadScanner$1.runInContext(SystemVmLoadScanner.java:79) > >> at > >> > org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49) > >> at > >> > org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) > >> at > >> > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) > >> at > >> > org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) > >> at > >> > org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46) > >> at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) > >> at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) > >> at > >> > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) > >> at > >> > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) > >> at > >> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) > >> at > >> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) > >> at java.lang.Thread.run(Thread.java:748) > >> Caused by: java.lang.IllegalArgumentException: Can not set long field > >> org.apache.cloudstack.framework.jobs.impl.AsyncJobVO.id to > >> java.math.BigInteger > >> at > >> > sun.reflect.UnsafeFieldAccessorImpl.throwSetIllegalArgumentException(UnsafeFieldAccessorImpl.java:167) > >> at > >> > sun.reflect.UnsafeFieldAccessorImpl.throwSetIllegalArgumentException(UnsafeFieldAccessorImpl.java:171) > >> at > >> > sun.reflect.UnsafeLongFieldAccessorImpl.set(UnsafeLongFieldAccessorImpl.java:102) > >> ... 30 more > >> > >> On Mon, Apr 20, 2020 at 12:05 AM Vivek Kumar <vivek.ku...@indiqus.com> > >> wrote: > >> > >>> Hello, > >>> > >>> Can you verify the mysql db host entry in db.properties file. It’s > under > >>> /etc/cloudstack/manaement. You can also check the mysql connector > version - > >>> i.e "mysql-connector-java" and "mysql-connector-python”. > >>> > >>> > >>> Vivek Kumar > >>> Manager - Cloud & DevOps > >>> IndiQus Technologies > >>> 24*7 O +91 11 4055 1411 | M +91 7503460090 > >>> www.indiqus.com <http://indiqus.com/> > >>> > >>> This message is intended only for the use of the individual or entity > to > >>> which it is addressed and may contain information that is confidential > >>> and/or privileged. If you are not the intended recipient please delete > the > >>> original message and any copy of it from your computer system. You are > >>> hereby notified that any dissemination, distribution or copying of this > >>> communication is strictly prohibited unless proper authorization has > been > >>> obtained for such action. If you have received this communication in > error, > >>> please notify the sender immediately. Although IndiQus attempts to > sweep > >>> e-mail and attachments for viruses, it does not guarantee that both are > >>> virus-free and accepts no liability for any damage sustained as a > result of > >>> viruses. > >>> > >>> > On 19-Apr-2020, at 8:14 PM, Fariborz Navidan <mdvlinqu...@gmail.com> > >>> wrote: > >>> > > >>> > Hello, > >>> > > >>> > I just restarted cloudstack management and now I cannot access UI. > >>> > Following errors are given in the log. I checked I can login to MySQL > >>> with > >>> > same user and password I have setup the management server. I guess > this > >>> > could be caused by recent yum update command. > >>> > > >>> > > >>> > 2020-04-19 16:36:45,022 INFO [o.e.j.s.AbstractConnector] > >>> (Thread-1:null) > >>> > (logid:) Stopped ServerConnector@51e2adc7{HTTP/1.1,[http/1.1]}{ > >>> 0.0.0.0:8080} > >>> > 2020-04-19 16:36:45,024 INFO [o.e.j.s.session] (Thread-1:null) > >>> (logid:) > >>> > Stopped scavenging > >>> > 2020-04-19 16:36:45,026 INFO [o.e.j.s.h.ContextHandler] > >>> (Thread-1:null) > >>> > (logid:) Stopped o.e.j.s.h.MovedContextHandler@6e2c9341 > >>> {/,null,UNAVAILABLE} > >>> > 2020-04-19 16:36:45,028 INFO [o.e.j.s.h.ContextHandler] > >>> (Thread-1:null) > >>> > (logid:) Stopped o.e.j.w.WebAppContext@646be2c3 > >>> > {/client,null,UNAVAILABLE}{/usr/share/cloudstack-management/webapp} > >>> > 2020-04-19 16:36:46,002 INFO [o.a.c.ServerDaemon] (main:null) > (logid:) > >>> > Server configuration file found: > >>> > /etc/cloudstack/management/server.properties > >>> > 2020-04-19 16:36:46,008 INFO [o.a.c.ServerDaemon] (main:null) > (logid:) > >>> > Initializing server daemon on null, with http.enable=true, > >>> http.port=8080, > >>> > https.enable=false, https.port=8443, context.path=/client > >>> > 2020-04-19 16:36:46,016 INFO [o.e.j.u.log] (main:null) (logid:) > >>> Logging > >>> > initialized @653ms to org.eclipse.jetty.util.log.Slf4jLog > >>> > 2020-04-19 16:36:46,147 INFO [o.e.j.s.Server] (main:null) (logid:) > >>> > jetty-9.4.z-SNAPSHOT, build timestamp: 2017-11-21T22:27:37+01:00, git > >>> hash: > >>> > 82b8fb23f757335bb3329d540ce37a2a2615f0a8 > >>> > 2020-04-19 16:36:46,191 INFO [o.e.j.s.AbstractNCSARequestLog] > >>> (main:null) > >>> > (logid:) Opened /var/log/cloudstack/management/access.log > >>> > 2020-04-19 16:36:46,281 INFO [o.e.j.w.StandardDescriptorProcessor] > >>> > (main:null) (logid:) NO JSP Support for /client, did not find > >>> > org.eclipse.jetty.jsp.JettyJspServlet > >>> > 2020-04-19 16:36:46,304 INFO [o.e.j.s.session] (main:null) (logid:) > >>> > DefaultSessionIdManager workerName=node0 > >>> > 2020-04-19 16:36:46,304 INFO [o.e.j.s.session] (main:null) (logid:) > No > >>> > SessionScavenger set, using defaults > >>> > 2020-04-19 16:36:46,305 INFO [o.e.j.s.session] (main:null) (logid:) > >>> > Scavenging every 660000ms > >>> > 2020-04-19 16:36:58,246 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Loading module context [bootstrap] from URL > >>> > > >>> > [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.13.0.0.jar!/META-INF/cloudstack/bootstrap/spring-bootstrap-context.xml] > >>> > 2020-04-19 16:36:58,246 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Loading module context [bootstrap] from URL > >>> > > >>> > [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.13.0.0.jar!/META-INF/cloudstack/bootstrap/spring-bootstrap-context-inheritable.xml] > >>> > 2020-04-19 16:36:58,396 DEBUG [c.c.u.c.EncryptionSecretKeyChecker] > >>> > (main:null) (logid:) Encryption Type: file > >>> > 2020-04-19 16:36:58,434 INFO [c.c.u.LogUtils] (main:null) (logid:) > >>> log4j > >>> > configuration found at /etc/cloudstack/management/log4j-cloud.xml > >>> > 2020-04-19 16:36:58,449 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Loaded module context [bootstrap] in 203 ms > >>> > 2020-04-19 16:36:58,449 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: bootstrap > >>> > 2020-04-19 16:36:58,450 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: system > >>> > 2020-04-19 16:36:58,450 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: core > >>> > 2020-04-19 16:36:58,450 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: allocator > >>> > 2020-04-19 16:36:58,450 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: host-allocator-random > >>> > 2020-04-19 16:36:58,450 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: planner > >>> > 2020-04-19 16:36:58,450 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: api-planner > >>> > 2020-04-19 16:36:58,450 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: baremetal-planner > >>> > 2020-04-19 16:36:58,450 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: explicit-dedication > >>> > 2020-04-19 16:36:58,450 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: host-affinity > >>> > 2020-04-19 16:36:58,450 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: host-anti-affinity > >>> > 2020-04-19 16:36:58,450 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: implicit-dedication > >>> > 2020-04-19 16:36:58,450 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: server-planner > >>> > 2020-04-19 16:36:58,450 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: skip-heurestics > >>> > 2020-04-19 16:36:58,451 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: > user-concentrated-pod > >>> > 2020-04-19 16:36:58,451 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: server-allocator > >>> > 2020-04-19 16:36:58,451 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: api > >>> > 2020-04-19 16:36:58,454 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: acl-dynamic-role-based > >>> > 2020-04-19 16:36:58,455 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: acl-static-role-based > >>> > 2020-04-19 16:36:58,455 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: cloudian > >>> > 2020-04-19 16:36:58,455 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: ldap > >>> > 2020-04-19 16:36:58,455 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: md5 > >>> > 2020-04-19 16:36:58,455 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: metrics > >>> > 2020-04-19 16:36:58,455 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: pbkdf2 > >>> > 2020-04-19 16:36:58,455 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: plaintext > >>> > 2020-04-19 16:36:58,455 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: prometheus > >>> > 2020-04-19 16:36:58,455 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: quota > >>> > 2020-04-19 16:36:58,455 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: rate-limit > >>> > 2020-04-19 16:36:58,455 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: saml2 > >>> > 2020-04-19 16:36:58,455 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: server-api > >>> > 2020-04-19 16:36:58,455 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: sha256salted > >>> > 2020-04-19 16:36:58,455 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: solidfire-intg-test > >>> > 2020-04-19 16:36:58,456 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: vmware-sioc > >>> > 2020-04-19 16:36:58,456 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: api-config > >>> > 2020-04-19 16:36:58,456 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: backend > >>> > 2020-04-19 16:36:58,456 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: ca > >>> > 2020-04-19 16:36:58,456 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: root-ca > >>> > 2020-04-19 16:36:58,456 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: compute > >>> > 2020-04-19 16:36:58,456 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: baremetal-compute > >>> > 2020-04-19 16:36:58,456 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: hyperv-compute > >>> > 2020-04-19 16:36:58,456 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: kvm-compute > >>> > 2020-04-19 16:36:58,456 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: ovm-compute > >>> > 2020-04-19 16:36:58,456 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: ovm3-compute > >>> > 2020-04-19 16:36:58,456 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: > >>> > server-alert-adapter-compute > >>> > 2020-04-19 16:36:58,456 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: server-compute > >>> > 2020-04-19 16:36:58,456 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: server-fencer > >>> > 2020-04-19 16:36:58,456 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: server-investigator > >>> > 2020-04-19 16:36:58,457 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: vmware-compute > >>> > 2020-04-19 16:36:58,457 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: xenserver-compute > >>> > 2020-04-19 16:36:58,457 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: network > >>> > 2020-04-19 16:36:58,457 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: baremetal-network > >>> > 2020-04-19 16:36:58,457 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: bigswitch > >>> > 2020-04-19 16:36:58,457 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: cisco-vnmc > >>> > 2020-04-19 16:36:58,457 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: contrail > >>> > 2020-04-19 16:36:58,457 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: elb > >>> > 2020-04-19 16:36:58,457 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: f5 > >>> > 2020-04-19 16:36:58,457 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: globodns > >>> > 2020-04-19 16:36:58,457 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: netscaler > >>> > 2020-04-19 16:36:58,457 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: nvp > >>> > 2020-04-19 16:36:58,457 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: opendaylight > >>> > 2020-04-19 16:36:58,457 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: ovs > >>> > 2020-04-19 16:36:58,457 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: paloalto > >>> > 2020-04-19 16:36:58,458 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: server-network > >>> > 2020-04-19 16:36:58,458 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: srx > >>> > 2020-04-19 16:36:58,458 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: ssp > >>> > 2020-04-19 16:36:58,458 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: vcs > >>> > 2020-04-19 16:36:58,458 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: vmware-network > >>> > 2020-04-19 16:36:58,458 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: vxlan > >>> > 2020-04-19 16:36:58,458 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: > >>> server-alert-adapter-backend > >>> > 2020-04-19 16:36:58,458 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: storage > >>> > 2020-04-19 16:36:58,458 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: baremetal-storage > >>> > 2020-04-19 16:36:58,458 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: > >>> > server-alert-adapter-storage > >>> > 2020-04-19 16:36:58,458 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: server-storage > >>> > 2020-04-19 16:36:58,458 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: > >>> server-template-adapter > >>> > 2020-04-19 16:36:58,458 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: storage-allocator > >>> > 2020-04-19 16:36:58,458 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: > storage-image-default > >>> > 2020-04-19 16:36:58,458 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: storage-image-s3 > >>> > 2020-04-19 16:36:58,459 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: storage-image-swift > >>> > 2020-04-19 16:36:58,459 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: > >>> storage-volume-cloudbyte > >>> > 2020-04-19 16:36:58,459 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: > storage-volume-datera > >>> > 2020-04-19 16:36:58,459 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: > storage-volume-default > >>> > 2020-04-19 16:36:58,459 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: > >>> storage-volume-solidfire > >>> > 2020-04-19 16:36:58,459 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: vmware-storage > >>> > 2020-04-19 16:36:58,459 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: discoverer > >>> > 2020-04-19 16:36:58,459 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: baremetal-discoverer > >>> > 2020-04-19 16:36:58,459 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: hyperv-discoverer > >>> > 2020-04-19 16:36:58,459 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: ovm-discoverer > >>> > 2020-04-19 16:36:58,459 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: ovm3-discoverer > >>> > 2020-04-19 16:36:58,459 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: > >>> secondary-storage-discoverer > >>> > 2020-04-19 16:36:58,459 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: server-discoverer > >>> > 2020-04-19 16:36:58,459 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: vmware-discoverer > >>> > 2020-04-19 16:36:58,459 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: xenserver-discoverer > >>> > 2020-04-19 16:36:58,459 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: outofbandmanagement > >>> > 2020-04-19 16:36:58,460 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: ipmitool > >>> > 2020-04-19 16:36:58,460 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Module Hierarchy: nested-cloudstack > >>> > 2020-04-19 16:36:58,460 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Loading module context [system] from URL > >>> > > >>> > [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.13.0.0.jar!/META-INF/cloudstack/system/spring-framework-config-system-context.xml] > >>> > 2020-04-19 16:36:58,460 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Loading module context [system] from URL > >>> > > >>> > [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.13.0.0.jar!/META-INF/cloudstack/system/spring-server-system-context.xml] > >>> > 2020-04-19 16:36:58,460 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Loading module context [system] from URL > >>> > > >>> > [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.13.0.0.jar!/META-INF/cloudstack/system/spring-core-system-context.xml] > >>> > 2020-04-19 16:36:58,461 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Loading module context [system] from URL > >>> > > >>> > [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.13.0.0.jar!/META-INF/cloudstack/system/spring-framework-db-system-context.xml] > >>> > 2020-04-19 16:36:58,461 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Loading module context [system] from URL > >>> > > >>> > [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.13.0.0.jar!/META-INF/cloudstack/system/spring-engine-schema-system-checkers-context.xml] > >>> > 2020-04-19 16:36:58,461 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Loading module context [system] from URL > >>> > > >>> > [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.13.0.0.jar!/META-INF/cloudstack/system/spring-framework-config-system-context-inheritable.xml] > >>> > 2020-04-19 16:36:58,461 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Loading module context [system] from URL > >>> > > >>> > [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.13.0.0.jar!/META-INF/cloudstack/system/spring-core-system-context-inheritable.xml] > >>> > 2020-04-19 16:36:58,461 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Loading module context [system] from URL > >>> > > >>> > [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.13.0.0.jar!/META-INF/cloudstack/system/spring-contrail-system-context-inheritable.xml] > >>> > 2020-04-19 16:36:58,461 INFO > >>> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] > >>> > (main:null) (logid:) Loading module context [system] from URL > >>> > > >>> > [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.13.0.0.jar!/META-INF/cloudstack/bootstrap/spring-bootstrap-context-inheritable.xml] > >>> > 2020-04-19 16:36:59,341 INFO [c.c.u.d.T.Transaction] (main:null) > >>> (logid:) > >>> > Is Data Base High Availiability enabled? Ans : false > >>> > 2020-04-19 16:36:59,390 DEBUG [c.c.u.d.DriverLoader] (main:null) > >>> (logid:) > >>> > Successfully loaded DB driver com.mysql.jdbc.Driver > >>> > 2020-04-19 16:36:59,416 DEBUG [c.c.u.d.DriverLoader] (main:null) > >>> (logid:) > >>> > DB driver com.mysql.jdbc.Driver was already loaded. > >>> > 2020-04-19 16:36:59,417 DEBUG [c.c.u.d.DriverLoader] (main:null) > >>> (logid:) > >>> > DB driver com.mysql.jdbc.Driver was already loaded. > >>> > 2020-04-19 16:37:03,616 ERROR [c.c.u.d.Merovingian2] (main:null) > >>> (logid:) > >>> > Unable to get a new db connection > >>> > java.sql.SQLNonTransientConnectionException: Could not create > >>> connection to > >>> > database server. Attempted reconnect 3 times. Giving up. > >>> > at > >>> > > >>> > com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:110) > >>> > at > >>> > > >>> > com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:97) > >>> > at > >>> > > >>> > com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:89) > >>> > at > >>> > > >>> > com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:63) > >>> > at > >>> > > >>> > com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:73) > >>> > at > >>> > > >>> > com.mysql.cj.jdbc.ConnectionImpl.connectWithRetries(ConnectionImpl.java:906) > >>> > at > >>> com.mysql.cj.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:831) > >>> > at com.mysql.cj.jdbc.ConnectionImpl.<init>(ConnectionImpl.java:456) > >>> > at > >>> com.mysql.cj.jdbc.ConnectionImpl.getInstance(ConnectionImpl.java:246) > >>> > at > >>> > > >>> > com.mysql.cj.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:197) > >>> > at java.sql.DriverManager.getConnection(DriverManager.java:664) > >>> > at java.sql.DriverManager.getConnection(DriverManager.java:247) > >>> > at > >>> > > >>> > org.apache.commons.dbcp2.DriverManagerConnectionFactory.createConnection(DriverManagerConnectionFactory.java:87) > >>> > at > >>> > > >>> > org.apache.commons.dbcp2.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:260) > >>> > at > >>> > > >>> > org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:888) > >>> > at > >>> > > >>> > org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:432) > >>> > at > >>> > > >>> > org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:361) > >>> > at > >>> > > >>> > org.apache.commons.dbcp2.PoolingDataSource.getConnection(PoolingDataSource.java:134) > >>> > at > >>> > > >>> > com.cloud.utils.db.TransactionLegacy.getStandaloneConnectionWithException(TransactionLegacy.java:213) > >>> > at com.cloud.utils.db.Merovingian2.<init>(Merovingian2.java:68) > >>> > at > >>> com.cloud.utils.db.Merovingian2.createLockMaster(Merovingian2.java:88) > >>> > at > >>> com.cloud.server.LockMasterListener.<init>(LockMasterListener.java:33) > >>> > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > >>> Method) > >>> > at > >>> > > >>> > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) > >>> > at > >>> > > >>> > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) > >>> > at java.lang.reflect.Constructor.newInstance(Constructor.java:423) > >>> > at > >>> > org.springframework.beans.BeanUtils.instantiateClass(BeanUtils.java:163) > >>> > at > >>> > > >>> > org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:117) > >>> > at > >>> > > >>> > org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:271) > >>> > at > >>> > > >>> > org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1270) > >>> > at > >>> > > >>> > org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1127) > >>> > at > >>> > > >>> > org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:545) > >>> > at > >>> > > >>> > org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:502) > >>> > at > >>> > > >>> > org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:312) > >>> > at > >>> > > >>> > org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:228) > >>> > at > >>> > > >>> > org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:310) > >>> > at > >>> > > >>> > org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:200) > >>> > at > >>> > > >>> > org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:758) > >>> > at > >>> > > >>> > org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:868) > >>> > at > >>> > > >>> > org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:549) > >>> > at > >>> > > >>> > org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.loadContext(DefaultModuleDefinitionSet.java:145) > >>> > at > >>> > > >>> > org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet$2.with(DefaultModuleDefinitionSet.java:122) > >>> > at > >>> > > >>> > org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:245) > >>> > at > >>> > > >>> > org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:250) > >>> > at > >>> > > >>> > org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:233) > >>> > at > >>> > > >>> > org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.loadContexts(DefaultModuleDefinitionSet.java:117) > >>> > at > >>> > > >>> > org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.load(DefaultModuleDefinitionSet.java:79) > >>> > at > >>> > > >>> > org.apache.cloudstack.spring.module.factory.ModuleBasedContextFactory.loadModules(ModuleBasedContextFactory.java:37) > >>> > at > >>> > > >>> > org.apache.cloudstack.spring.module.factory.CloudStackSpringContext.init(CloudStackSpringContext.java:71) > >>> > at > >>> > > >>> > org.apache.cloudstack.spring.module.factory.CloudStackSpringContext.<init>(CloudStackSpringContext.java:58) > >>> > at > >>> > > >>> > org.apache.cloudstack.spring.module.factory.CloudStackSpringContext.<init>(CloudStackSpringContext.java:62) > >>> > at > >>> > > >>> > org.apache.cloudstack.spring.module.web.CloudStackContextLoaderListener.contextInitialized(CloudStackContextLoaderListener.java:52) > >>> > at > >>> > > >>> > org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:890) > >>> > at > >>> > > >>> > org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:532) > >>> > at > >>> > > >>> > org.eclipse.jetty.server.handler.ContextHandler.startContext(ContextHandler.java:853) > >>> > at > >>> > > >>> > org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:344) > >>> > at > >>> > > >>> > org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1515) > >>> > at > >>> > > >>> > org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1477) > >>> > at > >>> > > >>> > org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:785) > >>> > at > >>> > > >>> > org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:261) > >>> > at > >>> org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:545) > >>> > at > >>> > > >>> > org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) > >>> > at > >>> > > >>> > org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:133) > >>> > at > >>> > > >>> > org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:107) > >>> > at > >>> > > >>> > org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:113) > >>> > at > >>> > > >>> > org.eclipse.jetty.server.handler.gzip.GzipHandler.doStart(GzipHandler.java:273) > >>> > at > >>> > > >>> > org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) > >>> > at > >>> > > >>> > org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:133) > >>> > at > >>> > > >>> > org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:115) > >>> > at > >>> > > >>> > org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:113) > >>> > at > >>> > > >>> > org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) > >>> > at > >>> > > >>> > org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:133) > >>> > at org.eclipse.jetty.server.Server.start(Server.java:418) > >>> > at > >>> > > >>> > org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:107) > >>> > at > >>> > > >>> > org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:113) > >>> > at org.eclipse.jetty.server.Server.doStart(Server.java:385) > >>> > at > >>> > > >>> > org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) > >>> > at org.apache.cloudstack.ServerDaemon.start(ServerDaemon.java:186) > >>> > at org.apache.cloudstack.ServerDaemon.main(ServerDaemon.java:103) > >>> > Caused by: > >>> com.mysql.cj.exceptions.InvalidConnectionAttributeException: The > >>> > server time zone value 'CEST' is unrecognized or represents more than > >>> one > >>> > time zone. You must configure either the server or JDBC driver (via > the > >>> > 'serverTimezone' configuration property) to use a more specifc time > >>> zone > >>> > value if you want to utilize time zone support. > >>> > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > >>> Method) > >>> > at > >>> > > >>> > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) > >>> > at > >>> > > >>> > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) > >>> > ... 81 more > >>> > 2020-04-19 16:37:03,620 WARN > [o.a.c.s.m.c.ResourceApplicationContext] > >>> > (main:null) (logid:) Exception encountered during context > >>> initialization - > >>> > cancelling refresh attempt: > >>> > org.springframework.beans.factory.BeanCreationException: Error > creating > >>> > bean with name 'lockMasterListener' defined in URL > >>> > > >>> > [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.13.0.0.jar!/META-INF/cloudstack/system/spring-server-system-context.xml]: > >>> > Bean instantiation via constructor failed; nested exception is > >>> > org.springframework.beans.BeanInstantiationException: Failed to > >>> instantiate > >>> > [com.cloud.server.LockMasterListener]: Constructor threw exception; > >>> nested > >>> > exception is com.cloud.utils.exception.CloudRuntimeException: Unable > to > >>> > initialize a connection to the database for locking purposes > >>> > 2020-04-19 16:37:03,621 WARN [o.e.j.w.WebAppContext] (main:null) > >>> (logid:) > >>> > Failed startup of context o.e.j.w.WebAppContext@646be2c3 > >>> > > >>> > {/client,file:///usr/share/cloudstack-management/webapp/,UNAVAILABLE}{/usr/share/cloudstack-management/webapp} > >>> > org.springframework.beans.factory.BeanCreationException: Error > creating > >>> > bean with name 'lockMasterListener' defined in URL > >>> > > >>> > [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.13.0.0.jar!/META-INF/cloudstack/system/spring-server-system-context.xml]: > >>> > Bean instantiation via constructor failed; nested exception is > >>> > org.springframework.beans.BeanInstantiationException: Failed to > >>> instantiate > >>> > [com.cloud.server.LockMasterListener]: Constructor threw exception; > >>> nested > >>> > exception is com.cloud.utils.exception.CloudRuntimeException: Unable > to > >>> > initialize a connection to the database for locking purposes > >>> > at > >>> > > >>> > org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:278) > >>> > at > >>> > > >>> > org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1270) > >>> > at > >>> > > >>> > org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1127) > >>> > at > >>> > > >>> > org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:545) > >>> > at > >>> > > >>> > org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:502) > >>> > at > >>> > > >>> > org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:312) > >>> > at > >>> > > >>> > org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:228) > >>> > at > >>> > > >>> > org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:310) > >>> > at > >>> > > >>> > org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:200) > >>> > at > >>> > > >>> > org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:758) > >>> > at > >>> > > >>> > org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:868) > >>> > at > >>> > > >>> > org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:549) > >>> > at > >>> > > >>> > org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.loadContext(DefaultModuleDefinitionSet.java:145) > >>> > at > >>> > > >>> > org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet$2.with(DefaultModuleDefinitionSet.java:122) > >>> > at > >>> > > >>> > org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:245) > >>> > at > >>> > > >>> > org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:250) > >>> > at > >>> > > >>> > org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:233) > >>> > at > >>> > > >>> > org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.loadContexts(DefaultModuleDefinitionSet.java:117) > >>> > at > >>> > > >>> > org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.load(DefaultModuleDefinitionSet.java:79) > >>> > at > >>> > > >>> > org.apache.cloudstack.spring.module.factory.ModuleBasedContextFactory.loadModules(ModuleBasedContextFactory.java:37) > >>> > at > >>> > > >>> > org.apache.cloudstack.spring.module.factory.CloudStackSpringContext.init(CloudStackSpringContext.java:71) > >>> > at > >>> > > >>> > org.apache.cloudstack.spring.module.factory.CloudStackSpringContext.<init>(CloudStackSpringContext.java:58) > >>> > at > >>> > > >>> > org.apache.cloudstack.spring.module.factory.CloudStackSpringContext.<init>(CloudStackSpringContext.java:62) > >>> > at > >>> > > >>> > org.apache.cloudstack.spring.module.web.CloudStackContextLoaderListener.contextInitialized(CloudStackContextLoaderListener.java:52) > >>> > at > >>> > > >>> > org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:890) > >>> > at > >>> > > >>> > org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:532) > >>> > at > >>> > > >>> > org.eclipse.jetty.server.handler.ContextHandler.startContext(ContextHandler.java:853) > >>> > at > >>> > > >>> > org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:344) > >>> > at > >>> > > >>> > org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1515) > >>> > at > >>> > > >>> > org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1477) > >>> > at > >>> > > >>> > org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:785) > >>> > at > >>> > > >>> > org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:261) > >>> > at > >>> org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:545) > >>> > at > >>> > > >>> > org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) > >>> > at > >>> > > >>> > org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:133) > >>> > at > >>> > > >>> > org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:107) > >>> > at > >>> > > >>> > org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:113) > >>> > at > >>> > > >>> > org.eclipse.jetty.server.handler.gzip.GzipHandler.doStart(GzipHandler.java:273) > >>> > at > >>> > > >>> > org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) > >>> > at > >>> > > >>> > org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:133) > >>> > at > >>> > > >>> > org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:115) > >>> > at > >>> > > >>> > org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:113) > >>> > at > >>> > > >>> > org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) > >>> > at > >>> > > >>> > org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:133) > >>> > at org.eclipse.jetty.server.Server.start(Server.java:418) > >>> > at > >>> > > >>> > org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:107) > >>> > at > >>> > > >>> > org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:113) > >>> > at org.eclipse.jetty.server.Server.doStart(Server.java:385) > >>> > at > >>> > > >>> > org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:68) > >>> > at org.apache.cloudstack.ServerDaemon.start(ServerDaemon.java:186) > >>> > at org.apache.cloudstack.ServerDaemon.main(ServerDaemon.java:103) > >>> > Caused by: org.springframework.beans.BeanInstantiationException: > >>> Failed to > >>> > instantiate [com.cloud.server.LockMasterListener]: Constructor threw > >>> > exception; nested exception is > >>> > com.cloud.utils.exception.CloudRuntimeException: Unable to > initialize a > >>> > connection to the database for locking purposes > >>> > at > >>> > org.springframework.beans.BeanUtils.instantiateClass(BeanUtils.java:175) > >>> > at > >>> > > >>> > org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:117) > >>> > at > >>> > > >>> > org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:271) > >>> > ... 50 more > >>> > Caused by: com.cloud.utils.exception.CloudRuntimeException: Unable to > >>> > initialize a connection to the database for locking purposes > >>> > at com.cloud.utils.db.Merovingian2.<init>(Merovingian2.java:74) > >>> > at > >>> com.cloud.utils.db.Merovingian2.createLockMaster(Merovingian2.java:88) > >>> > at > >>> com.cloud.server.LockMasterListener.<init>(LockMasterListener.java:33) > >>> > ... 57 more > >>> > Caused by: java.sql.SQLNonTransientConnectionException: Could not > >>> create > >>> > connection to database server. Attempted reconnect 3 times. Giving > up. > >>> > at > >>> > > >>> > com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:110) > >>> > at > >>> > > >>> > com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:97) > >>> > at > >>> > > >>> > com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:89) > >>> > ... 76 more > >>> > Caused by: > >>> com.mysql.cj.exceptions.InvalidConnectionAttributeException: The > >>> > server time zone value 'CEST' is unrecognized or represents more than > >>> one > >>> > time zone. You must configure either the server or JDBC driver (via > the > >>> > 'serverTimezone' configuration property) to use a more specifc time > >>> zone > >>> > value if you want to utilize time zone support. > >>> > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > >>> Method) > >>> > at > >>> > > >>> > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) > >>> > at > >>> > > >>> > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) > >>> > ... 81 more > >>> > 2020-04-19 16:37:03,624 INFO [o.e.j.s.h.ContextHandler] (main:null) > >>> > (logid:) Started o.e.j.s.h.MovedContextHandler@6e2c9341 > >>> {/,null,AVAILABLE} > >>> > 2020-04-19 16:37:03,667 INFO [o.e.j.s.AbstractConnector] (main:null) > >>> > (logid:) Started ServerConnector@51e2adc7{HTTP/1.1,[http/1.1]}{ > >>> 0.0.0.0:8080} > >>> > 2020-04-19 16:37:03,668 INFO [o.e.j.s.Server] (main:null) (logid:) > >>> Started > >>> > @18306ms > >>> > >>> >
