Re: Unable to start cloudstack.management server after initial installation successfully completed.

2024-02-10 Thread Wei ZHOU
Hi,

Since you have enabled FIPS, can you try with stronger db password, and
management key, database key?

-Wei

在 2024年2月10日星期六,Kapil Bhuskute  写道:

> Yes, I have followed all steps accordingly to the management server
> installation document says.
> And the database server is up and running fine.
>
> [root@qcs01 ~]# systemctl status mysqld.service
> ● mysqld.service - MySQL 8.0 database server
>Loaded: loaded (/usr/lib/systemd/system/mysqld.service; enabled;
> vendor preset: disabled)
>Active: active (running) since Sat 2024-02-10 14:36:47 UTC; 2h 32min ago
>  Main PID: 11969 (mysqld)
>Status: "Server is operational"
> Tasks: 46 (limit: 3355442)
>Memory: 859.1M
>CGroup: /system.slice/mysqld.service
>└─11969 /usr/libexec/mysqld --basedir=/usr
>
> Feb 10 14:36:43  systemd[1]: Starting MySQL 8.0 database
> server...
> Feb 10 14:36:43  mysql-prepare-db-dir[11883]: Initializing
> MySQL database
> Feb 10 14:36:47  systemd[1]: Started MySQL 8.0 database
> server.
> [root@qcs01 ~]#
>
>
>
> And one more thing I forgot to mention is that we have FIPS enabled on the
> OEL8 server here. Does that need any additional configurations before the
> management server is started?
> Kindly confirm and share if any additional config is required...
>
>
> Kapil Bhuskute
>
>
> -Original Message-
> From: Pearl d'Silva 
> Sent: Saturday, February 10, 2024 10:29 PM
> To: users@cloudstack.apache.org
> Subject: Re: Unable to start cloudstack.management server after initial
> installation successfully completed.
>
>CAUTION: This Email is from an EXTERNAL source. Ensure you trust
> this sender before clicking on any links or attachments.
>
> Hi Kapil,
>
> Can you please check if your database server is running - i.e., you've
> done all the steps mentioned here:https://urldefense.com/
> v3/__https://docs.cloudstack.apache.org/en/latest/installguide/management-
> server/index.html*install-the-database-on-the-management-
> server-node__;Iw!!Pw1rFClp!tqkNYBskb445HaLvcbQ3ACNCj44tYH
> qz8tRRA9ZHpdOobhELSD7slGjSqcRdp_QRIx8aDAG9eXOAoanofuXWGgxsQi4$
>
> Thanks,
> Pearl
>
>
>
> ________
> From: Kapil Bhuskute 
> Sent: February 10, 2024 11:36 AM
> To: users@cloudstack.apache.org 
> Subject: Unable to start cloudstack.management server after initial
> installation successfully completed.
>
> Hello,
> I have successfully followed all the management server installation steps
> for the first time. I see the cloudstack.management service is also showing
> started and active, but with some errors causing the UI to give below 503
> error. Can someone please help?
>
> ● cloudstack-management.service - CloudStack Management Server
>Loaded: loaded (/usr/lib/systemd/system/cloudstack-management.service;
> enabled; vendor preset: disabled)
>Active: active (running) since Sat 2024-02-10 15:55:09 UTC; 11min ago
> Main PID: 13630 (java)
> Tasks: 102 (limit: 3355442)
>Memory: 870.5M
>CGroup: /system.slice/cloudstack-management.service
>└─13630 /usr/bin/java -Djava.security.properties=/
> etc/cloudstack/management/java.security.ciphers -Djava.awt.headless=true
> -Dcom.sun.management.jmxremote=fa>
>
> Feb 10 15:55:23  java[13630]: INFO  
> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet]
> (main:null) (logid:) Loading module context [nested-cloudstack> Feb 10
> 15:55:23  java[13630]: WARN  
> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet]
> (main:null) (logid:) Failed to start module [nested-cloudstack> Feb 10
> 15:55:23  java[13630]: INFO  
> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet]
> (main:null) (logid:) Loading module context [redfish] from URL> Feb 10
> 15:55:23  java[13630]: INFO  
> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet]
> (main:null) (logid:) Loading module context [redfish] from URL> Feb 10
> 15:55:23  java[13630]: INFO  
> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet]
> (main:null) (logid:) Loading module context [redfish] from URL> Feb 10
> 15:55:23  java[13630]: INFO  
> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet]
> (main:null) (logid:) Loading module context [redfish] from URL> Feb 10
> 15:55:23  java[13630]: INFO  
> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet]
> (main:null) (logid:) Loading module context [redfish] from URL> Feb 10
> 15:55:23  java[13630]: INFO  
> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet]
> (main:null) (logid:) Loading module context [redfish] from URL> Feb 10
> 15:55:23  java[13630]: INFO  
> [o.a.c.s.m.m.i.DefaultModuleDefinitionSet]
> (main:null) (logid:) Loading module context [redfish] from URL> Feb 10
> 15:55:23  java[13630]: WARN  
> [o.a.c.s

RE: Unable to start cloudstack.management server after initial installation successfully completed.

2024-02-10 Thread Kapil Bhuskute
Yes, I have followed all steps accordingly to the management server 
installation document says.
And the database server is up and running fine.

[root@qcs01 ~]# systemctl status mysqld.service
● mysqld.service - MySQL 8.0 database server
   Loaded: loaded (/usr/lib/systemd/system/mysqld.service; enabled; vendor 
preset: disabled)
   Active: active (running) since Sat 2024-02-10 14:36:47 UTC; 2h 32min ago
 Main PID: 11969 (mysqld)
   Status: "Server is operational"
Tasks: 46 (limit: 3355442)
   Memory: 859.1M
   CGroup: /system.slice/mysqld.service
   └─11969 /usr/libexec/mysqld --basedir=/usr

Feb 10 14:36:43  systemd[1]: Starting MySQL 8.0 database server...
Feb 10 14:36:43  mysql-prepare-db-dir[11883]: Initializing MySQL 
database
Feb 10 14:36:47  systemd[1]: Started MySQL 8.0 database server.
[root@qcs01 ~]#



And one more thing I forgot to mention is that we have FIPS enabled on the OEL8 
server here. Does that need any additional configurations before the management 
server is started?
Kindly confirm and share if any additional config is required...


Kapil Bhuskute 


-Original Message-
From: Pearl d'Silva  
Sent: Saturday, February 10, 2024 10:29 PM
To: users@cloudstack.apache.org
Subject: Re: Unable to start cloudstack.management server after initial 
installation successfully completed.

   CAUTION: This Email is from an EXTERNAL source. Ensure you trust this 
sender before clicking on any links or attachments.  

Hi Kapil,

Can you please check if your database server is running - i.e., you've done all 
the steps mentioned 
here:https://urldefense.com/v3/__https://docs.cloudstack.apache.org/en/latest/installguide/management-server/index.html*install-the-database-on-the-management-server-node__;Iw!!Pw1rFClp!tqkNYBskb445HaLvcbQ3ACNCj44tYHqz8tRRA9ZHpdOobhELSD7slGjSqcRdp_QRIx8aDAG9eXOAoanofuXWGgxsQi4$
 

Thanks,
Pearl
 



From: Kapil Bhuskute 
Sent: February 10, 2024 11:36 AM
To: users@cloudstack.apache.org 
Subject: Unable to start cloudstack.management server after initial 
installation successfully completed.

Hello,
I have successfully followed all the management server installation steps for 
the first time. I see the cloudstack.management service is also showing started 
and active, but with some errors causing the UI to give below 503 error. Can 
someone please help?

● cloudstack-management.service - CloudStack Management Server
   Loaded: loaded (/usr/lib/systemd/system/cloudstack-management.service; 
enabled; vendor preset: disabled)
   Active: active (running) since Sat 2024-02-10 15:55:09 UTC; 11min ago Main 
PID: 13630 (java)
Tasks: 102 (limit: 3355442)
   Memory: 870.5M
   CGroup: /system.slice/cloudstack-management.service
   └─13630 /usr/bin/java 
-Djava.security.properties=/etc/cloudstack/management/java.security.ciphers 
-Djava.awt.headless=true -Dcom.sun.management.jmxremote=fa>

Feb 10 15:55:23  java[13630]: INFO  
[o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module 
context [nested-cloudstack> Feb 10 15:55:23  java[13630]: WARN  
[o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Failed to start 
module [nested-cloudstack> Feb 10 15:55:23  java[13630]: INFO  
[o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module 
context [redfish] from URL> Feb 10 15:55:23  java[13630]: INFO  
[o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module 
context [redfish] from URL> Feb 10 15:55:23  java[13630]: INFO  
[o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module 
context [redfish] from URL> Feb 10 15:55:23  java[13630]: INFO  
[o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module 
context [redfish] from URL> Feb 10 15:55:23  java[13630]: INFO  
[o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module 
context [redfish] from URL> Feb 10 15:55:23  java[13630]: INFO  
[o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module 
context [redfish] from URL> Feb 10 15:55:23  java[13630]: INFO  
[o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module 
context [redfish] from URL> Feb 10 15:55:23  java[13630]: WARN  
[o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Failed to start 
module [redfish] due to: > ~

The management logs are showing below messages:
[root@qcs01 ~]# grep -i -E 'error|exception' 
/var/log/cloudstack/management/management-server.log
2024-02-10 15:55:15,811 INFO  [c.c.u.d.T.Transaction] (main:null) (logid:) 
Using the following URI to connect to cloud database 
[jdbc:mysql://localhost:3306/cloud?autoReconnect=true&prepStmtCacheSize=517&cachePrepStmts=true&sessionVariables=sql_mode='STRICT_TRANS_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,NO_ENGINE_SUBSTITUTION'&serverTimezone=UTC].

Re: Unable to start cloudstack.management server after initial installation successfully completed.

2024-02-10 Thread Pearl d'Silva
Hi Kapil,

Can you please check if your database server is running - i.e., you've done all 
the steps mentioned 
here:https://docs.cloudstack.apache.org/en/latest/installguide/management-server/index.html#install-the-database-on-the-management-server-node

Thanks,
Pearl
 



From: Kapil Bhuskute 
Sent: February 10, 2024 11:36 AM
To: users@cloudstack.apache.org 
Subject: Unable to start cloudstack.management server after initial 
installation successfully completed.

Hello,
I have successfully followed all the management server installation steps for 
the first time. I see the cloudstack.management service is also showing started 
and active, but with some errors causing the UI to give below 503 error. Can 
someone please help?

● cloudstack-management.service - CloudStack Management Server
   Loaded: loaded (/usr/lib/systemd/system/cloudstack-management.service; 
enabled; vendor preset: disabled)
   Active: active (running) since Sat 2024-02-10 15:55:09 UTC; 11min ago
Main PID: 13630 (java)
Tasks: 102 (limit: 3355442)
   Memory: 870.5M
   CGroup: /system.slice/cloudstack-management.service
   └─13630 /usr/bin/java 
-Djava.security.properties=/etc/cloudstack/management/java.security.ciphers 
-Djava.awt.headless=true -Dcom.sun.management.jmxremote=fa>

Feb 10 15:55:23  java[13630]: INFO  
[o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module 
context [nested-cloudstack>
Feb 10 15:55:23  java[13630]: WARN  
[o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Failed to start 
module [nested-cloudstack>
Feb 10 15:55:23  java[13630]: INFO  
[o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module 
context [redfish] from URL>
Feb 10 15:55:23  java[13630]: INFO  
[o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module 
context [redfish] from URL>
Feb 10 15:55:23  java[13630]: INFO  
[o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module 
context [redfish] from URL>
Feb 10 15:55:23  java[13630]: INFO  
[o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module 
context [redfish] from URL>
Feb 10 15:55:23  java[13630]: INFO  
[o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module 
context [redfish] from URL>
Feb 10 15:55:23  java[13630]: INFO  
[o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module 
context [redfish] from URL>
Feb 10 15:55:23  java[13630]: INFO  
[o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module 
context [redfish] from URL>
Feb 10 15:55:23  java[13630]: WARN  
[o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Failed to start 
module [redfish] due to: >
~

The management logs are showing below messages:
[root@qcs01 ~]# grep -i -E 'error|exception' 
/var/log/cloudstack/management/management-server.log
2024-02-10 15:55:15,811 INFO  [c.c.u.d.T.Transaction] (main:null) (logid:) 
Using the following URI to connect to cloud database 
[jdbc:mysql://localhost:3306/cloud?autoReconnect=true&prepStmtCacheSize=517&cachePrepStmts=true&sessionVariables=sql_mode='STRICT_TRANS_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,NO_ENGINE_SUBSTITUTION'&serverTimezone=UTC].
2024-02-10 15:55:19,952 ERROR [c.c.u.d.Merovingian2] (main:null) (logid:) 
Unable to get a new db connection
java.sql.SQLNonTransientConnectionException: Could not create connection to 
database server. Attempted reconnect 3 times. Giving up.
at 
com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:110)
at 
com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:97)
at 
com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:89)
at 
com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:63)
at 
com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:73)
at 
com.cloud.utils.db.TransactionLegacy.getStandaloneConnectionWithException(TransactionLegacy.java:212)
Caused by: com.mysql.cj.exceptions.SSLParamsException: Cannot open file:NONE 
[NONE (No such file or directory)]
Caused by: java.io.FileNotFoundException: NONE (No such file or directory)
2024-02-10 15:55:19,958 WARN  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) (logid:) Failed to start module [system] due to: [Error creating 
bean with name 'lockControllerListener' defined in URL 
[jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.19.0.0.jar!/META-INF/cloudstack/system/spring-server-system-context.xml]:
 Bean instantiation via constructor failed; nested exception is 
org.springframework.beans.BeanInstantiationException: Failed to instantiate 
[com.cloud.server.LockControllerListener]: Constructor threw exception; nested 
exception is com.cloud.utils.exception.CloudRunti

Unable to start cloudstack.management server after initial installation successfully completed.

2024-02-10 Thread Kapil Bhuskute
Hello,
I have successfully followed all the management server installation steps for 
the first time. I see the cloudstack.management service is also showing started 
and active, but with some errors causing the UI to give below 503 error. Can 
someone please help?

● cloudstack-management.service - CloudStack Management Server
   Loaded: loaded (/usr/lib/systemd/system/cloudstack-management.service; 
enabled; vendor preset: disabled)
   Active: active (running) since Sat 2024-02-10 15:55:09 UTC; 11min ago
Main PID: 13630 (java)
Tasks: 102 (limit: 3355442)
   Memory: 870.5M
   CGroup: /system.slice/cloudstack-management.service
   └─13630 /usr/bin/java 
-Djava.security.properties=/etc/cloudstack/management/java.security.ciphers 
-Djava.awt.headless=true -Dcom.sun.management.jmxremote=fa>

Feb 10 15:55:23  java[13630]: INFO  
[o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module 
context [nested-cloudstack>
Feb 10 15:55:23  java[13630]: WARN  
[o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Failed to start 
module [nested-cloudstack>
Feb 10 15:55:23  java[13630]: INFO  
[o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module 
context [redfish] from URL>
Feb 10 15:55:23  java[13630]: INFO  
[o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module 
context [redfish] from URL>
Feb 10 15:55:23  java[13630]: INFO  
[o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module 
context [redfish] from URL>
Feb 10 15:55:23  java[13630]: INFO  
[o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module 
context [redfish] from URL>
Feb 10 15:55:23  java[13630]: INFO  
[o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module 
context [redfish] from URL>
Feb 10 15:55:23  java[13630]: INFO  
[o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module 
context [redfish] from URL>
Feb 10 15:55:23  java[13630]: INFO  
[o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Loading module 
context [redfish] from URL>
Feb 10 15:55:23  java[13630]: WARN  
[o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:null) (logid:) Failed to start 
module [redfish] due to: >
~

The management logs are showing below messages:
[root@qcs01 ~]# grep -i -E 'error|exception' 
/var/log/cloudstack/management/management-server.log
2024-02-10 15:55:15,811 INFO  [c.c.u.d.T.Transaction] (main:null) (logid:) 
Using the following URI to connect to cloud database 
[jdbc:mysql://localhost:3306/cloud?autoReconnect=true&prepStmtCacheSize=517&cachePrepStmts=true&sessionVariables=sql_mode='STRICT_TRANS_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,NO_ENGINE_SUBSTITUTION'&serverTimezone=UTC].
2024-02-10 15:55:19,952 ERROR [c.c.u.d.Merovingian2] (main:null) (logid:) 
Unable to get a new db connection
java.sql.SQLNonTransientConnectionException: Could not create connection to 
database server. Attempted reconnect 3 times. Giving up.
at 
com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:110)
at 
com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:97)
at 
com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:89)
at 
com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:63)
at 
com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:73)
at 
com.cloud.utils.db.TransactionLegacy.getStandaloneConnectionWithException(TransactionLegacy.java:212)
Caused by: com.mysql.cj.exceptions.SSLParamsException: Cannot open file:NONE 
[NONE (No such file or directory)]
Caused by: java.io.FileNotFoundException: NONE (No such file or directory)
2024-02-10 15:55:19,958 WARN  [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] 
(main:null) (logid:) Failed to start module [system] due to: [Error creating 
bean with name 'lockControllerListener' defined in URL 
[jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.19.0.0.jar!/META-INF/cloudstack/system/spring-server-system-context.xml]:
 Bean instantiation via constructor failed; nested exception is 
org.springframework.beans.BeanInstantiationException: Failed to instantiate 
[com.cloud.server.LockControllerListener]: Constructor threw exception; nested 
exception is com.cloud.utils.exception.CloudRuntimeException: Unable to 
initialize a connection to the database for locking purposes].
org.springframework.beans.factory.BeanCreationException: Error creating bean 
with name 'lockControllerListener' defined in URL 
[jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.19.0.0.jar!/META-INF/cloudstack/system/spring-server-system-context.xml]:
 Bean instantiation via constructor failed; nested exception is 
org.springframework.beans.BeanInstantiationException: Failed to instantiate 
[com.cloud.server.LockControllerListener]: Constructor threw exception; nested 
exception is com.cloud.utils.exception.CloudRun