On 25/9/20 16:12, Rene Peinthor wrote:
My last idea is that you didn't run with a linstor.toml file until now
and so user/password would have been empty.
You can comment out user/password in the linstor.toml and restart the
controller, if this doesn't work it is probably simpler to start fresh.
Interesting, you are correct, it works if I comment out the
username/password.
So, in order to try and get a more standard installation, I tried
connecting to the DB and running these commands:
SET PASSWORD='linstor';
ALTER USER "" rename to "linstor";
They seemed to work, but after resetting the linstor.toml file with the
user/pass, it wouldn't work, and I couldn't connect to the DB with the
linstor/linstor nor with the details as blanks.
So, for now, I've restored the DB, and commented out the user/pass from
the linstor.toml file.
Could you offer any advice on how to fix things so that it will use the
linstor/linstor credentials normally?
linstor n l
╭──────────────────────────────────────────────────────────╮
┊ Node ┊ NodeType ┊ Addresses ┊ State ┊
╞══════════════════════════════════════════════════════════╡
┊ castle ┊ SATELLITE ┊ 192.168.5.204:3366 (PLAIN) ┊ Online ┊
┊ san5 ┊ SATELLITE ┊ 192.168.5.205:3366 (PLAIN) ┊ Online ┊
┊ san6 ┊ SATELLITE ┊ 192.168.5.206:3366 (PLAIN) ┊ Online ┊
╰──────────────────────────────────────────────────────────╯
Regards,
Adam
You can delete the DB file and start over again, but your LV/ZFS
volumes will still be there.
Your data will still be replicated, but the Satellite will delete the
resource files once restarted.
Cheers,
Rene
On Thu, Sep 24, 2020 at 4:55 PM Adam Goryachev
<[email protected]
<mailto:[email protected]>> wrote:
On 24/9/20 23:48, Rene Peinthor wrote:
I can only recreate that error, if I actively change the password
in the linstor.toml to something incorrect.
I don't know how this would happen in normal operation, are you
sure you never had another password or changed the password?
if you can connect to the h2 database with the commandline tool,
you might be able to set a new password.
I tried this method:
castle:/usr/share/linstor-server/lib# java -cp h2*.jar
org.h2.tools.Shell
Welcome to H2 Shell 1.4.197 (2018-03-18)
Exit with Ctrl+C
[Enter] jdbc:h2:~/test
URL jdbc:h2:/var/lib/linstor/linstordb
[Enter] org.h2.Driver
Driver
[Enter]
User linstor
[Enter] Hide
Password linstor
SQL Exception: Wrong user name or password [28000-197]
However, it requires user/pass, which clearly is wrong....
Is there a method to confirm that the file is "valid" ? I seem to
have three versions of this file all identical content:
-rw-r--r-- 1 root root 376832 Sep 18 16:45 linstordb.mv.db
-rw-r--r-- 1 root root 376832 Sep 24 02:25
linstordb.mv.db-2020-09-24T02:25+10:00.bak
-rw-r--r-- 1 root root 376832 Sep 24 02:25 linstordb.mv.db.bak
Should I just delete the DB file and start again? Is this data
replicated to other nodes automatically?
Thanks,
Adam
Cheers,
Rene
On Thu, Sep 24, 2020 at 2:48 PM Adam Goryachev
<[email protected]
<mailto:[email protected]>> wrote:
On 24/9/20 22:42, Rene Peinthor wrote:
They are.
And how do you start the controller?
It should start automatically at boot from systemd, but I can
start it manually with:
systemctl restart linstor-controller
In case it is your next question, here is the content of
/etc/systemd/system/multi-user.target.wants/linstor-controller.service
[Unit]
Description=LINSTOR Controller Service
Wants=network-online.target
After=network-online.target
[Service]
Type=simple
ExecStart=/usr/share/linstor-server/bin/Controller
--logs=/var/log/linstor-controller
--config-directory=/etc/linstor
# if killed by signal 143 -> SIGTERM, 129 -> SIGHUP
SuccessExitStatus=0 143 129
User=root
PrivateTmp=yes
[Install]
WantedBy=multi-user.target
Regards,
Adam
On Thu, Sep 24, 2020 at 2:19 PM Adam Goryachev
<[email protected]
<mailto:[email protected]>> wrote:
On 24/9/20 15:30, Rene Peinthor wrote:
Sounds weird, I don't think we changed anything with
the database initialization.
Can you post your /etc/linstor/linstor.toml?
Cheers,
Rene
Hi, please see the contents below (I assume these are
default settings):
# Basic linstor configuration toml file
# For more options check documentation
[db]
user = "linstor"
password = "linstor"
connection_url = "jdbc:h2:/var/lib/linstor/linstordb"
Thanks,
Adam
On Wed, Sep 23, 2020 at 6:54 PM Adam Goryachev
<[email protected]
<mailto:[email protected]>> wrote:
Hi,
After upgrading on one of my test nodes I got some
errors, so I thought to upgrade the controller, and
now I am unable to start the controller.
Here is what I get in the system log:
Sep 24 02:33:40 castle systemd[1]: Started LINSTOR
Controller Service.
Sep 24 02:33:41 castle Controller[1093]: LINSTOR,
Module Controller
Sep 24 02:33:41 castle Controller[1093]:
Version: 1.9.0
(678acd24a8b9b73a735407cd79ca33a5e95eb2e2)
Sep 24 02:33:41 castle Controller[1093]: Build
time: 2020-09-23T10:27:49+00:00
Sep 24 02:33:41 castle Controller[1093]: Java
Version: 11
Sep 24 02:33:41 castle Controller[1093]: Java
VM: Debian, Version
11.0.8+10-post-Debian-1deb10u1
Sep 24 02:33:41 castle Controller[1093]: Operating
system: Linux, Version 4.19.0-10-amd64
Sep 24 02:33:41 castle Controller[1093]:
Environment: amd64, 2 processors, 1988 MiB
memory reserved for allocations
Sep 24 02:33:41 castle Controller[1093]: System
components initialization in progress
Sep 24 02:33:42 castle Controller[1093]:
02:33:42.355 [main] INFO LINSTOR/Controller -
SYSTEM - ErrorReporter DB version 1 found.
Sep 24 02:33:42 castle Controller[1093]:
02:33:42.359 [main] INFO LINSTOR/Controller -
SYSTEM - Log directory set to:
'/var/log/linstor-controller'
Sep 24 02:33:42 castle Controller[1093]:
02:33:42.410 [main] WARN io.sentry.dsn.Dsn - ***
Couldn't find a suitable DSN, Sentry operations
will do nothing! See documentation:
https://docs.sentry.io/clients/java/
<https://docs.sentry.io/clients/java/> ***
Sep 24 02:33:42 castle Controller[1093]:
02:33:42.434 [Main] INFO LINSTOR/Controller -
SYSTEM - Loading API classes started.
Sep 24 02:33:43 castle Controller[1093]:
02:33:43.046 [Main] INFO LINSTOR/Controller -
SYSTEM - API classes loading finished: 611ms
Sep 24 02:33:43 castle Controller[1093]:
02:33:43.047 [Main] INFO LINSTOR/Controller -
SYSTEM - Dependency injection started.
Sep 24 02:33:43 castle Controller[1093]:
02:33:43.065 [Main] INFO LINSTOR/Controller -
SYSTEM - Attempting dynamic load of extension
module
"com.linbit.linstor.spacetracking.ControllerSpaceTrackingModule"
Sep 24 02:33:43 castle Controller[1093]:
02:33:43.065 [Main] INFO LINSTOR/Controller -
SYSTEM - Extension module
"com.linbit.linstor.spacetracking.ControllerSpaceTrackingModule"
is not installed
Sep 24 02:33:43 castle Controller[1093]: WARNING:
An illegal reflective access operation has occurred
Sep 24 02:33:43 castle Controller[1093]: WARNING:
Illegal reflective access by
com.google.inject.internal.cglib.core.$ReflectUtils$1
(file:/usr/share/linstor-server/lib/guice-4.2.2.jar)
to method
java.lang.ClassLoader.defineClass(java.lang.String,byte[],int,int,java.security.ProtectionDomain)
Sep 24 02:33:43 castle Controller[1093]: WARNING:
Please consider reporting this to the maintainers
of
com.google.inject.internal.cglib.core.$ReflectUtils$1
Sep 24 02:33:43 castle Controller[1093]: WARNING:
Use --illegal-access=warn to enable warnings of
further illegal reflective access operations
Sep 24 02:33:43 castle Controller[1093]: WARNING:
All illegal access operations will be denied in a
future release
Sep 24 02:33:44 castle Controller[1093]:
02:33:44.962 [Main] INFO LINSTOR/Controller -
SYSTEM - Dependency injection finished: 1915ms
Sep 24 02:33:45 castle Controller[1093]:
02:33:45.533 [Main] INFO LINSTOR/Controller -
SYSTEM - Initializing authentication subsystem
Sep 24 02:33:45 castle Controller[1093]:
02:33:45.736 [Main] INFO LINSTOR/Controller -
SYSTEM - Starting service instance
'TimerEventService' of type TimerEventService
Sep 24 02:33:45 castle Controller[1093]:
02:33:45.740 [Main] INFO LINSTOR/Controller -
SYSTEM - Initializing the database connection pool
Sep 24 02:33:46 castle Controller[1093]:
02:33:46.303 [Main] ERROR LINSTOR/Controller -
SYSTEM - Database initialization error [Report
number 5F6B78E5-00000-000000]
Sep 24 02:33:46 castle Controller[1093]:
02:33:46.343 [Thread-2] INFO LINSTOR/Controller -
SYSTEM - Shutdown in progress
Sep 24 02:33:46 castle Controller[1093]:
02:33:46.344 [Thread-2] INFO LINSTOR/Controller -
SYSTEM - Shutting down service instance
'TaskScheduleService' of type TaskScheduleService
Sep 24 02:33:46 castle Controller[1093]:
02:33:46.345 [Thread-2] INFO LINSTOR/Controller -
SYSTEM - Waiting for service instance
'TaskScheduleService' to complete shutdown
Sep 24 02:33:46 castle Controller[1093]:
02:33:46.345 [Thread-2] INFO LINSTOR/Controller -
SYSTEM - Shutting down service instance
'DatabaseService' of type DatabaseService
Sep 24 02:33:46 castle Controller[1093]:
02:33:46.349 [Thread-2] INFO LINSTOR/Controller -
SYSTEM - Waiting for service instance
'DatabaseService' to complete shutdown
Sep 24 02:33:46 castle Controller[1093]:
02:33:46.350 [Thread-2] INFO LINSTOR/Controller -
SYSTEM - Shutting down service instance
'TimerEventService' of type TimerEventService
Sep 24 02:33:46 castle Controller[1093]:
02:33:46.351 [Thread-2] INFO LINSTOR/Controller -
SYSTEM - Waiting for service instance
'TimerEventService' to complete shutdown
Sep 24 02:33:46 castle Controller[1093]:
02:33:46.351 [Thread-2] INFO LINSTOR/Controller -
SYSTEM - Shutdown complete
Sep 24 02:33:46 castle systemd[1]:
linstor-controller.service: Main process exited,
code=exited, status=20/n/a
Sep 24 02:33:46 castle systemd[1]:
linstor-controller.service: Failed with result
'exit-code'.
Here is
/var/log/linstor-controller/ErrorReport-5F6B78E5-00000-000000.log
ERROR REPORT 5F6B78E5-00000-000000
============================================================
Application: LINBIT® LINSTOR
Module: Controller
Version: 1.9.0
Build ID: 678acd24a8b9b73a735407cd79ca33a5e95eb2e2
Build time: 2020-09-23T10:27:49+00:00
Error time: 2020-09-24 02:33:46
Node: castle
============================================================
Reported error:
===============
Description:
Database initialization error
Category: LinStorException
Class name: SystemServiceStartException
Class canonical name:
com.linbit.SystemServiceStartException
Generated at: Method
'initialize', Source file
'DbConnectionPoolInitializer.java', Line #56
Error message: Database initialization error
Call backtrace:
Method Native Class:Line number
initialize N
com.linbit.linstor.dbcp.DbConnectionPoolInitializer:56
startSystemServices N
com.linbit.linstor.core.ApplicationLifecycleManager:87
start N com.linbit.linstor.core.Controller:337
main N com.linbit.linstor.core.Controller:556
Caused by:
==========
Category: RuntimeException
Class name: LinStorDBRuntimeException
Class canonical name:
com.linbit.linstor.LinStorDBRuntimeException
Generated at: Method
'setTransactionIsolation', Source file
'DbConnectionPool.java', Line #485
Error message: Failed to set transaction isolation
Call backtrace:
Method Native Class:Line number
setTransactionIsolation N
com.linbit.linstor.dbcp.DbConnectionPool:485
migrate N com.linbit.linstor.dbcp.DbConnectionPool:202
initialize N
com.linbit.linstor.dbcp.DbConnectionPoolInitializer:50
startSystemServices N
com.linbit.linstor.core.ApplicationLifecycleManager:87
start N com.linbit.linstor.core.Controller:337
main N com.linbit.linstor.core.Controller:556
Caused by:
==========
Category: Exception
Class name: JdbcSQLException
Class canonical name: org.h2.jdbc.JdbcSQLException
Generated at: Method
'getJdbcSQLException', Source file
'DbException.java', Line #357
Error message: Wrong user name or password [28000-197]
Call backtrace:
Method Native Class:Line number
getJdbcSQLException N org.h2.message.DbException:357
get N org.h2.message.DbException:179
get N org.h2.message.DbException:155
get N org.h2.message.DbException:144
validateUserAndPassword N org.h2.engine.Engine:341
createSessionAndValidate N
org.h2.engine.Engine:165
createSession N org.h2.engine.Engine:140
createSession N org.h2.engine.Engine:28
connectEmbeddedOrServer N
org.h2.engine.SessionRemote:351
<init> N org.h2.jdbc.JdbcConnection:124
<init> N org.h2.jdbc.JdbcConnection:103
connect N org.h2.Driver:69
getConnection N java.sql.DriverManager:677
getConnection N java.sql.DriverManager:189
createConnection N
org.apache.commons.dbcp2.DriverManagerConnectionFactory:123
makeObject N
org.apache.commons.dbcp2.PoolableConnectionFactory:355
create N
org.apache.commons.pool2.impl.GenericObjectPool:889
borrowObject N
org.apache.commons.pool2.impl.GenericObjectPool:424
borrowObject N
org.apache.commons.pool2.impl.GenericObjectPool:349
getConnection N
org.apache.commons.dbcp2.PoolingDataSource:134
setTransactionIsolation N
com.linbit.linstor.dbcp.DbConnectionPool:477
migrate N com.linbit.linstor.dbcp.DbConnectionPool:202
initialize N
com.linbit.linstor.dbcp.DbConnectionPoolInitializer:50
startSystemServices N
com.linbit.linstor.core.ApplicationLifecycleManager:87
start N com.linbit.linstor.core.Controller:337
main N com.linbit.linstor.core.Controller:556
Finally I found another log in
/var/lib/linstor/linstordb.trace.db
2020-09-24 02:33:45 database: wrong user or
password; user: "LINSTOR"
org.h2.message.DbException: Wrong user name or
password [28000-197]
at
org.h2.message.DbException.get(DbException.java:179)
at
org.h2.message.DbException.get(DbException.java:155)
at
org.h2.message.DbException.get(DbException.java:144)
at
org.h2.engine.Engine.openSession(Engine.java:107)
at
org.h2.engine.Engine.openSession(Engine.java:179)
at
org.h2.engine.Engine.createSessionAndValidate(Engine.java:157)
at
org.h2.engine.Engine.createSession(Engine.java:140)
at
org.h2.engine.Engine.createSession(Engine.java:28)
at
org.h2.engine.SessionRemote.connectEmbeddedOrServer(SessionRemote.java:351)
at
org.h2.jdbc.JdbcConnection.<init>(JdbcConnection.java:124)
at
org.h2.jdbc.JdbcConnection.<init>(JdbcConnection.java:103)
at org.h2.Driver.connect(Driver.java:69)
at
java.sql/java.sql.DriverManager.getConnection(DriverManager.java:677)
at
java.sql/java.sql.DriverManager.getConnection(DriverManager.java:189)
at
org.apache.commons.dbcp2.DriverManagerConnectionFactory.createConnection(DriverManagerConnectionFactory.java:123)
at
org.apache.commons.dbcp2.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:355)
at
org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:889)
at
org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:424)
at
org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:349)
at
org.apache.commons.dbcp2.PoolingDataSource.getConnection(PoolingDataSource.java:134)
at
com.linbit.linstor.dbcp.DbConnectionPool.setTransactionIsolation(DbConnectionPool.java:477)
at
com.linbit.linstor.dbcp.DbConnectionPool.migrate(DbConnectionPool.java:202)
at
com.linbit.linstor.dbcp.DbConnectionPoolInitializer.initialize(DbConnectionPoolInitializer.java:50)
at
com.linbit.linstor.core.ApplicationLifecycleManager.startSystemServices(ApplicationLifecycleManager.java:87)
at
com.linbit.linstor.core.Controller.start(Controller.java:337)
at
com.linbit.linstor.core.Controller.main(Controller.java:556)
Caused by: org.h2.jdbc.JdbcSQLException: Wrong user
name or password [28000-197]
at
org.h2.message.DbException.getJdbcSQLException(DbException.java:357)
... 26 more
Luckily, this is just a test environment, but I'd
like to know if I messed up in my upgrade process
somehow or this is a bug in the new version. I
haven't downgraded or anything yet.
Regards,
Adam
On 23/9/20 22:31, Rene Peinthor wrote:
Hi!
Here is a new minor Linstor release, this release
contains more bug fixes than new features.
Notable features are a new auto-unplace option, to
reduce the replica-count of resources
to the value set in the resource-group after a
certain time. And error-reports can now be deleted
from the REST-API (client).
linstor-server 1.9.0
--------------------
* Added auto-"unplace", automatically removes
resources if they exceed the replica count if
`DrbdOptions/auto-unplace` is set
* Added error-report deletion API
* Expose DRBD promotion_score and may_promote via
REST-API and server sent events
* Prometheus metrics are now mostly cached and
much faster to query
* Send SD_NOTIFY READY to systemd if services are
ready
* OpenFlex resource are now correctly limited to
32 characters
* Fix etcd modify net-interface (incorrect
serialization)
* Fix autoplacer also toggling diskless resources
* Fix snapshot-shipping with more than 1 volume
definitions
* Fix zfs create options handling
* Fixed recaching of lvm-filter
* Fix missing client answer if drbd device
doesn't become ready in reasonable time
* REST-API v1.4.0
https://www.linbit.com/downloads/linstor/linstor-server-1.9.0.tar.gz
<https://www.linbit.com/downloads/linstor/linstor-server-1.9.0.tar.gz>
Linstor PPA:
https://launchpad.net/~linbit/+archive/ubuntu/linbit-drbd9-stack
<https://launchpad.net/~linbit/+archive/ubuntu/linbit-drbd9-stack>
Cheers,
Rene
_______________________________________________
Star us on GITHUB:https://github.com/LINBIT
<https://github.com/LINBIT>
drbd-user mailing list
[email protected] <mailto:[email protected]>
https://lists.linbit.com/mailman/listinfo/drbd-user
<https://lists.linbit.com/mailman/listinfo/drbd-user>
_______________________________________________
Star us on GITHUB: https://github.com/LINBIT
<https://github.com/LINBIT>
drbd-user mailing list
[email protected]
<mailto:[email protected]>
https://lists.linbit.com/mailman/listinfo/drbd-user
<https://lists.linbit.com/mailman/listinfo/drbd-user>
_______________________________________________
Star us on GITHUB: https://github.com/LINBIT
drbd-user mailing list
[email protected]
https://lists.linbit.com/mailman/listinfo/drbd-user
