Hi,
Thank you all for your replies.
Below, the error reports:
I missed to say that zern1 uses protocol A, I did set up it with
drbdmanage sites, but I think it's not relevant because errors are on
all nodes
root@pve211:~# linstor error-reports list
┊ 1 ┊ 5C3B5BC3-00000-000000 ┊ 2019-01-13 16:46:24 ┊ Controller ┊
┊ 2 ┊ 5C3B5BC3-00000-000001 ┊ 2019-01-13 16:46:24 ┊ Controller ┊
┊ 3 ┊ 5C3B5BC3-00000-000002 ┊ 2019-01-13 16:46:26 ┊ Controller ┊
┊ 4 ┊ 5C3B5BC3-00000-000003 ┊ 2019-01-13 16:46:27 ┊ Controller ┊
┊ 5 ┊ 5C3B5BC3-00000-000004 ┊ 2019-01-13 16:46:27 ┊ Controller ┊
┊ 6 ┊ 5C3B5BC3-00000-000005 ┊ 2019-01-13 16:46:27 ┊ Controller ┊
┊ 7 ┊ 5C3B5BC3-00000-000006 ┊ 2019-01-13 16:46:28 ┊ Controller ┊
┊ 8 ┊ 5C3B5BC3-00000-000007 ┊ 2019-01-13 16:46:28 ┊ Controller ┊
┊ 9 ┊ 5C3B5BC3-00000-000008 ┊ 2019-01-13 16:46:28 ┊ Controller ┊
root@pve211:~# linstor error-reports s 5C3B5BC3-00000-000000
ERROR REPORT 5C3B5BC3-00000-000000
============================================================
Application: LINBIT® LINSTOR
Module: Controller
Version: 0.7.5
Build ID: d74305b420fdc878182afa162378a317e6a4a3b9
Build time: 2018-12-21T08:28:19+00:00
Error time: 2019-01-13 16:46:24
Node: pve211
Peer: 127.0.0.1:56966
============================================================
Reported error:
===============
Category: RuntimeException
Class name: ApiRcException
Class canonical name:
com.linbit.linstor.core.apicallhandler.response.ApiRcException
Generated at: Method 'loadRscDfn', Source file
'CtrlApiDataLoader.java', Line #130
Error message: Resource definition 'vm-108-disk-1'
not found.
Error context:
Resource definition 'vm-108-disk-1' not found.
Call backtrace:
Method Native Class:Line number
loadRscDfn N
com.linbit.linstor.core.apicallhandler.controller.CtrlApiDataLoader:130
loadRscDfn N
com.linbit.linstor.core.apicallhandler.controller.CtrlApiDataLoader:104
createVolumeDefinitions N
com.linbit.linstor.core.apicallhandler.controller.CtrlVlmDfnApiCallHandler:128
createVlmDfns N
com.linbit.linstor.core.apicallhandler.controller.CtrlApiCallHandler:324
execute N
com.linbit.linstor.api.protobuf.controller.CreateVolumeDefinition:50
executeNonReactive N
com.linbit.linstor.proto.CommonMessageProcessor:520
lambda$execute$13 N
com.linbit.linstor.proto.CommonMessageProcessor:496
doInScope N
com.linbit.linstor.core.apicallhandler.ScopeRunner:141
lambda$null$0 N
com.linbit.linstor.core.apicallhandler.ScopeRunner:71
call N
reactor.core.publisher.MonoCallable:92
trySubscribeScalarMap N
reactor.core.publisher.FluxFlatMap:126
subscribe N
reactor.core.publisher.MonoFlatMapMany:46
subscribe N
reactor.core.publisher.Flux:6877
onNext N
reactor.core.publisher.MonoFlatMapMany$FlatMapManyMain:184
request N
reactor.core.publisher.Operators$ScalarSubscription:1640
onSubscribe N
reactor.core.publisher.MonoFlatMapMany$FlatMapManyMain:131
subscribe N
reactor.core.publisher.MonoCurrentContext:35
subscribe N
reactor.core.publisher.MonoFlatMapMany:49
subscribe N
reactor.core.publisher.FluxOnAssembly:252
subscribe N
reactor.core.publisher.FluxOnAssembly:252
subscribe N
reactor.core.publisher.FluxOnErrorResume:47
subscribe N
reactor.core.publisher.FluxOnErrorResume:47
subscribe N
reactor.core.publisher.FluxOnErrorResume:47
subscribe N
reactor.core.publisher.FluxOnErrorResume:47
subscribe N
reactor.core.publisher.FluxContextStart:49
subscribe N
reactor.core.publisher.Flux:6877
onNext N
reactor.core.publisher.FluxFlatMap$FlatMapMain:372
slowPath N
reactor.core.publisher.FluxArray$ArraySubscription:126
request N
reactor.core.publisher.FluxArray$ArraySubscription:99
onSubscribe N
reactor.core.publisher.FluxFlatMap$FlatMapMain:332
subscribe N
reactor.core.publisher.FluxMerge:70
subscribe N
reactor.core.publisher.FluxOnErrorResume:47
subscribe N
reactor.core.publisher.Flux:6877
onComplete N
reactor.core.publisher.FluxConcatArray$ConcatArraySubscriber:208
subscribe N
reactor.core.publisher.FluxConcatArray:81
subscribe N
reactor.core.publisher.FluxPeek:83
subscribe N
reactor.core.publisher.FluxPeek:83
subscribe N
reactor.core.publisher.FluxPeek:83
subscribe N
reactor.core.publisher.FluxOnErrorResume:47
subscribe N
reactor.core.publisher.FluxDefer:55
subscribe N
reactor.core.publisher.Flux:6877
onNext N
reactor.core.publisher.FluxFlatMap$FlatMapMain:372
drainAsync N
reactor.core.publisher.FluxFlattenIterable$FlattenIterableSubscriber:391
drain N
reactor.core.publisher.FluxFlattenIterable$FlattenIterableSubscriber:633
onNext N
reactor.core.publisher.FluxFlattenIterable$FlattenIterableSubscriber:238
drainFused N
reactor.core.publisher.UnicastProcessor:234
drain N
reactor.core.publisher.UnicastProcessor:267
onNext N
reactor.core.publisher.UnicastProcessor:343
next N
reactor.core.publisher.FluxCreate$IgnoreSink:573
next N
reactor.core.publisher.FluxCreate$SerializedSink:151
processInOrder N
com.linbit.linstor.netcom.TcpConnectorPeer:361
doProcessMessage N
com.linbit.linstor.proto.CommonMessageProcessor:215
lambda$processMessage$2 N
com.linbit.linstor.proto.CommonMessageProcessor:161
onNext N
reactor.core.publisher.FluxPeek$PeekSubscriber:177
runAsync N
reactor.core.publisher.FluxPublishOn$PublishOnSubscriber:396
run N
reactor.core.publisher.FluxPublishOn$PublishOnSubscriber:480
call N
reactor.core.scheduler.WorkerTask:84
call N
reactor.core.scheduler.WorkerTask:37
run N
java.util.concurrent.FutureTask:266
access$201 N
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask:180
run N
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask:293
runWorker N
java.util.concurrent.ThreadPoolExecutor:1149
run N
java.util.concurrent.ThreadPoolExecutor$Worker:624
run N java.lang.Thread:748
END OF ERROR REPORT.
5C3B5BC3-00000-000002
Category: RuntimeException
Class name: ApiRcException
Class canonical name:
com.linbit.linstor.core.apicallhandler.response.ApiRcException
Generated at: Method 'loadRscDfn', Source file
'CtrlApiDataLoader.java', Line #130
Error message: Resource definition 'vm-102-disk-1'
not found.
Error context:
Resource definition 'vm-102-disk-1' not found.
Others are pretty the same...
root@pve211:~# journalctl -u linstor-satellite
-- Logs begin at Sun 2019-01-13 15:32:33 CET, end at Wed 2019-01-16
12:22:00 CET. --
Jan 13 16:20:06 pve211 systemd[1]: Started LINSTOR Satellite Service.
Jan 13 16:20:07 pve211 Satellite[13805]: LINSTOR, Module Satellite
Jan 13 16:20:07 pve211 Satellite[13805]: Version: 0.7.5
(d74305b420fdc878182afa162378a317e6a4a3b9)
Jan 13 16:20:07 pve211 Satellite[13805]: Build time:
2018-12-21T08:28:19+00:00
Jan 13 16:20:07 pve211 Satellite[13805]: Java Version: 1.8
Jan 13 16:20:07 pve211 Satellite[13805]: Java VM: Oracle Corporation,
Version 25.181-b13
Jan 13 16:20:07 pve211 Satellite[13805]: Operating system: Linux,
Version 4.13.13-6-pve
Jan 13 16:20:07 pve211 Satellite[13805]: Environment: amd64, 8
processors, 7138 MiB memory reserved for allocations
Jan 13 16:20:07 pve211 Satellite[13805]: System components
initialization in progress
Jan 13 16:20:07 pve211 Satellite[13805]: 16:20:07.527 [main] INFO
LINSTOR/Satellite - Log directory set to: '/var/log/linstor-satellite'
Jan 13 16:20:07 pve211 Satellite[13805]: 16:20:07.529 [Main] INFO
LINSTOR/Satellite - Loading API classes started.
Jan 13 16:20:07 pve211 Satellite[13805]: 16:20:07.793 [Main] INFO
LINSTOR/Satellite - API classes loading finished: 263ms
Jan 13 16:20:07 pve211 Satellite[13805]: 16:20:07.793 [Main] INFO
LINSTOR/Satellite - Dependency injection started.
Jan 13 16:20:08 pve211 Satellite[13805]: 16:20:08.626 [Main] INFO
LINSTOR/Satellite - Dependency injection finished: 832ms
Jan 13 16:20:08 pve211 Satellite[13805]: 16:20:08.801 [Main] INFO
LINSTOR/Satellite - Removing all res files from /var/lib/linstor.d
Jan 13 16:20:08 pve211 Satellite[13805]: 16:20:08.805 [Main] INFO
LINSTOR/Satellite - Starting service instance 'DeviceManager' of type
DeviceManager
Jan 13 16:20:08 pve211 Satellite[13805]: 16:20:08.806 [Main] INFO
LINSTOR/Satellite - Starting service instance 'DrbdEventPublisher-1' of
type DrbdEventPublish
Jan 13 16:20:08 pve211 Satellite[13805]: 16:20:08.806 [Main] INFO
LINSTOR/Satellite - Starting service instance 'DrbdEventService-1' of
type DrbdEventService
Jan 13 16:20:08 pve211 Satellite[13805]: 16:20:08.808 [Main] INFO
LINSTOR/Satellite - Starting service instance 'FileEventService' of type
FileEventService
Jan 13 16:20:08 pve211 Satellite[13805]: 16:20:08.808 [Main] INFO
LINSTOR/Satellite - Starting service instance 'TimerEventService' of
type TimerEventService
Jan 13 16:20:08 pve211 Satellite[13805]: 16:20:08.808 [Main] INFO
LINSTOR/Satellite - Initializing main network communications service
Jan 13 16:20:08 pve211 Satellite[13805]: 16:20:08.820 [Main] INFO
LINSTOR/Satellite - NetComService started on port /0:0:0:0:0:0:0:0:3366
Jan 13 16:40:31 pve211 Satellite[13805]: 16:40:31.727 [MainWorkerPool-1]
INFO LINSTOR/Satellite - Controller connected and authenticated
(10.12.150.1:55252)
Jan 13 16:40:31 pve211 Satellite[13805]: 16:40:31.757 [MainWorkerPool-2]
INFO LINSTOR/Satellite - Node 'pve211' created.
Jan 13 16:40:31 pve211 Satellite[13805]: 16:40:31.767 [MainWorkerPool-2]
INFO LINSTOR/Satellite - Storage pool 'DfltDisklessStorPool' created.
Jan 13 16:40:33 pve211 Satellite[13805]: 16:40:33.786 [MainWorkerPool-4]
INFO LINSTOR/Satellite - Storage pool 'drbdpool' created.
Jan 13 17:02:07 pve211 Satellite[13805]: 17:02:07.360 [MainWorkerPool-6]
INFO LINSTOR/Satellite - Resource 'vm-108-disk-1' created for node
'pve211'.
Jan 13 17:02:07 pve211 Satellite[13805]: 17:02:07.715 [MainWorkerPool-8]
INFO LINSTOR/Satellite - Resource 'vm-108-disk-1' updated for node
'pve211'.
root@pve212:~# journalctl -u linstor-satellite
-- Logs begin at Sun 2019-01-13 15:34:23 CET, end at Wed 2019-01-16
12:23:04 CET. --
Jan 13 16:24:25 pve212 systemd[1]: Started LINSTOR Satellite Service.
Jan 13 16:24:26 pve212 Satellite[15540]: LINSTOR, Module Satellite
Jan 13 16:24:26 pve212 Satellite[15540]: Version: 0.7.5
(d74305b420fdc878182afa162378a317e6a4a3b9)
Jan 13 16:24:26 pve212 Satellite[15540]: Build time:
2018-12-21T08:28:19+00:00
Jan 13 16:24:26 pve212 Satellite[15540]: Java Version: 1.8
Jan 13 16:24:26 pve212 Satellite[15540]: Java VM: Oracle Corporation,
Version 25.181-b13
Jan 13 16:24:26 pve212 Satellite[15540]: Operating system: Linux,
Version 4.13.13-6-pve
Jan 13 16:24:26 pve212 Satellite[15540]: Environment: amd64, 8
processors, 7138 MiB memory reserved for allocations
Jan 13 16:24:26 pve212 Satellite[15540]: System components
initialization in progress
Jan 13 16:24:26 pve212 Satellite[15540]: 16:24:26.353 [main] INFO
LINSTOR/Satellite - Log directory set to: '/var/log/linstor-satellite'
Jan 13 16:24:26 pve212 Satellite[15540]: 16:24:26.355 [Main] INFO
LINSTOR/Satellite - Loading API classes started.
Jan 13 16:24:26 pve212 Satellite[15540]: 16:24:26.630 [Main] INFO
LINSTOR/Satellite - API classes loading finished: 275ms
Jan 13 16:24:26 pve212 Satellite[15540]: 16:24:26.630 [Main] INFO
LINSTOR/Satellite - Dependency injection started.
Jan 13 16:24:27 pve212 Satellite[15540]: 16:24:27.458 [Main] INFO
LINSTOR/Satellite - Dependency injection finished: 828ms
Jan 13 16:24:27 pve212 Satellite[15540]: 16:24:27.639 [Main] INFO
LINSTOR/Satellite - Removing all res files from /var/lib/linstor.d
Jan 13 16:24:27 pve212 Satellite[15540]: 16:24:27.642 [Main] INFO
LINSTOR/Satellite - Starting service instance 'DeviceManager' of type
DeviceManager
Jan 13 16:24:27 pve212 Satellite[15540]: 16:24:27.643 [Main] INFO
LINSTOR/Satellite - Starting service instance 'DrbdEventPublisher-1' of
type DrbdEventPublisher
Jan 13 16:24:27 pve212 Satellite[15540]: 16:24:27.643 [Main] INFO
LINSTOR/Satellite - Starting service instance 'DrbdEventService-1' of
type DrbdEventService
Jan 13 16:24:27 pve212 Satellite[15540]: 16:24:27.645 [Main] INFO
LINSTOR/Satellite - Starting service instance 'FileEventService' of type
FileEventService
Jan 13 16:24:27 pve212 Satellite[15540]: 16:24:27.645 [Main] INFO
LINSTOR/Satellite - Starting service instance 'TimerEventService' of
type TimerEventService
Jan 13 16:24:27 pve212 Satellite[15540]: 16:24:27.645 [Main] INFO
LINSTOR/Satellite - Initializing main network communications service
Jan 13 16:24:27 pve212 Satellite[15540]: 16:24:27.657 [Main] INFO
LINSTOR/Satellite - NetComService started on port /0:0:0:0:0:0:0:0:3366
Jan 13 16:42:17 pve212 Satellite[15540]: 16:42:17.206 [MainWorkerPool-1]
INFO LINSTOR/Satellite - Controller connected and authenticated
(10.12.150.1:51862)
Jan 13 16:42:17 pve212 Satellite[15540]: 16:42:17.274 [MainWorkerPool-2]
INFO LINSTOR/Satellite - Node 'pve212' created.
Jan 13 16:42:17 pve212 Satellite[15540]: 16:42:17.285 [MainWorkerPool-2]
INFO LINSTOR/Satellite - Storage pool 'DfltDisklessStorPool' created.
Jan 13 16:42:19 pve212 Satellite[15540]: 16:42:19.085 [MainWorkerPool-4]
INFO LINSTOR/Satellite - Storage pool 'drbdpool' created.
Jan 13 16:42:23 pve212 Satellite[15540]: 16:42:23.522 [MainWorkerPool-6]
INFO LINSTOR/Satellite - Resource 'vm-101-disk-1' created for node
'pve212'.
Jan 13 16:42:24 pve212 Satellite[15540]: 16:42:24.059 [MainWorkerPool-8]
INFO LINSTOR/Satellite - Resource 'vm-101-disk-1' updated for node
'pve212'.
Jan 13 16:47:25 pve212 Satellite[15540]: 16:47:25.530 [MainWorkerPool-2]
INFO LINSTOR/Satellite - Resource 'vm-101-disk-1' created for node
'pve213'.
Jan 13 16:47:25 pve212 Satellite[15540]: 16:47:25.530 [MainWorkerPool-2]
INFO LINSTOR/Satellite - Resource 'vm-101-disk-1' updated for node
'pve212'.
Jan 13 16:48:09 pve212 Satellite[15540]: 16:48:09.210 [MainWorkerPool-4]
INFO LINSTOR/Satellite - Resource 'vm-101-disk-1' created for node 'zern1'.
Jan 13 16:48:09 pve212 Satellite[15540]: 16:48:09.210 [MainWorkerPool-4]
INFO LINSTOR/Satellite - Resource 'vm-101-disk-1' updated for node
'pve212'.
Jan 13 16:48:09 pve212 Satellite[15540]: 16:48:09.210 [MainWorkerPool-4]
INFO LINSTOR/Satellite - Resource 'vm-101-disk-1' updated for node
'pve213'.
Jan 13 17:14:23 pve212 Satellite[15540]: 17:14:23.765 [MainWorkerPool-6]
INFO LINSTOR/Satellite - Resource 'vm-202-disk-1' created for node
'pve212'.
Jan 13 17:14:24 pve212 Satellite[15540]: 17:14:24.280 [MainWorkerPool-8]
INFO LINSTOR/Satellite - Resource 'vm-202-disk-1' updated for node
'pve212'.
Jan 13 17:20:09 pve212 Satellite[15540]: 17:20:09.412 [MainWorkerPool-2]
INFO LINSTOR/Satellite - Resource 'vm-102-disk-1' created for node
'pve212'.
Jan 13 17:20:09 pve212 Satellite[15540]: 17:20:09.877 [MainWorkerPool-4]
INFO LINSTOR/Satellite - Resource 'vm-102-disk-1' updated for node
'pve212'.
Jan 13 17:25:17 pve212 Satellite[15540]: 17:25:17.380 [MainWorkerPool-6]
INFO LINSTOR/Satellite - Resource 'vm-102-disk-1' created for node
'pve213'.
Jan 13 17:25:17 pve212 Satellite[15540]: 17:25:17.380 [MainWorkerPool-6]
INFO LINSTOR/Satellite - Resource 'vm-102-disk-1' updated for node
'pve212'.
root@pve213:~# journalctl -u linstor-satellite
-- Logs begin at Sun 2019-01-13 15:36:06 CET, end at Wed 2019-01-16
12:23:38 CET. --
Jan 13 16:26:09 pve213 systemd[1]: Started LINSTOR Satellite Service.
Jan 13 16:26:09 pve213 Satellite[14120]: LINSTOR, Module Satellite
Jan 13 16:26:09 pve213 Satellite[14120]: Version: 0.7.5
(d74305b420fdc878182afa162378a317e6a4a3b9)
Jan 13 16:26:09 pve213 Satellite[14120]: Build time:
2018-12-21T08:28:19+00:00
Jan 13 16:26:09 pve213 Satellite[14120]: Java Version: 1.8
Jan 13 16:26:09 pve213 Satellite[14120]: Java VM: Oracle Corporation,
Version 25.181-b13
Jan 13 16:26:09 pve213 Satellite[14120]: Operating system: Linux,
Version 4.13.13-6-pve
Jan 13 16:26:09 pve213 Satellite[14120]: Environment: amd64, 8
processors, 7138 MiB memory reserved for allocations
Jan 13 16:26:09 pve213 Satellite[14120]: System components
initialization in progress
Jan 13 16:26:10 pve213 Satellite[14120]: 16:26:10.020 [main] INFO
LINSTOR/Satellite - Log directory set to: '/var/log/linstor-satellite'
Jan 13 16:26:10 pve213 Satellite[14120]: 16:26:10.022 [Main] INFO
LINSTOR/Satellite - Loading API classes started.
Jan 13 16:26:10 pve213 Satellite[14120]: 16:26:10.277 [Main] INFO
LINSTOR/Satellite - API classes loading finished: 254ms
Jan 13 16:26:10 pve213 Satellite[14120]: 16:26:10.277 [Main] INFO
LINSTOR/Satellite - Dependency injection started.
Jan 13 16:26:11 pve213 Satellite[14120]: 16:26:11.032 [Main] INFO
LINSTOR/Satellite - Dependency injection finished: 755ms
Jan 13 16:26:11 pve213 Satellite[14120]: 16:26:11.208 [Main] INFO
LINSTOR/Satellite - Removing all res files from /var/lib/linstor.d
Jan 13 16:26:11 pve213 Satellite[14120]: 16:26:11.212 [Main] INFO
LINSTOR/Satellite - Starting service instance 'DeviceManager' of type
DeviceManager
Jan 13 16:26:11 pve213 Satellite[14120]: 16:26:11.212 [Main] INFO
LINSTOR/Satellite - Starting service instance 'DrbdEventPublisher-1' of
type DrbdEventPublisher
Jan 13 16:26:11 pve213 Satellite[14120]: 16:26:11.213 [Main] INFO
LINSTOR/Satellite - Starting service instance 'DrbdEventService-1' of
type DrbdEventService
Jan 13 16:26:11 pve213 Satellite[14120]: 16:26:11.214 [Main] INFO
LINSTOR/Satellite - Starting service instance 'FileEventService' of type
FileEventService
Jan 13 16:26:11 pve213 Satellite[14120]: 16:26:11.215 [Main] INFO
LINSTOR/Satellite - Starting service instance 'TimerEventService' of
type TimerEventService
Jan 13 16:26:11 pve213 Satellite[14120]: 16:26:11.215 [Main] INFO
LINSTOR/Satellite - Initializing main network communications service
Jan 13 16:26:11 pve213 Satellite[14120]: 16:26:11.227 [Main] INFO
LINSTOR/Satellite - NetComService started on port /0:0:0:0:0:0:0:0:3366
Jan 13 16:43:58 pve213 Satellite[14120]: 16:43:58.127 [MainWorkerPool-1]
INFO LINSTOR/Satellite - Controller connected and authenticated
(10.12.150.1:33896)
Jan 13 16:43:58 pve213 Satellite[14120]: 16:43:58.159 [MainWorkerPool-2]
INFO LINSTOR/Satellite - Node 'pve213' created.
Jan 13 16:43:58 pve213 Satellite[14120]: 16:43:58.168 [MainWorkerPool-2]
INFO LINSTOR/Satellite - Storage pool 'DfltDisklessStorPool' created.
Jan 13 16:44:00 pve213 Satellite[14120]: 16:44:00.096 [MainWorkerPool-4]
INFO LINSTOR/Satellite - Storage pool 'drbdpool' created.
Jan 13 16:49:06 pve213 Satellite[14120]: 16:49:06.059 [MainWorkerPool-6]
INFO LINSTOR/Satellite - Resource 'vm-101-disk-1' created for node
'pve212'.
Jan 13 16:49:06 pve213 Satellite[14120]: 16:49:06.059 [MainWorkerPool-6]
INFO LINSTOR/Satellite - Resource 'vm-101-disk-1' created for node
'pve213'.
Jan 13 16:49:49 pve213 Satellite[14120]: 16:49:49.729 [MainWorkerPool-8]
INFO LINSTOR/Satellite - Resource 'vm-101-disk-1' created for node 'zern1'.
Jan 13 16:49:49 pve213 Satellite[14120]: 16:49:49.730 [MainWorkerPool-8]
INFO LINSTOR/Satellite - Resource 'vm-101-disk-1' updated for node
'pve212'.
Jan 13 16:49:49 pve213 Satellite[14120]: 16:49:49.730 [MainWorkerPool-8]
INFO LINSTOR/Satellite - Resource 'vm-101-disk-1' updated for node
'pve213'.
Jan 13 17:26:57 pve213 Satellite[14120]: 17:26:57.910 [MainWorkerPool-2]
INFO LINSTOR/Satellite - Resource 'vm-102-disk-1' created for node
'pve212'.
Jan 13 17:26:57 pve213 Satellite[14120]: 17:26:57.910 [MainWorkerPool-2]
INFO LINSTOR/Satellite - Resource 'vm-102-disk-1' created for node
'pve213'.
root@zern1:~# grep Satellite /var/log/daemon.log
Jan 13 16:22:01 zern1 systemd[1]: Started LINSTOR Satellite Service.
Jan 13 16:22:02 zern1 Satellite[20849]: LINSTOR, Module Satellite
Jan 13 16:22:02 zern1 Satellite[20849]: Version: 0.7.5
(d74305b420fdc878182afa162378a317e6a4a3b9)
Jan 13 16:22:02 zern1 Satellite[20849]: Build time:
2018-12-21T08:28:19+00:00
Jan 13 16:22:02 zern1 Satellite[20849]: Java Version: 1.8
Jan 13 16:22:02 zern1 Satellite[20849]: Java VM: Oracle
Corporation, Version 25.181-b13
Jan 13 16:22:02 zern1 Satellite[20849]: Operating system: Linux,
Version 4.13.13-6-pve
Jan 13 16:22:02 zern1 Satellite[20849]: Environment: amd64, 2
processors, 1653 MiB memory reserved for allocations
Jan 13 16:22:02 zern1 Satellite[20849]: System components initialization
in progress
Jan 13 16:22:02 zern1 Satellite[20849]: 16:22:02.710 [main] INFO
LINSTOR/Satellite - Log directory set to: '/var/log/linstor-satellite'
Jan 13 16:22:02 zern1 Satellite[20849]: 16:22:02.716 [Main] INFO
LINSTOR/Satellite - Loading API classes started.
Jan 13 16:22:03 zern1 Satellite[20849]: 16:22:03.415 [Main] INFO
LINSTOR/Satellite - API classes loading finished: 698ms
Jan 13 16:22:03 zern1 Satellite[20849]: 16:22:03.417 [Main] INFO
LINSTOR/Satellite - Dependency injection started.
Jan 13 16:22:05 zern1 Satellite[20849]: 16:22:05.819 [Main] INFO
LINSTOR/Satellite - Dependency injection finished: 2398ms
Jan 13 16:22:06 zern1 Satellite[20849]: 16:22:06.380 [Main] INFO
LINSTOR/Satellite - Removing all res files from /var/lib/linstor.d
Jan 13 16:22:06 zern1 Satellite[20849]: 16:22:06.390 [Main] INFO
LINSTOR/Satellite - Starting service instance 'DeviceManager' of type
DeviceManager
Jan 13 16:22:06 zern1 Satellite[20849]: 16:22:06.395 [Main] INFO
LINSTOR/Satellite - Starting service instance 'DrbdEventPublisher-1' of
type DrbdEventPublisher
Jan 13 16:22:06 zern1 Satellite[20849]: 16:22:06.397 [Main] INFO
LINSTOR/Satellite - Starting service instance 'DrbdEventService-1' of
type DrbdEventService
Jan 13 16:22:06 zern1 Satellite[20849]: 16:22:06.407 [Main] INFO
LINSTOR/Satellite - Starting service instance 'FileEventService' of type
FileEventService
Jan 13 16:22:06 zern1 Satellite[20849]: 16:22:06.408 [Main] INFO
LINSTOR/Satellite - Starting service instance 'TimerEventService' of
type TimerEventService
Jan 13 16:22:06 zern1 Satellite[20849]: 16:22:06.417 [Main] INFO
LINSTOR/Satellite - Initializing main network communications service
Jan 13 16:22:06 zern1 Satellite[20849]: 16:22:06.452 [Main] INFO
LINSTOR/Satellite - NetComService started on port /0:0:0:0:0:0:0:0:3366
Jan 13 16:37:22 zern1 Satellite[20849]: 16:37:22.139 [MainWorkerPool-1]
INFO LINSTOR/Satellite - Controller connected and authenticated
(10.12.150.1:34792)
Jan 13 16:37:22 zern1 Satellite[20849]: 16:37:22.193 [MainWorkerPool-2]
INFO LINSTOR/Satellite - Node 'zern1' created.
Jan 13 16:37:22 zern1 Satellite[20849]: 16:37:22.212 [MainWorkerPool-2]
INFO LINSTOR/Satellite - Storage pool 'DfltDisklessStorPool' created.
Jan 13 16:37:24 zern1 Satellite[20849]: 16:37:24.210 [MainWorkerPool-2]
INFO LINSTOR/Satellite - Storage pool 'drbdpool' created.
Jan 13 16:43:12 zern1 Satellite[20849]: 16:43:12.833 [MainWorkerPool-2]
INFO LINSTOR/Satellite - Resource 'vm-101-disk-1' created for node
'pve212'.
Jan 13 16:43:12 zern1 Satellite[20849]: 16:43:12.835 [MainWorkerPool-2]
INFO LINSTOR/Satellite - Resource 'vm-101-disk-1' created for node
'pve213'.
Jan 13 16:43:12 zern1 Satellite[20849]: 16:43:12.836 [MainWorkerPool-2]
INFO LINSTOR/Satellite - Resource 'vm-101-disk-1' created for node 'zern1'.
Jan 13 16:43:42 zern1 Satellite[20849]: 16:43:42.116 [MainWorkerPool-2]
INFO LINSTOR/Satellite - Resource 'vm-111-disk-1' created for node 'zern1'.
Jan 13 16:44:23 zern1 Satellite[20849]: 16:44:23.286 [MainWorkerPool-2]
INFO LINSTOR/Satellite - Resource 'vm-111-disk-1' updated for node 'zern1'.
Finally, the generated resource files:
PVE211
# This file was generated by linstor(0.7.5), do not edit manually.
resource "vm-108-disk-1"
{
template-file "linstor_common.conf";
net
{
cram-hmac-alg sha1;
shared-secret "TqrARbxMBdQr2xjJ0Fu4";
allow-two-primaries yes;
}
on pve211
{
volume 0
{
disk /dev/drbdpool/vm-108-disk-1_00;
meta-disk internal;
device minor 110;
}
node-id 1;
}
}
PVE212
root@pve212:/var/lib/linstor.d# cat vm-101-disk-1.res
# This file was generated by linstor(0.7.5), do not edit manually.
resource "vm-101-disk-1"
{
template-file "linstor_common.conf";
net
{
cram-hmac-alg sha1;
shared-secret "cAKoGGuAxS2dGoih7ahn";
allow-two-primaries yes;
}
on pve212
{
volume 0
{
disk /dev/drbdpool/vm-101-disk-1_00;
meta-disk internal;
device minor 108;
}
node-id 1;
}
on pve213
{
volume 0
{
disk /dev/drbd/this/is/not/used;
meta-disk internal;
device minor 108;
}
node-id 2;
}
on zern1
{
volume 0
{
disk /dev/drbd/this/is/not/used;
meta-disk internal;
device minor 108;
}
node-id 0;
}
connection
{
host pve212 address ipv4 10.12.150.2:7000;
host pve213 address ipv4 10.12.150.3:7000;
}
connection
{
host pve212 address ipv4 10.12.150.2:7000;
host zern1 address ipv4 10.12.150.4:7000;
}
}
root@pve212:/var/lib/linstor.d# cat vm-102-disk-1.res
# This file was generated by linstor(0.7.5), do not edit manually.
resource "vm-102-disk-1"
{
template-file "linstor_common.conf";
net
{
cram-hmac-alg sha1;
shared-secret "CpY6iL4Mnh9QAX1bP3Dd";
allow-two-primaries yes;
}
on pve212
{
volume 0
{
disk /dev/drbdpool/vm-102-disk-1_00;
meta-disk internal;
device minor 109;
}
node-id 2;
}
on pve213
{
volume 0
{
disk /dev/drbd/this/is/not/used;
meta-disk internal;
device minor 109;
}
node-id 1;
}
connection
{
host pve212 address ipv4 10.12.150.2:7001;
host pve213 address ipv4 10.12.150.3:7001;
}
}
root@pve212:/var/lib/linstor.d# cat vm-202-disk-1.res
# This file was generated by linstor(0.7.5), do not edit manually.
resource "vm-202-disk-1"
{
template-file "linstor_common.conf";
net
{
cram-hmac-alg sha1;
shared-secret "psvtT2unU5ZgFUvSWUxG";
allow-two-primaries yes;
}
on pve212
{
volume 0
{
disk /dev/drbdpool/vm-202-disk-1_00;
meta-disk internal;
device minor 115;
}
node-id 1;
}
}
root@pve212:/var/lib/linstor.d#
PVE213
root@pve213:/var/lib/linstor.d# cat vm-101-disk-1.res vm-102-disk-1.res
# This file was generated by linstor(0.7.5), do not edit manually.
resource "vm-101-disk-1"
{
template-file "linstor_common.conf";
net
{
cram-hmac-alg sha1;
shared-secret "cAKoGGuAxS2dGoih7ahn";
allow-two-primaries yes;
}
on pve213
{
volume 0
{
disk /dev/drbdpool/vm-101-disk-1_00;
meta-disk internal;
device minor 108;
}
node-id 2;
}
on pve212
{
volume 0
{
disk /dev/drbd/this/is/not/used;
meta-disk internal;
device minor 108;
}
node-id 1;
}
on zern1
{
volume 0
{
disk /dev/drbd/this/is/not/used;
meta-disk internal;
device minor 108;
}
node-id 0;
}
connection
{
host pve213 address ipv4 10.12.150.3:7000;
host pve212 address ipv4 10.12.150.2:7000;
}
connection
{
host pve213 address ipv4 10.12.150.3:7000;
host zern1 address ipv4 10.12.150.4:7000;
}
}
# This file was generated by linstor(0.7.5), do not edit manually.
resource "vm-102-disk-1"
{
template-file "linstor_common.conf";
net
{
cram-hmac-alg sha1;
shared-secret "CpY6iL4Mnh9QAX1bP3Dd";
allow-two-primaries yes;
}
on pve213
{
volume 0
{
disk /dev/drbdpool/vm-102-disk-1_00;
meta-disk internal;
device minor 109;
}
node-id 1;
}
on pve212
{
volume 0
{
disk /dev/drbd/this/is/not/used;
meta-disk internal;
device minor 109;
}
node-id 2;
}
connection
{
host pve213 address ipv4 10.12.150.3:7001;
host pve212 address ipv4 10.12.150.2:7001;
}
}
ZERN1
root@zern1:/var/lib/linstor.d# cat vm-101-disk-1.res_tmp
vm-111-disk-1.res_tmp
# This file was generated by linstor(0.7.5), do not edit manually.
resource "vm-101-disk-1"
{
template-file "linstor_common.conf";
net
{
cram-hmac-alg sha1;
shared-secret "cAKoGGuAxS2dGoih7ahn";
allow-two-primaries yes;
}
on zern1
{
volume 0
{
disk /dev/drbdpool/vm-101-disk-1_00;
meta-disk internal;
device minor 108;
}
node-id 0;
}
on pve212
{
volume 0
{
disk /dev/drbd/this/is/not/used;
meta-disk internal;
device minor 108;
}
node-id 1;
}
on pve213
{
volume 0
{
disk /dev/drbd/this/is/not/used;
meta-disk internal;
device minor 108;
}
node-id 2;
}
connection
{
host zern1 address ipv4 10.12.150.4:7000;
host pve212 address ipv4 10.12.150.2:7000;
}
connection
{
host zern1 address ipv4 10.12.150.4:7000;
host pve213 address ipv4 10.12.150.3:7000;
}
}
# This file was generated by linstor(0.7.5), do not edit manually.
resource "vm-111-disk-1"
{
template-file "linstor_common.conf";
net
{
cram-hmac-alg sha1;
shared-secret "LRZVSP38T/1GryvfghVn";
allow-two-primaries yes;
}
on zern1
{
volume 0
{
disk /dev/drbdpool/vm-111-disk-1_00;
meta-disk internal;
device minor 113;
}
node-id 0;
}
}
Il 16/01/19 07:13, Rene Peinthor ha scritto:
Hi!
We would need more info here, like if error-reports were generate:
`linstor error-reports list`
and the output of those error reports
`linstor error-reports [ids...]`
if the first command didn't output anything, also check the service
looks on the satellites
`journalctl -u linstor-satellite`
Cheers,
Rene
On Mon, Jan 14, 2019 at 10:09 AM Denis <drbd...@made.net
<mailto:drbd...@made.net>> wrote:
Hello,
Yesterday i did try the migration on a 4 node cluster with proxmox
5.1,
latest version of drbd and drbdmanage.
I installed linstor controller and satellite on all nodes and
activate
controller on the first.
I logged to the controller, created and reviewed dmmigrate.sh and
executed it.
### Nodes ###
linstor node create --node-type Combined pve212 10.12.150.2
linstor node create --node-type Combined pve213 10.12.150.3
linstor node create --node-type Combined pve211 10.12.150.1
linstor node create --node-type Combined zern1 10.12.150.4
### Storage ###
linstor storage-pool-definition create drbdpool
linstor storage-pool create lvm pve212 drbdpool drbdpool
linstor storage-pool create lvm pve213 drbdpool drbdpool
linstor storage-pool create lvm pve211 drbdpool drbdpool
linstor storage-pool create lvm zern1 drbdpool drbdpool
### Resource: vm-101-disk-1 ###
linstor resource-definition create --port 7000 vm-101-disk-1
linstor resource-definition drbd-options --allow-two-primaries yes
vm-101-disk-1
linstor volume-definition create --vlmnr 0 --minor 108 vm-101-disk-1
52428800K
linstor volume-definition set-property vm-101-disk-1 0 OverrideVlmId
vm-101-disk-1_00
linstor volume-definition set-property vm-101-disk-1 0
AllowLargerVolumeSize true
linstor resource create --node-id 1 --storage-pool drbdpool pve212
vm-101-disk-1
linstor resource create --node-id 2 --storage-pool drbdpool pve213
vm-101-disk-1
linstor resource create --node-id 0 --storage-pool drbdpool zern1
vm-101-disk-1
The last command timed out after 5 minutes with no errors.
Satellite is running on all 4 nodes.
Then I tried to continue:
### Resource: vm-108-disk-1 ###
linstor resource-definition create --port 7002 vm-108-disk-1
linstor resource-definition drbd-options --allow-two-primaries yes
vm-108-disk-1
linstor volume-definition create --vlmnr 0 --minor 110 vm-108-disk-1
52428800K
linstor volume-definition set-property vm-108-disk-1 0 OverrideVlmId
vm-108-disk-1_00
linstor volume-definition set-property vm-108-disk-1 0
AllowLargerVolumeSize true
linstor resource create --node-id 1 --storage-pool drbdpool pve211
vm-108-disk-1
...timed out after 5 minutes...
I made other steps with same result and then rolled back to
drbdmanage.
BTW: I did see resize and UUID modification during migration process,
can it be dangerous restoring old drbdmanage .res files?
If you need some other information, please tell me.
I have drbdmange and linstor running now, but linstor resourced
are not
included by drbd and proxmox still uses drbdmanage plugin
Thank you,
Denis
_______________________________________________
drbd-user mailing list
drbd-user@lists.linbit.com <mailto:drbd-user@lists.linbit.com>
http://lists.linbit.com/mailman/listinfo/drbd-user
_______________________________________________
drbd-user mailing list
drbd-user@lists.linbit.com
http://lists.linbit.com/mailman/listinfo/drbd-user
