Hi, We are running 3 node cluster and suddenly it went into maintenance mode. Now i am able to login into nodes but cant do any action like activating the cluster or removing other nodes from it. All 3 nodes run in isolated mode. I restarted the cluster, but it didn't help. Is there a way to exit maintenance mode? How do we recover from such a state ?
Error: -------------------------------------------------------------------------------- Failed to change cluster state to ACTIVE Failed to activate cluster (node is in maintenance mode). suppressed: Command [SET-STATE] finished with code: 4 Error stack trace: class org.apache.ignite.internal.client.GridClientException: Failed to activate cluster (node is in maintenance mode). suppressed: at org.apache.ignite.internal.client.impl.connection.GridClientNioTcpConnection.handleClientResponse(GridClientNioTcpConnection.java:632) at org.apache.ignite.internal.client.impl.connection.GridClientNioTcpConnection.handleResponse(GridClientNioTcpConnection.java:563) at org.apache.ignite.internal.client.impl.connection.GridClientConnectionManagerAdapter$NioListener.onMessage(GridClientConnectionManagerAdapter.java:691) at org.apache.ignite.internal.util.nio.GridNioFilterChain$TailFilter.onMessageReceived(GridNioFilterChain.java:279) at org.apache.ignite.internal.util.nio.GridNioFilterAdapter.proceedMessageReceived(GridNioFilterAdapter.java:109) at org.apache.ignite.internal.util.nio.GridNioCodecFilter.onMessageReceived(GridNioCodecFilter.java:116) at org.apache.ignite.internal.util.nio.GridNioFilterAdapter.proceedMessageReceived(GridNioFilterAdapter.java:109) at org.apache.ignite.internal.util.nio.GridNioServer$HeadFilter.onMessageReceived(GridNioServer.java:3734) at org.apache.ignite.internal.util.nio.GridNioFilterChain.onMessageReceived(GridNioFilterChain.java:175) at org.apache.ignite.internal.util.nio.GridNioServer$ByteBufferNioClientWorker.processRead(GridNioServer.java:1211) at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.processSelectedKeysOptimized(GridNioServer.java:2508) at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.bodyInternal(GridNioServer.java:2273) at org.apache.ignite.internal.util.nio.GridNioServer$AbstractNioClientWorker.body(GridNioServer.java:1910) at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120) at java.base/java.lang.Thread.run(Unknown Source) Control utility has completed execution at: 2022-06-02T14:06:03.205 Execution time: 209 ms root@ignite-client-kaurv-tbabor1-0:/opt/ignite/apache-ignite/bin#