[
https://issues.apache.org/jira/browse/IGNITE-25398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Roman Puchkovskiy updated IGNITE-25398:
---------------------------------------
Description:
The following exception happened and was propagated to the Failure Processor:
2025-05-16T06:59:28,491][ERROR][%ihaprt_throtz_3344%Raft-Group-Client-4][FailureManager]
Critical system error detected. Will be handled accordingly to configured
handler [hnd=NoOpFailureHandler [super=AbstractFailureHandler
[ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED,
SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], failureCtx=CRITICAL_ERROR]
org.apache.ignite.internal.failure.StackTraceCapturingException: Rebalance
failover subscription on elected primary replica failed [groupId=26_part_0].
at
org.apache.ignite.internal.failure.FailureManager.process(FailureManager.java:153)
~[ignite-failure-handler-9.1.127-SNAPSHOT.jar:?]
at
org.apache.ignite.internal.failure.FailureManager.process(FailureManager.java:130)
~[ignite-failure-handler-9.1.127-SNAPSHOT.jar:?]
at
org.apache.ignite.internal.replicator.ReplicaImpl.lambda$registerFailoverCallback$2(ReplicaImpl.java:187)
~[ignite-replicator-9.1.127-SNAPSHOT.jar:?]
at
java.base/java.util.concurrent.CompletableFuture.uniExceptionally(CompletableFuture.java:990)
[?:?]
at
java.base/java.util.concurrent.CompletableFuture$UniExceptionally.tryFire(CompletableFuture.java:974)
[?:?]
at
java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510)
[?:?]
at
java.base/java.util.concurrent.CompletableFuture.postFire(CompletableFuture.java:614)
[?:?]
at
java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:844)
[?:?]
at
java.base/java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:482)
[?:?]
at
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
[?:?]
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
at
java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
[?:?]
at
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
[?:?]
at
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
[?:?]
at java.base/java.lang.Thread.run(Thread.java:833) [?:?]
Caused by: java.util.concurrent.CompletionException:
org.apache.ignite.internal.network.RecipientLeftException: IGN-NETWORK-5
TraceId:a9ceb148-91e4-4a72-9bbd-3e114798f55b
at
java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:332)
~[?:?]
at
java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:347)
~[?:?]
at
java.base/java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:1141)
~[?:?]
at
java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510)
~[?:?]
at
java.base/java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2162)
~[?:?]
at
org.apache.ignite.internal.network.OutNetworkObject.failAcknowledgement(OutNetworkObject.java:87)
~[ignite-network-9.1.127-SNAPSHOT.jar:?]
at
org.apache.ignite.internal.network.recovery.RecoveryDescriptor.dispose(RecoveryDescriptor.java:257)
~[ignite-network-9.1.127-SNAPSHOT.jar:?]
at
org.apache.ignite.internal.network.netty.ConnectionManager.blockAndDisposeDescriptor(ConnectionManager.java:702)
~[ignite-network-9.1.127-SNAPSHOT.jar:?]
at
org.apache.ignite.internal.network.netty.ConnectionManager.disposeRecoveryDescriptorsOfLeftNode(ConnectionManager.java:670)
~[ignite-network-9.1.127-SNAPSHOT.jar:?]
at
org.apache.ignite.internal.network.netty.ConnectionManager.lambda$handleNodeLeft$9(ConnectionManager.java:646)
~[ignite-network-9.1.127-SNAPSHOT.jar:?]
at
java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:863)
~[?:?]
at
java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:841)
~[?:?]
at
java.base/java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:482)
~[?:?]
... 3 more
Such exceptions should be treated as recoverable.
> Handle RecipientLeftException in topology-aware raft client
> -----------------------------------------------------------
>
> Key: IGNITE-25398
> URL: https://issues.apache.org/jira/browse/IGNITE-25398
> Project: Ignite
> Issue Type: Improvement
> Reporter: Roman Puchkovskiy
> Assignee: Roman Puchkovskiy
> Priority: Major
> Labels: ignite-3
>
> The following exception happened and was propagated to the Failure Processor:
>
> 2025-05-16T06:59:28,491][ERROR][%ihaprt_throtz_3344%Raft-Group-Client-4][FailureManager]
> Critical system error detected. Will be handled accordingly to configured
> handler [hnd=NoOpFailureHandler [super=AbstractFailureHandler
> [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED,
> SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], failureCtx=CRITICAL_ERROR]
> org.apache.ignite.internal.failure.StackTraceCapturingException: Rebalance
> failover subscription on elected primary replica failed [groupId=26_part_0].
> at
> org.apache.ignite.internal.failure.FailureManager.process(FailureManager.java:153)
> ~[ignite-failure-handler-9.1.127-SNAPSHOT.jar:?]
> at
> org.apache.ignite.internal.failure.FailureManager.process(FailureManager.java:130)
> ~[ignite-failure-handler-9.1.127-SNAPSHOT.jar:?]
> at
> org.apache.ignite.internal.replicator.ReplicaImpl.lambda$registerFailoverCallback$2(ReplicaImpl.java:187)
> ~[ignite-replicator-9.1.127-SNAPSHOT.jar:?]
> at
> java.base/java.util.concurrent.CompletableFuture.uniExceptionally(CompletableFuture.java:990)
> [?:?]
> at
> java.base/java.util.concurrent.CompletableFuture$UniExceptionally.tryFire(CompletableFuture.java:974)
> [?:?]
> at
> java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510)
> [?:?]
> at
> java.base/java.util.concurrent.CompletableFuture.postFire(CompletableFuture.java:614)
> [?:?]
> at
> java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:844)
> [?:?]
> at
> java.base/java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:482)
> [?:?]
> at
> java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539)
> [?:?]
> at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
> at
> java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
> [?:?]
> at
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
> [?:?]
> at
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
> [?:?]
> at java.base/java.lang.Thread.run(Thread.java:833) [?:?]
> Caused by: java.util.concurrent.CompletionException:
> org.apache.ignite.internal.network.RecipientLeftException: IGN-NETWORK-5
> TraceId:a9ceb148-91e4-4a72-9bbd-3e114798f55b
> at
> java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:332)
> ~[?:?]
> at
> java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:347)
> ~[?:?]
> at
> java.base/java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:1141)
> ~[?:?]
> at
> java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510)
> ~[?:?]
> at
> java.base/java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:2162)
> ~[?:?]
> at
> org.apache.ignite.internal.network.OutNetworkObject.failAcknowledgement(OutNetworkObject.java:87)
> ~[ignite-network-9.1.127-SNAPSHOT.jar:?]
> at
> org.apache.ignite.internal.network.recovery.RecoveryDescriptor.dispose(RecoveryDescriptor.java:257)
> ~[ignite-network-9.1.127-SNAPSHOT.jar:?]
> at
> org.apache.ignite.internal.network.netty.ConnectionManager.blockAndDisposeDescriptor(ConnectionManager.java:702)
> ~[ignite-network-9.1.127-SNAPSHOT.jar:?]
> at
> org.apache.ignite.internal.network.netty.ConnectionManager.disposeRecoveryDescriptorsOfLeftNode(ConnectionManager.java:670)
> ~[ignite-network-9.1.127-SNAPSHOT.jar:?]
> at
> org.apache.ignite.internal.network.netty.ConnectionManager.lambda$handleNodeLeft$9(ConnectionManager.java:646)
> ~[ignite-network-9.1.127-SNAPSHOT.jar:?]
> at
> java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:863)
> ~[?:?]
> at
> java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:841)
> ~[?:?]
> at
> java.base/java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:482)
> ~[?:?]
> ... 3 more
>
> Such exceptions should be treated as recoverable.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)