Jin Xing created FLINK-22276: -------------------------------- Summary: ExceptionHistoryEntryExtractor throws fatal error when task failure Key: FLINK-22276 URL: https://issues.apache.org/jira/browse/FLINK-22276 Project: Flink Issue Type: Bug Components: Runtime / Coordination Reporter: Jin Xing Attachments: image-2021-04-14-17-47-42-323.png
When running my batch job on Flink cluster, I got a fatal error as below and JM exits: {code:java} 2021-04-14 17:06:50,286 ERROR org.apache.flink.runtime.util.FatalExitExceptionHandler [] - FATAL: Thread 'flink-akka.actor.default-dispatcher-4' produced an uncaught exception. Stopping the process...2021-04-14 17:06:50,286 ERROR org.apache.flink.runtime.util.FatalExitExceptionHandler [] - FATAL: Thread 'flink-akka.actor.default-dispatcher-4' produced an uncaught exception. Stopping the process...java.util.concurrent.CompletionException: java.lang.IllegalArgumentException: The selected ExecutionVertex 306d8342cb5b2ad8b53f1be57f65bee8_1 didn't fail. at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:273) ~[?:1.8.0_161] at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:280) ~[?:1.8.0_161] at java.util.concurrent.CompletableFuture.uniRun(CompletableFuture.java:708) ~[?:1.8.0_161] at java.util.concurrent.CompletableFuture$UniRun.tryFire(CompletableFuture.java:687) ~[?:1.8.0_161] at java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:442) ~[?:1.8.0_161] at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRunAsync(AkkaRpcActor.java:440) ~[flink-runtime_2.11-1.13-vvr-4.0-20210413.184913-596.jar:1.13-vvr-4.0-SNAPSHOT] at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:208) ~[flink-runtime_2.11-1.13-vvr-4.0-20210413.184913-596.jar:1.13-vvr-4.0-SNAPSHOT] at org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:77) ~[flink-runtime_2.11-1.13-vvr-4.0-20210413.184913-596.jar:1.13-vvr-4.0-SNAPSHOT] at org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:158) ~[flink-runtime_2.11-1.13-vvr-4.0-20210413.184913-596.jar:1.13-vvr-4.0-SNAPSHOT] at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:26) [akka-actor_2.11-2.5.21.jar:2.5.21] at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:21) [akka-actor_2.11-2.5.21.jar:2.5.21] at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123) [scala-library-2.11.12.jar:?] at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:21) [akka-actor_2.11-2.5.21.jar:2.5.21] at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:170) [scala-library-2.11.12.jar:?] at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171) [scala-library-2.11.12.jar:?] at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171) [scala-library-2.11.12.jar:?] at akka.actor.Actor$class.aroundReceive(Actor.scala:517) [akka-actor_2.11-2.5.21.jar:2.5.21] at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:225) [akka-actor_2.11-2.5.21.jar:2.5.21] at akka.actor.ActorCell.receiveMessage(ActorCell.scala:592) [akka-actor_2.11-2.5.21.jar:2.5.21] at akka.actor.ActorCell.invoke(ActorCell.scala:561) [akka-actor_2.11-2.5.21.jar:2.5.21] at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258) [akka-actor_2.11-2.5.21.jar:2.5.21] at akka.dispatch.Mailbox.run(Mailbox.scala:225) [akka-actor_2.11-2.5.21.jar:2.5.21] at akka.dispatch.Mailbox.exec(Mailbox.scala:235) [akka-actor_2.11-2.5.21.jar:2.5.21] at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) [akka-actor_2.11-2.5.21.jar:2.5.21] at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) [akka-actor_2.11-2.5.21.jar:2.5.21] at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) [akka-actor_2.11-2.5.21.jar:2.5.21] at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) [akka-actor_2.11-2.5.21.jar:2.5.21]Caused by: java.lang.IllegalArgumentException: The selected ExecutionVertex 306d8342cb5b2ad8b53f1be57f65bee8_1 didn't fail. at org.apache.flink.runtime.scheduler.exceptionhistory.ExceptionHistoryEntryExtractor.lambda$createLocalExceptionHistoryEntry$1(ExceptionHistoryEntryExtractor.java:146) ~[flink-runtime_2.11-1.13-vvr-4.0-20210413.184913-596.jar:1.13-vvr-4.0-SNAPSHOT] at java.util.Optional.orElseThrow(Optional.java:290) ~[?:1.8.0_161] at org.apache.flink.runtime.scheduler.exceptionhistory.ExceptionHistoryEntryExtractor.createLocalExceptionHistoryEntry(ExceptionHistoryEntryExtractor.java:142) ~[flink-runtime_2.11-1.13-vvr-4.0-20210413.184913-596.jar:1.13-vvr-4.0-SNAPSHOT] at org.apache.flink.runtime.scheduler.exceptionhistory.ExceptionHistoryEntryExtractor.extractLocalFailure(ExceptionHistoryEntryExtractor.java:60) ~[flink-runtime_2.11-1.13-vvr-4.0-20210413.184913-596.jar:1.13-vvr-4.0-SNAPSHOT] at org.apache.flink.runtime.scheduler.SchedulerBase.archiveFromFailureHandlingResult(SchedulerBase.java:619) ~[flink-runtime_2.11-1.13-vvr-4.0-20210413.184913-596.jar:1.13-vvr-4.0-SNAPSHOT] at org.apache.flink.runtime.scheduler.DefaultScheduler.lambda$null$1(DefaultScheduler.java:260) ~[flink-runtime_2.11-1.13-vvr-4.0-20210413.184913-596.jar:1.13-vvr-4.0-SNAPSHOT] at java.util.concurrent.CompletableFuture.uniRun(CompletableFuture.java:705) ~[?:1.8.0_161] ... 24 more {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)