[ https://issues.apache.org/jira/browse/FLINK-22115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhu Zhu closed FLINK-22115. --------------------------- Resolution: Won't Fix Close this ticket since it may be already fixed and has been inactive for too long. Please re-open it if it still happens in latest 1.12/1.13 fix versions. > JobManager dies with IllegalStateException SharedSlot (physical request > SlotRequestId{%}) has been released > ----------------------------------------------------------------------------------------------------------- > > Key: FLINK-22115 > URL: https://issues.apache.org/jira/browse/FLINK-22115 > Project: Flink > Issue Type: Bug > Components: Runtime / Coordination > Affects Versions: 1.12.0 > Reporter: wym_maozi > Priority: Minor > Labels: auto-deprioritized-major > Attachments: flink-root-standalonesession-0-banyue01.zip > > > After TaskManager hangs, and JobManager fails to restart the task many times, > I experienced fatal JobManager crashes, with the following log: > {code:java} > 2021-04-06 14:13:10,388 INFO > org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting > nesourceProfile{UNKNOWN} with allocation id 6c99582801115ac080d407123cf92e80 > from resource manager. > 2021-04-06 14:13:10,389 INFO > org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - > Request5123cc0fd9eb3 with allocation id 6c99582801115ac080d407123cf92e80. > 2021-04-06 14:13:10,389 INFO > org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl [] - Requesting > nesourceProfile{UNKNOWN} with allocation id 56b82914f123bdf3aec2cad538dc8e75 > from resource manager. > 2021-04-06 14:13:10,389 INFO > org.apache.flink.runtime.resourcemanager.StandaloneResourceManager [] - > Request5123cc0fd9eb3 with allocation id 56b82914f123bdf3aec2cad538dc8e75. > 2021-04-06 14:13:10,389 ERROR > org.apache.flink.runtime.util.FatalExitExceptionHandler [] - FATAL: > Thread. Stopping the process... > java.util.concurrent.CompletionException: java.lang.IllegalStateException: > SharedSlot (physical request SlotR > at > java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:273) > ~[?:1.8.0_181] > at > java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:280) > ~[?:1.8.0_181 > at > java.util.concurrent.CompletableFuture.uniRun(CompletableFuture.java:708) > ~[?:1.8.0_181] > at > java.util.concurrent.CompletableFuture$UniRun.tryFire(CompletableFuture.java:687) > ~[?:1.8.0_181] > at > java.util.concurrent.CompletableFuture$Completion.run(CompletableFuture.java:442) > ~[?:1.8.0_181] > at > org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRunAsync(AkkaRpcActor.java:404) > ~[flink-dist_ > at > org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:197) > ~[flink-dis > at > org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:74) > at > org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:154) > ~[flink-dist_2 > at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:26) > [flink-dist_2.11-1.12.0.jar:1.12.0] > at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:21) > [flink-dist_2.11-1.12.0.jar:1.12.0] > at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123) > [flink-dist_2.11-1.12.0.jar:1.1 > at > akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:21) > [flink-dist_2.11-1.12.0.jar:1. > at > scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:170) > [flink-dist_2.11-1.12.0.jar:1. > at > scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171) > [flink-dist_2.11-1.12.0.jar:1. > at > scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171) > [flink-dist_2.11-1.12.0.jar:1. > at akka.actor.Actor$class.aroundReceive(Actor.scala:517) > [flink-dist_2.11-1.12.0.jar:1.12.0] > at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:225) > [flink-dist_2.11-1.12.0.jar:1.12.0 > at akka.actor.ActorCell.receiveMessage(ActorCell.scala:592) > [flink-dist_2.11-1.12.0.jar:1.12.0] > at akka.actor.ActorCell.invoke(ActorCell.scala:561) > [flink-dist_2.11-1.12.0.jar:1.12.0] > at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258) > [flink-dist_2.11-1.12.0.jar:1.12.0] > at akka.dispatch.Mailbox.run(Mailbox.scala:225) > [flink-dist_2.11-1.12.0.jar:1.12.0] > at akka.dispatch.Mailbox.exec(Mailbox.scala:235) > [flink-dist_2.11-1.12.0.jar:1.12.0] > at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) > [flink-dist_2.11-1.12.0.jar:1.12 > at > akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) > [flink-dist_2.11-1.1 > at > akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) > [flink-dist_2.11-1.12.0.jar: > at > akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) > [flink-dist_2.11-1. > Caused by: java.lang.IllegalStateException: SharedSlot (physical request > SlotRequestId{0db9fa269ccc01f3eb2c15 > at > org.apache.flink.util.Preconditions.checkState(Preconditions.java:220) > ~[flink-dist_2.11-1.12.0.ja > at > org.apache.flink.runtime.scheduler.SharedSlot.allocateLogicalSlot(SharedSlot.java:126) > ~[flink-dis > at > org.apache.flink.runtime.scheduler.SlotSharingExecutionSlotAllocator.allocateLogicalSlotsFromShare12.0.jar:1.12.0] > at > org.apache.flink.runtime.scheduler.SlotSharingExecutionSlotAllocator.allocateSlotsFor(SlotSharingE > at > org.apache.flink.runtime.scheduler.DefaultScheduler.allocateSlots(DefaultScheduler.java:371) > ~[fli > at > org.apache.flink.runtime.scheduler.DefaultScheduler.allocateSlotsAndDeploy(DefaultScheduler.java:3 > at > org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy.maybeScheduleRegion(r:1.12.0] > at > org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy.maybeScheduleRegionsar:1.12.0] > at > org.apache.flink.runtime.scheduler.strategy.PipelinedRegionSchedulingStrategy.restartTasks(Pipelin] > at > org.apache.flink.runtime.scheduler.DefaultScheduler.lambda$restartTasks$2(DefaultScheduler.java:29 > at > java.util.concurrent.CompletableFuture.uniRun(CompletableFuture.java:705) > ~[?:1.8.0_181] > ... 24 more > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)