[
https://issues.apache.org/jira/browse/FLINK-23575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17392048#comment-17392048
]
Piotr Nowojski commented on FLINK-23575:
----------------------------------------
This might be a duplicate of FLINK-23558
CC [~akalashnikov]
> UnalignedCheckpointRescaleITCase.shouldRescaleUnalignedCheckpoint fails with
> AsynchronousException
> --------------------------------------------------------------------------------------------------
>
> Key: FLINK-23575
> URL: https://issues.apache.org/jira/browse/FLINK-23575
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Task
> Affects Versions: 1.14.0
> Reporter: Xintong Song
> Priority: Critical
> Labels: test-stability
> Fix For: 1.14.0
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=21246&view=logs&j=5c8e7682-d68f-54d1-16a2-a09310218a49&t=86f654fa-ab48-5c1a-25f4-7e7f6afb9bba&l=4938
> {code}
> Jul 31 21:32:59 [ERROR] Tests run: 72, Failures: 0, Errors: 1, Skipped: 0,
> Time elapsed: 655.588 s <<< FAILURE! - in
> org.apache.flink.test.checkpointing.UnalignedCheckpointRescaleITCase
> Jul 31 21:32:59 [ERROR] shouldRescaleUnalignedCheckpoint[upscale pipeline
> from 20 to 21, buffersPerChannel =
> 1](org.apache.flink.test.checkpointing.UnalignedCheckpointRescaleITCase)
> Time elapsed: 21.288 s <<< ERROR!
> Jul 31 21:32:59 org.apache.flink.runtime.client.JobExecutionException: Job
> execution failed.
> Jul 31 21:32:59 at
> org.apache.flink.runtime.jobmaster.JobResult.toJobExecutionResult(JobResult.java:144)
> Jul 31 21:32:59 at
> org.apache.flink.test.checkpointing.UnalignedCheckpointTestBase.execute(UnalignedCheckpointTestBase.java:159)
> Jul 31 21:32:59 at
> org.apache.flink.test.checkpointing.UnalignedCheckpointRescaleITCase.shouldRescaleUnalignedCheckpoint(UnalignedCheckpointRescaleITCase.java:543)
> Jul 31 21:32:59 at
> sun.reflect.GeneratedMethodAccessor128.invoke(Unknown Source)
> Jul 31 21:32:59 at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> Jul 31 21:32:59 at java.lang.reflect.Method.invoke(Method.java:498)
> Jul 31 21:32:59 at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
> Jul 31 21:32:59 at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> Jul 31 21:32:59 at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
> Jul 31 21:32:59 at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> Jul 31 21:32:59 at org.junit.rules.Verifier$1.evaluate(Verifier.java:35)
> Jul 31 21:32:59 at
> org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
> Jul 31 21:32:59 at
> org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
> Jul 31 21:32:59 at
> org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:61)
> Jul 31 21:32:59 at
> org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
> Jul 31 21:32:59 at
> org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
> Jul 31 21:32:59 at
> org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
> Jul 31 21:32:59 at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
> Jul 31 21:32:59 at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
> Jul 31 21:32:59 at
> org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
> Jul 31 21:32:59 at
> org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
> Jul 31 21:32:59 at
> org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
> Jul 31 21:32:59 at
> org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
> Jul 31 21:32:59 at
> org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
> Jul 31 21:32:59 at
> org.junit.runners.ParentRunner.run(ParentRunner.java:413)
> Jul 31 21:32:59 at org.junit.runners.Suite.runChild(Suite.java:128)
> Jul 31 21:32:59 at org.junit.runners.Suite.runChild(Suite.java:27)
> Jul 31 21:32:59 at
> org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
> Jul 31 21:32:59 at
> org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
> Jul 31 21:32:59 at
> org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
> Jul 31 21:32:59 at
> org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
> Jul 31 21:32:59 at
> org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
> Jul 31 21:32:59 at
> org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
> Jul 31 21:32:59 at
> org.junit.runners.ParentRunner.run(ParentRunner.java:413)
> Jul 31 21:32:59 at
> org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:365)
> Jul 31 21:32:59 at
> org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:273)
> Jul 31 21:32:59 at
> org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
> Jul 31 21:32:59 at
> org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:159)
> Jul 31 21:32:59 at
> org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:384)
> Jul 31 21:32:59 at
> org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:345)
> Jul 31 21:32:59 at
> org.apache.maven.surefire.booter.ForkedBooter.execute(ForkedBooter.java:126)
> Jul 31 21:32:59 at
> org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)
> Jul 31 21:32:59 Caused by: org.apache.flink.runtime.JobException: Recovery is
> suppressed by
> FixedDelayRestartBackoffTimeStrategy(maxNumberRestartAttempts=1,
> backoffTimeMS=100)
> Jul 31 21:32:59 at
> org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.handleFailure(ExecutionFailureHandler.java:138)
> Jul 31 21:32:59 at
> org.apache.flink.runtime.executiongraph.failover.flip1.ExecutionFailureHandler.getFailureHandlingResult(ExecutionFailureHandler.java:82)
> Jul 31 21:32:59 at
> org.apache.flink.runtime.scheduler.DefaultScheduler.handleTaskFailure(DefaultScheduler.java:228)
> Jul 31 21:32:59 at
> org.apache.flink.runtime.scheduler.DefaultScheduler.maybeHandleTaskFailure(DefaultScheduler.java:218)
> Jul 31 21:32:59 at
> org.apache.flink.runtime.scheduler.DefaultScheduler.updateTaskExecutionStateInternal(DefaultScheduler.java:209)
> Jul 31 21:32:59 at
> org.apache.flink.runtime.scheduler.SchedulerBase.updateTaskExecutionState(SchedulerBase.java:682)
> Jul 31 21:32:59 at
> org.apache.flink.runtime.scheduler.SchedulerNG.updateTaskExecutionState(SchedulerNG.java:79)
> Jul 31 21:32:59 at
> org.apache.flink.runtime.jobmaster.JobMaster.updateTaskExecutionState(JobMaster.java:436)
> Jul 31 21:32:59 at sun.reflect.GeneratedMethodAccessor33.invoke(Unknown
> Source)
> Jul 31 21:32:59 at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> Jul 31 21:32:59 at java.lang.reflect.Method.invoke(Method.java:498)
> Jul 31 21:32:59 at
> org.apache.flink.runtime.rpc.akka.AkkaRpcActor.lambda$handleRpcInvocation$1(AkkaRpcActor.java:316)
> Jul 31 21:32:59 at
> org.apache.flink.runtime.concurrent.akka.ClassLoadingUtils.runWithContextClassLoader(ClassLoadingUtils.java:83)
> Jul 31 21:32:59 at
> org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcInvocation(AkkaRpcActor.java:314)
> Jul 31 21:32:59 at
> org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:217)
> Jul 31 21:32:59 at
> org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:78)
> Jul 31 21:32:59 at
> org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:163)
> Jul 31 21:32:59 at
> akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:24)
> Jul 31 21:32:59 at
> akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:20)
> Jul 31 21:32:59 at
> scala.PartialFunction.applyOrElse(PartialFunction.scala:123)
> Jul 31 21:32:59 at
> scala.PartialFunction.applyOrElse$(PartialFunction.scala:122)
> Jul 31 21:32:59 at
> akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:20)
> Jul 31 21:32:59 at
> scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
> Jul 31 21:32:59 at
> scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
> Jul 31 21:32:59 at
> scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:172)
> Jul 31 21:32:59 at akka.actor.Actor.aroundReceive(Actor.scala:537)
> Jul 31 21:32:59 at akka.actor.Actor.aroundReceive$(Actor.scala:535)
> Jul 31 21:32:59 at
> akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:220)
> Jul 31 21:32:59 at
> akka.actor.ActorCell.receiveMessage(ActorCell.scala:580)
> Jul 31 21:32:59 at akka.actor.ActorCell.invoke(ActorCell.scala:548)
> Jul 31 21:32:59 at
> akka.dispatch.Mailbox.processMailbox(Mailbox.scala:270)
> Jul 31 21:32:59 at akka.dispatch.Mailbox.run(Mailbox.scala:231)
> Jul 31 21:32:59 at akka.dispatch.Mailbox.exec(Mailbox.scala:243)
> Jul 31 21:32:59 at
> java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
> Jul 31 21:32:59 at
> java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
> Jul 31 21:32:59 at
> java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
> Jul 31 21:32:59 at
> java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:175)
> Jul 31 21:32:59 Caused by:
> org.apache.flink.streaming.runtime.tasks.AsynchronousException: Caught
> exception while processing timer.
> Jul 31 21:32:59 at
> org.apache.flink.streaming.runtime.tasks.StreamTask$StreamTaskAsyncExceptionHandler.handleAsyncException(StreamTask.java:1434)
> Jul 31 21:32:59 at
> org.apache.flink.streaming.runtime.tasks.StreamTask.handleAsyncException(StreamTask.java:1410)
> Jul 31 21:32:59 at
> org.apache.flink.streaming.runtime.tasks.StreamTask.handleTimerException(StreamTask.java:1530)
> Jul 31 21:32:59 at
> org.apache.flink.streaming.runtime.tasks.SystemProcessingTimeService$ScheduledTask.run(SystemProcessingTimeService.java:319)
> Jul 31 21:32:59 at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> Jul 31 21:32:59 at
> java.util.concurrent.FutureTask.run(FutureTask.java:266)
> Jul 31 21:32:59 at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
> Jul 31 21:32:59 at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
> Jul 31 21:32:59 at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> Jul 31 21:32:59 at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> Jul 31 21:32:59 at java.lang.Thread.run(Thread.java:748)
> Jul 31 21:32:59 Caused by:
> TimerException{java.util.concurrent.RejectedExecutionException:
> org.apache.flink.streaming.runtime.tasks.mailbox.TaskMailbox$MailboxClosedException:
> Mailbox is in state QUIESCED, but is required to be in state OPEN for put
> operations.}
> Jul 31 21:32:59 ... 9 more
> Jul 31 21:32:59 Caused by: java.util.concurrent.RejectedExecutionException:
> org.apache.flink.streaming.runtime.tasks.mailbox.TaskMailbox$MailboxClosedException:
> Mailbox is in state QUIESCED, but is required to be in state OPEN for put
> operations.
> Jul 31 21:32:59 at
> org.apache.flink.streaming.runtime.tasks.mailbox.MailboxExecutorImpl.execute(MailboxExecutorImpl.java:78)
> Jul 31 21:32:59 at
> org.apache.flink.runtime.mailbox.MailboxExecutor.submit(MailboxExecutor.java:163)
> Jul 31 21:32:59 at
> org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$throughputCalculationSetup$3(StreamTask.java:688)
> Jul 31 21:32:59 at
> org.apache.flink.streaming.runtime.tasks.SystemProcessingTimeService$ScheduledTask.run(SystemProcessingTimeService.java:317)
> Jul 31 21:32:59 ... 7 more
> Jul 31 21:32:59 Caused by:
> org.apache.flink.streaming.runtime.tasks.mailbox.TaskMailbox$MailboxClosedException:
> Mailbox is in state QUIESCED, but is required to be in state OPEN for put
> operations.
> Jul 31 21:32:59 at
> org.apache.flink.streaming.runtime.tasks.mailbox.TaskMailboxImpl.checkPutStateConditions(TaskMailboxImpl.java:269)
> Jul 31 21:32:59 at
> org.apache.flink.streaming.runtime.tasks.mailbox.TaskMailboxImpl.put(TaskMailboxImpl.java:197)
> Jul 31 21:32:59 at
> org.apache.flink.streaming.runtime.tasks.mailbox.MailboxExecutorImpl.execute(MailboxExecutorImpl.java:74)
> Jul 31 21:32:59 ... 10 more
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
