[
https://issues.apache.org/jira/browse/FLINK-33186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Martijn Visser reopened FLINK-33186:
------------------------------------
Reopening, 0ecc34d3bb5 fixed the checkpoint failure before the savepoint but
not the hang in the restored job from my comment in July. The test thread still
parks on {{miniCluster.requestJobResult(restoredJobGraph.getJobID()).get()}}
(line 138) until the watchdog kills the fork after 900 seconds without output.
Five runs on master in the last seven days, all including the fix:
https://github.com/apache/flink/actions/runs/35414462164/job/105822884214
(nightly 2026-09-19, Hadoop 3.4.3)
https://github.com/apache/flink/actions/runs/35482928089/job/106004627204
(nightly 2026-09-20, Java 11)
https://github.com/apache/flink/actions/runs/35577002100/job/106263398626 (push
2026-09-21, Java 17)
https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=79325&view=logs&j=8fd9202e-fd17-5b26-353c-ac1ff76c8f28
(nightly 2026-09-22, AdaptiveScheduler)
https://github.com/apache/flink/actions/runs/35945605031/job/107464814781
(nightly 2026-09-24, Java 21)
{code}
Process produced no output for 900 seconds.
...
"ForkJoinPool-1-worker-1" #28 [27552] daemon prio=5 os_prio=0 cpu=3038.12ms
elapsed=4929.99s tid=0x00007f78f00a1200 nid=27552 waiting on condition
java.lang.Thread.State: WAITING (parking)
at
java.util.concurrent.CompletableFuture.get([email protected]/CompletableFuture.java:2072)
at
org.apache.flink.test.checkpointing.CheckpointAfterAllTasksFinishedITCase.testRestoreAfterSomeTasksFinished(CheckpointAfterAllTasksFinishedITCase.java:138)
{code}
In the thread dumps the restored job has one source subtask parked in
{{StreamTask.afterInvoke}} and four pass -> sink subtasks parked in the mailbox
loop. The release branches don't have 0ecc34d3bb5 and did not hit the hang in
the same week.
> CheckpointAfterAllTasksFinishedITCase.testRestoreAfterSomeTasksFinished
> fails on AZP
> -------------------------------------------------------------------------------------
>
> Key: FLINK-33186
> URL: https://issues.apache.org/jira/browse/FLINK-33186
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Checkpointing
> Affects Versions: 1.19.0, 1.18.1, 2.4.0
> Reporter: Sergey Nuyanzin
> Assignee: Efrat Levitan
> Priority: Critical
> Labels: pull-request-available, test-stability
> Fix For: 2.4.0
>
>
> This build
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=53509&view=logs&j=baf26b34-3c6a-54e8-f93f-cf269b32f802&t=8c9d126d-57d2-5a9e-a8c8-ff53f7b35cd9&l=8762
> fails as
> {noformat}
> Sep 28 01:23:43 Caused by:
> org.apache.flink.runtime.checkpoint.CheckpointException: Task local
> checkpoint failure.
> Sep 28 01:23:43 at
> org.apache.flink.runtime.checkpoint.PendingCheckpoint.abort(PendingCheckpoint.java:550)
> Sep 28 01:23:43 at
> org.apache.flink.runtime.checkpoint.CheckpointCoordinator.abortPendingCheckpoint(CheckpointCoordinator.java:2248)
> Sep 28 01:23:43 at
> org.apache.flink.runtime.checkpoint.CheckpointCoordinator.abortPendingCheckpoint(CheckpointCoordinator.java:2235)
> Sep 28 01:23:43 at
> org.apache.flink.runtime.checkpoint.CheckpointCoordinator.lambda$null$9(CheckpointCoordinator.java:817)
> Sep 28 01:23:43 at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> Sep 28 01:23:43 at
> java.util.concurrent.FutureTask.run(FutureTask.java:266)
> Sep 28 01:23:43 at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
> Sep 28 01:23:43 at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
> Sep 28 01:23:43 at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> Sep 28 01:23:43 at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> Sep 28 01:23:43 at java.lang.Thread.run(Thread.java:748)
> {noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
