[ 
https://issues.apache.org/jira/browse/FLINK-40200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Efrat Levitan updated FLINK-40200:
----------------------------------
    Summary: Introduce sync phase timeout for TaskManagers locking up in 
org.rocksdb.Checkpoint.createCheckpoint  (was: Introduce sync phase timeout to 
for TaskManagers locking up in org.rocksdb.Checkpoint.createCheckpoint)

> Introduce sync phase timeout for TaskManagers locking up in 
> org.rocksdb.Checkpoint.createCheckpoint
> ---------------------------------------------------------------------------------------------------
>
>                 Key: FLINK-40200
>                 URL: https://issues.apache.org/jira/browse/FLINK-40200
>             Project: Flink
>          Issue Type: Improvement
>          Components: Runtime / Checkpointing
>    Affects Versions: 2.3.0
>            Reporter: Efrat Levitan
>            Assignee: Efrat Levitan
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 2.4.0
>
>
> With TMs blocked by rocksdb native calls, jobs might hang for 
> \{execution.checkpointing.timeout} X 
> (\{execution.checkpointing.tolerable-failed-checkpoints} + 1) which can 
> result in days without progress before JM issues a job restart and cancels 
> the blocked task
> We experience this internally and constantly need to bump TM pods while this 
> could be otherwise handled automatically by setting a lower timeout on the 
> sync phase part of the checkpoint



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to