[
https://issues.apache.org/jira/browse/FLINK-25191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Piotr Nowojski updated FLINK-25191:
-----------------------------------
Description:
Intermediate savepoints should not be used for recovery. In order to achieve
that we should:
* do not send {{notifyCheckpointComplete}} for intermediate savepoints
* do not add them to {{CompletedCheckpointStore}}
Important! Synchronous savepoints (stop-with-savepoint) should still commit
side-effects. We need to distinguish them from the intermediate savepoints.
https://cwiki.apache.org/confluence/x/bIyqCw#FLIP193:Snapshotsownership-SkippingSavepointsforRecovery
Document recommendation to drop (change UID) the external state (like
transactions from two phase commit sinks) if starting multiple jobs from the
same intermediate savepoint.
was:
Intermediate savepoints should not be used for recovery. In order to achieve
that we should:
* do not send {{notifyCheckpointComplete}} for intermediate savepoints
* do not add them to {{CompletedCheckpointStore}}
Important! Synchronous savepoints (stop-with-savepoint) should still commit
side-effects. We need to distinguish them from the intermediate savepoints.
https://cwiki.apache.org/confluence/x/bIyqCw#FLIP193:Snapshotsownership-SkippingSavepointsforRecovery
Document recommendation to drop the sink's state if starting multiple jobs from
the same intermediate savepoint.
> Skip savepoints for recovery
> ----------------------------
>
> Key: FLINK-25191
> URL: https://issues.apache.org/jira/browse/FLINK-25191
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / Checkpointing
> Reporter: Dawid Wysakowicz
> Priority: Major
> Fix For: 1.15.0
>
>
> Intermediate savepoints should not be used for recovery. In order to achieve
> that we should:
> * do not send {{notifyCheckpointComplete}} for intermediate savepoints
> * do not add them to {{CompletedCheckpointStore}}
> Important! Synchronous savepoints (stop-with-savepoint) should still commit
> side-effects. We need to distinguish them from the intermediate savepoints.
> https://cwiki.apache.org/confluence/x/bIyqCw#FLIP193:Snapshotsownership-SkippingSavepointsforRecovery
> Document recommendation to drop (change UID) the external state (like
> transactions from two phase commit sinks) if starting multiple jobs from the
> same intermediate savepoint.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
