[jira] [Updated] (FLINK-18753) Support local recovery for Unaligned checkpoints
[ https://issues.apache.org/jira/browse/FLINK-18753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-18753: --- Fix Version/s: (was: 1.18.0) > Support local recovery for Unaligned checkpoints > > > Key: FLINK-18753 > URL: https://issues.apache.org/jira/browse/FLINK-18753 > Project: Flink > Issue Type: Improvement > Components: Runtime / Checkpointing, Runtime / Task >Affects Versions: 1.11.0 >Reporter: Roman Khachatryan >Priority: Minor > Labels: auto-deprioritized-major > > There is standard mechanism of writing two duplicating streams with state > data: to DFS and to local FS. On recovery, if local state is present and it > matches state on JM then it will be used (instead of downloading state from > DFS). > Currently, local recovery is not supported if running with Unaligned > checkpoints enabled. > To enable it, we need to > # write this second stream (see > CheckpointStreamWithResultProvider.getCheckpointOutputStream) > # make sure localState is included into the snapshot reported to JM > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (FLINK-18753) Support local recovery for Unaligned checkpoints
[ https://issues.apache.org/jira/browse/FLINK-18753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song updated FLINK-18753: - Fix Version/s: 1.18.0 (was: 1.17.0) > Support local recovery for Unaligned checkpoints > > > Key: FLINK-18753 > URL: https://issues.apache.org/jira/browse/FLINK-18753 > Project: Flink > Issue Type: Improvement > Components: Runtime / Checkpointing, Runtime / Task >Affects Versions: 1.11.0 >Reporter: Roman Khachatryan >Priority: Minor > Labels: auto-deprioritized-major > Fix For: 1.18.0 > > > There is standard mechanism of writing two duplicating streams with state > data: to DFS and to local FS. On recovery, if local state is present and it > matches state on JM then it will be used (instead of downloading state from > DFS). > Currently, local recovery is not supported if running with Unaligned > checkpoints enabled. > To enable it, we need to > # write this second stream (see > CheckpointStreamWithResultProvider.getCheckpointOutputStream) > # make sure localState is included into the snapshot reported to JM > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (FLINK-18753) Support local recovery for Unaligned checkpoints
[ https://issues.apache.org/jira/browse/FLINK-18753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Godfrey He updated FLINK-18753: --- Fix Version/s: 1.17.0 (was: 1.16.0) > Support local recovery for Unaligned checkpoints > > > Key: FLINK-18753 > URL: https://issues.apache.org/jira/browse/FLINK-18753 > Project: Flink > Issue Type: Improvement > Components: Runtime / Checkpointing, Runtime / Task >Affects Versions: 1.11.0 >Reporter: Roman Khachatryan >Priority: Minor > Labels: auto-deprioritized-major > Fix For: 1.17.0 > > > There is standard mechanism of writing two duplicating streams with state > data: to DFS and to local FS. On recovery, if local state is present and it > matches state on JM then it will be used (instead of downloading state from > DFS). > Currently, local recovery is not supported if running with Unaligned > checkpoints enabled. > To enable it, we need to > # write this second stream (see > CheckpointStreamWithResultProvider.getCheckpointOutputStream) > # make sure localState is included into the snapshot reported to JM > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (FLINK-18753) Support local recovery for Unaligned checkpoints
[ https://issues.apache.org/jira/browse/FLINK-18753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-18753: Fix Version/s: 1.16.0 > Support local recovery for Unaligned checkpoints > > > Key: FLINK-18753 > URL: https://issues.apache.org/jira/browse/FLINK-18753 > Project: Flink > Issue Type: Improvement > Components: Runtime / Checkpointing, Runtime / Task >Affects Versions: 1.11.0 >Reporter: Roman Khachatryan >Priority: Minor > Labels: auto-deprioritized-major > Fix For: 1.15.0, 1.16.0 > > > There is standard mechanism of writing two duplicating streams with state > data: to DFS and to local FS. On recovery, if local state is present and it > matches state on JM then it will be used (instead of downloading state from > DFS). > Currently, local recovery is not supported if running with Unaligned > checkpoints enabled. > To enable it, we need to > # write this second stream (see > CheckpointStreamWithResultProvider.getCheckpointOutputStream) > # make sure localState is included into the snapshot reported to JM > -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (FLINK-18753) Support local recovery for Unaligned checkpoints
[ https://issues.apache.org/jira/browse/FLINK-18753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song updated FLINK-18753: - Fix Version/s: (was: 1.14.0) 1.15.0 > Support local recovery for Unaligned checkpoints > > > Key: FLINK-18753 > URL: https://issues.apache.org/jira/browse/FLINK-18753 > Project: Flink > Issue Type: Improvement > Components: Runtime / Checkpointing, Runtime / Task >Affects Versions: 1.11.0 >Reporter: Roman Khachatryan >Priority: Minor > Labels: auto-deprioritized-major > Fix For: 1.15.0 > > > There is standard mechanism of writing two duplicating streams with state > data: to DFS and to local FS. On recovery, if local state is present and it > matches state on JM then it will be used (instead of downloading state from > DFS). > Currently, local recovery is not supported if running with Unaligned > checkpoints enabled. > To enable it, we need to > # write this second stream (see > CheckpointStreamWithResultProvider.getCheckpointOutputStream) > # make sure localState is included into the snapshot reported to JM > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-18753) Support local recovery for Unaligned checkpoints
[ https://issues.apache.org/jira/browse/FLINK-18753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-18753: --- Labels: auto-deprioritized-major (was: stale-major) Priority: Minor (was: Major) This issue was labeled "stale-major" 7 ago and has not received any updates so it is being deprioritized. If this ticket is actually Major, please raise the priority and ask a committer to assign you the issue or revive the public discussion. > Support local recovery for Unaligned checkpoints > > > Key: FLINK-18753 > URL: https://issues.apache.org/jira/browse/FLINK-18753 > Project: Flink > Issue Type: Improvement > Components: Runtime / Checkpointing, Runtime / Task >Affects Versions: 1.11.0 >Reporter: Roman Khachatryan >Priority: Minor > Labels: auto-deprioritized-major > Fix For: 1.14.0 > > > There is standard mechanism of writing two duplicating streams with state > data: to DFS and to local FS. On recovery, if local state is present and it > matches state on JM then it will be used (instead of downloading state from > DFS). > Currently, local recovery is not supported if running with Unaligned > checkpoints enabled. > To enable it, we need to > # write this second stream (see > CheckpointStreamWithResultProvider.getCheckpointOutputStream) > # make sure localState is included into the snapshot reported to JM > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-18753) Support local recovery for Unaligned checkpoints
[ https://issues.apache.org/jira/browse/FLINK-18753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dawid Wysakowicz updated FLINK-18753: - Fix Version/s: (was: 1.13.0) 1.14.0 > Support local recovery for Unaligned checkpoints > > > Key: FLINK-18753 > URL: https://issues.apache.org/jira/browse/FLINK-18753 > Project: Flink > Issue Type: Improvement > Components: Runtime / Checkpointing, Runtime / Task >Affects Versions: 1.11.0 >Reporter: Roman Khachatryan >Priority: Major > Labels: stale-major > Fix For: 1.14.0 > > > There is standard mechanism of writing two duplicating streams with state > data: to DFS and to local FS. On recovery, if local state is present and it > matches state on JM then it will be used (instead of downloading state from > DFS). > Currently, local recovery is not supported if running with Unaligned > checkpoints enabled. > To enable it, we need to > # write this second stream (see > CheckpointStreamWithResultProvider.getCheckpointOutputStream) > # make sure localState is included into the snapshot reported to JM > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-18753) Support local recovery for Unaligned checkpoints
[ https://issues.apache.org/jira/browse/FLINK-18753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-18753: --- Labels: stale-major (was: ) > Support local recovery for Unaligned checkpoints > > > Key: FLINK-18753 > URL: https://issues.apache.org/jira/browse/FLINK-18753 > Project: Flink > Issue Type: Improvement > Components: Runtime / Checkpointing, Runtime / Task >Affects Versions: 1.11.0 >Reporter: Roman Khachatryan >Priority: Major > Labels: stale-major > Fix For: 1.13.0 > > > There is standard mechanism of writing two duplicating streams with state > data: to DFS and to local FS. On recovery, if local state is present and it > matches state on JM then it will be used (instead of downloading state from > DFS). > Currently, local recovery is not supported if running with Unaligned > checkpoints enabled. > To enable it, we need to > # write this second stream (see > CheckpointStreamWithResultProvider.getCheckpointOutputStream) > # make sure localState is included into the snapshot reported to JM > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-18753) Support local recovery for Unaligned checkpoints
[ https://issues.apache.org/jira/browse/FLINK-18753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-18753: Fix Version/s: (was: 1.12.0) 1.13.0 > Support local recovery for Unaligned checkpoints > > > Key: FLINK-18753 > URL: https://issues.apache.org/jira/browse/FLINK-18753 > Project: Flink > Issue Type: Improvement > Components: Runtime / Checkpointing, Runtime / Task >Affects Versions: 1.11.0 >Reporter: Roman Khachatryan >Priority: Major > Fix For: 1.13.0 > > > There is standard mechanism of writing two duplicating streams with state > data: to DFS and to local FS. On recovery, if local state is present and it > matches state on JM then it will be used (instead of downloading state from > DFS). > Currently, local recovery is not supported if running with Unaligned > checkpoints enabled. > To enable it, we need to > # write this second stream (see > CheckpointStreamWithResultProvider.getCheckpointOutputStream) > # make sure localState is included into the snapshot reported to JM > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-18753) Support local recovery for Unaligned checkpoints
[ https://issues.apache.org/jira/browse/FLINK-18753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roman Khachatryan updated FLINK-18753: -- Description: There is standard mechanism of writing two duplicating streams with state data: to DFS and to local FS. On recovery, if local state is present and it matches state on JM then it will be used (instead of downloading state from DFS). Currently, local recovery is not supported if running with Unaligned checkpoints enabled. To enable it, we need to # write this second stream (see CheckpointStreamWithResultProvider.getCheckpointOutputStream) # make sure localState is included into the snapshot reported to JM > Support local recovery for Unaligned checkpoints > > > Key: FLINK-18753 > URL: https://issues.apache.org/jira/browse/FLINK-18753 > Project: Flink > Issue Type: Improvement > Components: Runtime / Checkpointing, Runtime / Task >Affects Versions: 1.11.0 >Reporter: Roman Khachatryan >Priority: Major > Fix For: 1.12.0 > > > There is standard mechanism of writing two duplicating streams with state > data: to DFS and to local FS. On recovery, if local state is present and it > matches state on JM then it will be used (instead of downloading state from > DFS). > Currently, local recovery is not supported if running with Unaligned > checkpoints enabled. > To enable it, we need to > # write this second stream (see > CheckpointStreamWithResultProvider.getCheckpointOutputStream) > # make sure localState is included into the snapshot reported to JM > -- This message was sent by Atlassian Jira (v8.3.4#803005)
