[jira] [Updated] (FLINK-14344) Snapshot master hook state asynchronously
[ https://issues.apache.org/jira/browse/FLINK-14344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Biao Liu updated FLINK-14344: - Release Note: Makes the semantic of MasterTriggerRestoreHook#triggerCheckpoint more clearer. It should be non-blocking, Any heavy operation should be executed asynchronously with given executor. (was: Makes the semantic of {{MasterTriggerRestoreHook#triggerCheckpoint}} more clearer. It should be non-blocking, Any heavy operation should be executed asynchronously with given executor.) > Snapshot master hook state asynchronously > - > > Key: FLINK-14344 > URL: https://issues.apache.org/jira/browse/FLINK-14344 > Project: Flink > Issue Type: Sub-task > Components: Runtime / Checkpointing >Reporter: Biao Liu >Assignee: Biao Liu >Priority: Major > Labels: pull-request-available > Fix For: 1.10.0 > > Time Spent: 10m > Remaining Estimate: 0h > > Currently we snapshot the master hook state synchronously. As a part of > reworking threading model of {{CheckpointCoordinator}}, we have to make this > non-blocking to satisfy the requirement of running in main thread. > The behavior of snapshotting master hook state is similar to task state > snapshotting. Master state snapshotting is taken before task state > snapshotting. Because in master hook, there might be external system > initialization which task state snapshotting might depend on. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-14344) Snapshot master hook state asynchronously
[ https://issues.apache.org/jira/browse/FLINK-14344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Biao Liu updated FLINK-14344: - Release Note: Makes the semantic of {{MasterTriggerRestoreHook#triggerCheckpoint}} more clearer. It should be non-blocking, Any heavy operation should be executed asynchronously with given executor. > Snapshot master hook state asynchronously > - > > Key: FLINK-14344 > URL: https://issues.apache.org/jira/browse/FLINK-14344 > Project: Flink > Issue Type: Sub-task > Components: Runtime / Checkpointing >Reporter: Biao Liu >Assignee: Biao Liu >Priority: Major > Labels: pull-request-available > Fix For: 1.10.0 > > Time Spent: 10m > Remaining Estimate: 0h > > Currently we snapshot the master hook state synchronously. As a part of > reworking threading model of {{CheckpointCoordinator}}, we have to make this > non-blocking to satisfy the requirement of running in main thread. > The behavior of snapshotting master hook state is similar to task state > snapshotting. Master state snapshotting is taken before task state > snapshotting. Because in master hook, there might be external system > initialization which task state snapshotting might depend on. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-14344) Snapshot master hook state asynchronously
[ https://issues.apache.org/jira/browse/FLINK-14344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-14344: --- Labels: pull-request-available (was: ) > Snapshot master hook state asynchronously > - > > Key: FLINK-14344 > URL: https://issues.apache.org/jira/browse/FLINK-14344 > Project: Flink > Issue Type: Sub-task > Components: Runtime / Checkpointing >Reporter: Biao Liu >Assignee: Biao Liu >Priority: Major > Labels: pull-request-available > Fix For: 1.10.0 > > > Currently we snapshot the master hook state synchronously. As a part of > reworking threading model of {{CheckpointCoordinator}}, we have to make this > non-blocking to satisfy the requirement of running in main thread. > The behavior of snapshotting master hook state is similar to task state > snapshotting. Master state snapshotting is taken before task state > snapshotting. Because in master hook, there might be external system > initialization which task state snapshotting might depend on. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-14344) Snapshot master hook state asynchronously
[ https://issues.apache.org/jira/browse/FLINK-14344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Biao Liu updated FLINK-14344: - Description: Currently we snapshot the master hook state synchronously. As a part of reworking threading model of {{CheckpointCoordinator}}, we have to make this non-blocking to satisfy the requirement of running in main thread. The behavior of snapshotting master hook state is similar to task state snapshotting. Master state snapshotting is taken before task state snapshotting. Because in master hook, there might be external system initialization which task state snapshotting might depend on. was: Currently we snapshot the master hook state synchronously. As a part of reworking threading model of {{CheckpointCoordinator}}, we have to make this non-blocking to satisfy the requirement of running in main thread. The behavior of snapshotting master hook state is similar to task state snapshotting. Master state snapshotting is taken before task state snapshotting. Because in master hook, there might be external system initialization which task state snapshotting might depends on. > Snapshot master hook state asynchronously > - > > Key: FLINK-14344 > URL: https://issues.apache.org/jira/browse/FLINK-14344 > Project: Flink > Issue Type: Sub-task > Components: Runtime / Checkpointing >Reporter: Biao Liu >Priority: Major > Fix For: 1.10.0 > > > Currently we snapshot the master hook state synchronously. As a part of > reworking threading model of {{CheckpointCoordinator}}, we have to make this > non-blocking to satisfy the requirement of running in main thread. > The behavior of snapshotting master hook state is similar to task state > snapshotting. Master state snapshotting is taken before task state > snapshotting. Because in master hook, there might be external system > initialization which task state snapshotting might depend on. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-14344) Snapshot master hook state asynchronously
[ https://issues.apache.org/jira/browse/FLINK-14344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Biao Liu updated FLINK-14344: - Description: Currently we snapshot the master hook state synchronously. As a part of reworking threading model of {{CheckpointCoordinator}}, we have to make this non-blocking to satisfy the requirement of running in main thread. The behavior of snapshotting master hook state is similar to task state snapshotting. Master state snapshotting is taken before task state snapshotting. Because in master hook, there might be external system initialization which task state snapshotting might depends on. was: Currently we snapshot the master hook state synchronously. As a part of reworking threading model of {{CheckpointCoordinator}}, we have to make this non-blocking to satisfy the requirement of running in main thread. The behavior of snapshotting master hook state should be similar to task state snapshotting. It should be launched after \{{PendingCheckpoint}} created. It could complete or fail the {{PendingCheckpoint}} like task state snapshotting. > Snapshot master hook state asynchronously > - > > Key: FLINK-14344 > URL: https://issues.apache.org/jira/browse/FLINK-14344 > Project: Flink > Issue Type: Sub-task > Components: Runtime / Checkpointing >Reporter: Biao Liu >Priority: Major > Fix For: 1.10.0 > > > Currently we snapshot the master hook state synchronously. As a part of > reworking threading model of {{CheckpointCoordinator}}, we have to make this > non-blocking to satisfy the requirement of running in main thread. > The behavior of snapshotting master hook state is similar to task state > snapshotting. Master state snapshotting is taken before task state > snapshotting. Because in master hook, there might be external system > initialization which task state snapshotting might depends on. -- This message was sent by Atlassian Jira (v8.3.4#803005)