[jira] [Updated] (FLINK-34984) FLIP-423: Disaggregated State Storage and Management (Umbrella FLIP)

2024-04-01 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-34984: - Description: The past decade has witnessed a dramatic shift in Flink's deployment mode, workload patter

[jira] [Updated] (FLINK-34984) FLIP-423: Disaggregated State Storage and Management (Umbrella FLIP)

2024-04-01 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-34984: - Description: The past decade has witnessed a dramatic shift in Flink's deployment mode, workload patter

[jira] [Updated] (FLINK-34984) FLIP-423: Disaggregated State Storage and Management (Umbrella FLIP)

2024-04-01 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-34984: - Description: The past decade has witnessed a dramatic shift in Flink's deployment mode, workload patter

[jira] [Updated] (FLINK-34984) Disaggregated State Storage and Management (Umbrella FLIP)

2024-04-01 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-34984: - Description: The past decade has witnessed a dramatic shift in Flink's deployment mode, workload pattern

[jira] [Created] (FLINK-34984) Disaggregated State Storage and Management (Umbrella FLIP)

2024-04-01 Thread Yuan Mei (Jira)
Yuan Mei created FLINK-34984: Summary: Disaggregated State Storage and Management (Umbrella FLIP) Key: FLINK-34984 URL: https://issues.apache.org/jira/browse/FLINK-34984 Project: Flink Issue Type

[jira] [Closed] (FLINK-32073) Implement file merging in snapshot

2024-01-22 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei closed FLINK-32073. Resolution: Done > Implement file merging in snapshot > -- > >

[jira] [Commented] (FLINK-32073) Implement file merging in snapshot

2024-01-22 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809461#comment-17809461 ] Yuan Mei commented on FLINK-32073: -- merged commit  [{{f9f9299}}|https://github.com/apac

[jira] [Commented] (FLINK-26490) Adjust the MaxParallelism or remove the MaxParallelism check when unnecessary.

2023-11-12 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17785394#comment-17785394 ] Yuan Mei commented on FLINK-26490: -- Sorry to respond late. Just saw this ticket recentl

[jira] [Closed] (FLINK-17916) Provide API to separate KafkaShuffle's Producer and Consumer to different jobs

2023-10-17 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei closed FLINK-17916. Resolution: Won't Do > Provide API to separate KafkaShuffle's Producer and Consumer to different jobs > --

[jira] [Commented] (FLINK-17916) Provide API to separate KafkaShuffle's Producer and Consumer to different jobs

2023-10-17 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17776099#comment-17776099 ] Yuan Mei commented on FLINK-17916: -- Yes, I think so. Thanks for reminding [~martijnviss

[jira] [Commented] (FLINK-33052) codespeed and benchmark server is down

2023-10-12 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17774779#comment-17774779 ] Yuan Mei commented on FLINK-33052: -- As the pipeline has been running daily, and the rep

[jira] [Comment Edited] (FLINK-33052) codespeed and benchmark server is down

2023-10-12 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17774779#comment-17774779 ] Yuan Mei edited comment on FLINK-33052 at 10/13/23 4:19 AM:

[jira] [Updated] (FLINK-33052) codespeed and benchmark server is down

2023-10-12 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-33052: - Affects Version/s: 1.19.0 (was: 1.18.0) > codespeed and benchmark server is d

[jira] [Comment Edited] (FLINK-33052) codespeed server is down

2023-09-13 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17764675#comment-17764675 ] Yuan Mei edited comment on FLINK-33052 at 9/13/23 2:14 PM: --- He

[jira] [Comment Edited] (FLINK-33052) codespeed server is down

2023-09-13 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17764675#comment-17764675 ] Yuan Mei edited comment on FLINK-33052 at 9/13/23 1:44 PM: --- He

[jira] [Comment Edited] (FLINK-33052) codespeed server is down

2023-09-13 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17764675#comment-17764675 ] Yuan Mei edited comment on FLINK-33052 at 9/13/23 1:41 PM: --- He

[jira] [Comment Edited] (FLINK-33052) codespeed server is down

2023-09-13 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17764675#comment-17764675 ] Yuan Mei edited comment on FLINK-33052 at 9/13/23 1:39 PM: --- He

[jira] [Comment Edited] (FLINK-33052) codespeed server is down

2023-09-13 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17764675#comment-17764675 ] Yuan Mei edited comment on FLINK-33052 at 9/13/23 1:35 PM: --- He

[jira] [Comment Edited] (FLINK-33052) codespeed server is down

2023-09-13 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17764675#comment-17764675 ] Yuan Mei edited comment on FLINK-33052 at 9/13/23 1:35 PM: --- He

[jira] [Comment Edited] (FLINK-33052) codespeed server is down

2023-09-13 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17764675#comment-17764675 ] Yuan Mei edited comment on FLINK-33052 at 9/13/23 1:31 PM: --- He

[jira] [Comment Edited] (FLINK-33052) codespeed server is down

2023-09-13 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17764675#comment-17764675 ] Yuan Mei edited comment on FLINK-33052 at 9/13/23 1:31 PM: --- He

[jira] [Comment Edited] (FLINK-33052) codespeed server is down

2023-09-13 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17764675#comment-17764675 ] Yuan Mei edited comment on FLINK-33052 at 9/13/23 1:31 PM: --- He

[jira] [Comment Edited] (FLINK-33052) codespeed server is down

2023-09-13 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17764675#comment-17764675 ] Yuan Mei edited comment on FLINK-33052 at 9/13/23 1:30 PM: --- He

[jira] [Commented] (FLINK-33052) codespeed server is down

2023-09-13 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17764675#comment-17764675 ] Yuan Mei commented on FLINK-33052: -- # I think this issue is very critical as you mentio

[jira] [Updated] (FLINK-33052) codespeed server is down

2023-09-13 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-33052: - Priority: Critical (was: Blocker) > codespeed server is down > > >

[jira] [Commented] (FLINK-33052) codespeed server is down

2023-09-13 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17764570#comment-17764570 ] Yuan Mei commented on FLINK-33052: -- [~pnowojski] We have the historical data backed up.

[jira] [Assigned] (FLINK-33052) codespeed server is down

2023-09-13 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei reassigned FLINK-33052: Assignee: Zakelly Lan (was: Yuan Mei) > codespeed server is down > > >

[jira] [Comment Edited] (FLINK-33052) codespeed server is down

2023-09-12 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17764484#comment-17764484 ] Yuan Mei edited comment on FLINK-33052 at 9/13/23 4:44 AM: --- Le

[jira] [Commented] (FLINK-33052) codespeed server is down

2023-09-12 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17764484#comment-17764484 ] Yuan Mei commented on FLINK-33052: -- Let me see whether i can get a new machine for this

[jira] [Assigned] (FLINK-33052) codespeed server is down

2023-09-12 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei reassigned FLINK-33052: Assignee: Yuan Mei (was: Yanfei Lei) > codespeed server is down > > >

[jira] [Updated] (FLINK-25842) [v2] FLIP-158: Generalized incremental checkpoints

2023-07-23 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-25842: - Description: Umbrella ticket for the 2nd iteration of [FLIP-158: Generalized incremental checkpoints|ht

[jira] [Comment Edited] (FLINK-25842) [v2] FLIP-158: Generalized incremental checkpoints

2023-07-23 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746065#comment-17746065 ] Yuan Mei edited comment on FLINK-25842 at 7/23/23 12:31 PM:

[jira] (FLINK-25842) [v2] FLIP-158: Generalized incremental checkpoints

2023-07-23 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25842 ] Yuan Mei deleted comment on FLINK-25842: -- was (Author: ym): The second half of Changelog is done in the 1.17 release.   There are two remaining tasks related to 1) DFS writer benchmarking and

[jira] [Commented] (FLINK-25842) [v2] FLIP-158: Generalized incremental checkpoints

2023-07-23 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746065#comment-17746065 ] Yuan Mei commented on FLINK-25842: -- The second half of Changelog is done in the 1.17 re

[jira] [Commented] (FLINK-25842) [v2] FLIP-158: Generalized incremental checkpoints

2023-07-23 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746064#comment-17746064 ] Yuan Mei commented on FLINK-25842: -- The second half of Changelog is done in the 1.17 re

[jira] [Resolved] (FLINK-25842) [v2] FLIP-158: Generalized incremental checkpoints

2023-07-23 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei resolved FLINK-25842. -- Resolution: Fixed Move the remaining two benchmarks to follow-ups.  > [v2] FLIP-158: Generalized incr

[jira] [Updated] (FLINK-23485) Add a benchmark for the Changelog DFS writer

2023-07-23 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-23485: - Parent Issue: FLINK-32651 (was: FLINK-25842) > Add a benchmark for the Changelog DFS writer > -

[jira] [Updated] (FLINK-32364) Add Rescaling benchmark for ChangelogStateBackend

2023-07-23 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32364: - Parent Issue: FLINK-32651 (was: FLINK-25842) > Add Rescaling benchmark for ChangelogStateBackend >

[jira] [Created] (FLINK-32651) Benchmark Support for Changelog Statebackend

2023-07-23 Thread Yuan Mei (Jira)
Yuan Mei created FLINK-32651: Summary: Benchmark Support for Changelog Statebackend Key: FLINK-32651 URL: https://issues.apache.org/jira/browse/FLINK-32651 Project: Flink Issue Type: Improvement

[jira] [Updated] (FLINK-32364) Add Rescaling benchmark for ChangelogStateBackend

2023-07-23 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32364: - Priority: Minor (was: Major) > Add Rescaling benchmark for ChangelogStateBackend >

[jira] [Assigned] (FLINK-28581) Test Changelog StateBackend V2 Manually

2023-07-23 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei reassigned FLINK-28581: Assignee: Hangxiang Yu > Test Changelog StateBackend V2 Manually > --

[jira] [Comment Edited] (FLINK-32485) Flink State Backend Changelog should support build test-jar

2023-06-29 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17738861#comment-17738861 ] Yuan Mei edited comment on FLINK-32485 at 6/30/23 3:34 AM: --- I

[jira] [Comment Edited] (FLINK-32485) Flink State Backend Changelog should support build test-jar

2023-06-29 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17738861#comment-17738861 ] Yuan Mei edited comment on FLINK-32485 at 6/30/23 3:34 AM: --- I

[jira] [Commented] (FLINK-32485) Flink State Backend Changelog should support build test-jar

2023-06-29 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17738861#comment-17738861 ] Yuan Mei commented on FLINK-32485: -- I can take a look   "test-jar" is usually used to

[jira] [Commented] (FLINK-32071) Implement the snapshot manager for merged checkpoint files in TM

2023-06-23 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17736556#comment-17736556 ] Yuan Mei commented on FLINK-32071: -- commit  [{{01560a1}}|https://github.com/apache/flin

[jira] [Closed] (FLINK-32071) Implement the snapshot manager for merged checkpoint files in TM

2023-06-23 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei closed FLINK-32071. Resolution: Done > Implement the snapshot manager for merged checkpoint files in TM >

[jira] [Updated] (FLINK-32092) Integrate snapshot file-merging with existing IT cases

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32092: - Affects Version/s: 1.18.0 > Integrate snapshot file-merging with existing IT cases > ---

[jira] [Updated] (FLINK-32092) Integrate snapshot file-merging with existing IT cases

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32092: - Component/s: Runtime / Checkpointing Runtime / State Backends > Integrate snapshot file

[jira] [Updated] (FLINK-32091) Add necessary metrics for file-merging

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32091: - Component/s: Runtime / Checkpointing Runtime / State Backends > Add necessary metrics f

[jira] [Updated] (FLINK-32091) Add necessary metrics for file-merging

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32091: - Affects Version/s: 1.18.0 > Add necessary metrics for file-merging > ---

[jira] [Updated] (FLINK-32090) Python API for enabling and configuring file merging snapshot

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32090: - Component/s: Runtime / Checkpointing Runtime / State Backends > Python API for enabling

[jira] [Updated] (FLINK-32087) Space amplification statistics of file merging

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32087: - Component/s: Runtime / Checkpointing Runtime / State Backends > Space amplification sta

[jira] [Updated] (FLINK-32090) Python API for enabling and configuring file merging snapshot

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32090: - Affects Version/s: 1.18.0 > Python API for enabling and configuring file merging snapshot >

[jira] [Updated] (FLINK-32089) Do fast copy in best-effort during first checkpoint after restoration

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32089: - Affects Version/s: 1.18.0 > Do fast copy in best-effort during first checkpoint after restoration >

[jira] [Updated] (FLINK-32089) Do fast copy in best-effort during first checkpoint after restoration

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32089: - Component/s: Runtime / Checkpointing Runtime / State Backends > Do fast copy in best-ef

[jira] [Updated] (FLINK-32088) Re-uploading in state file-merging for space amplification control

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32088: - Affects Version/s: 1.18.0 > Re-uploading in state file-merging for space amplification control > ---

[jira] [Updated] (FLINK-32087) Space amplification statistics of file merging

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32087: - Affects Version/s: 1.18.0 > Space amplification statistics of file merging > ---

[jira] [Updated] (FLINK-32088) Re-uploading in state file-merging for space amplification control

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32088: - Component/s: Runtime / Checkpointing Runtime / State Backends > Re-uploading in state f

[jira] [Updated] (FLINK-32086) Cleanup non-reported managed directory on exit of TM

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32086: - Component/s: Runtime / Checkpointing Runtime / State Backends > Cleanup non-reported ma

[jira] [Updated] (FLINK-32086) Cleanup non-reported managed directory on exit of TM

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32086: - Affects Version/s: 1.18.0 > Cleanup non-reported managed directory on exit of TM > -

[jira] [Updated] (FLINK-32085) Implement and migrate batch uploading in changelog files into the file merging framework

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32085: - Affects Version/s: 1.18.0 > Implement and migrate batch uploading in changelog files into the file > me

[jira] [Updated] (FLINK-32085) Implement and migrate batch uploading in changelog files into the file merging framework

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32085: - Component/s: Runtime / Checkpointing Runtime / State Backends > Implement and migrate b

[jira] [Updated] (FLINK-32083) Chinese translation of documentation of checkpoint file-merging

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32083: - Component/s: Runtime / Checkpointing Runtime / State Backends > Chinese translation of

[jira] [Updated] (FLINK-32084) Migrate current file merging of channel state into the file merging framework

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32084: - Affects Version/s: 1.18.0 > Migrate current file merging of channel state into the file merging framewor

[jira] [Updated] (FLINK-32084) Migrate current file merging of channel state into the file merging framework

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32084: - Component/s: Runtime / Checkpointing Runtime / State Backends > Migrate current file me

[jira] [Updated] (FLINK-32083) Chinese translation of documentation of checkpoint file-merging

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32083: - Affects Version/s: 1.18.0 > Chinese translation of documentation of checkpoint file-merging > --

[jira] [Updated] (FLINK-32082) Documentation of checkpoint file-merging

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32082: - Component/s: Runtime / Checkpointing Runtime / State Backends > Documentation of checkp

[jira] [Updated] (FLINK-32082) Documentation of checkpoint file-merging

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32082: - Affects Version/s: 1.18.0 > Documentation of checkpoint file-merging > -

[jira] [Updated] (FLINK-32081) Compatibility between file-merging on and off across job runs

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32081: - Component/s: Runtime / Checkpointing Runtime / State Backends > Compatibility between f

[jira] [Updated] (FLINK-32081) Compatibility between file-merging on and off across job runs

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32081: - Affects Version/s: 1.18.0 > Compatibility between file-merging on and off across job runs >

[jira] [Updated] (FLINK-32080) Restoration of FileMergingSnapshotManager

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32080: - Component/s: Runtime / Checkpointing Runtime / State Backends > Restoration of FileMerg

[jira] [Updated] (FLINK-32080) Restoration of FileMergingSnapshotManager

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32080: - Affects Version/s: 1.18.0 > Restoration of FileMergingSnapshotManager >

[jira] [Updated] (FLINK-32079) Read/write checkpoint metadata of merged files

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32079: - Affects Version/s: 1.18.0 > Read/write checkpoint metadata of merged files > ---

[jira] [Updated] (FLINK-32079) Read/write checkpoint metadata of merged files

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32079: - Component/s: Runtime / Checkpointing Runtime / State Backends > Read/write checkpoint m

[jira] [Updated] (FLINK-32078) Implement private state file merging

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32078: - Component/s: Runtime / Checkpointing Runtime / State Backends > Implement private state

[jira] [Updated] (FLINK-32077) Implement shared state file merging

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32077: - Component/s: Runtime / Checkpointing Runtime / State Backends > Implement shared state

[jira] [Updated] (FLINK-32077) Implement shared state file merging

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32077: - Affects Version/s: 1.18.0 > Implement shared state file merging > --- >

[jira] [Updated] (FLINK-32078) Implement private state file merging

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32078: - Affects Version/s: 1.18.0 > Implement private state file merging >

[jira] [Updated] (FLINK-32076) Add file pool for concurrent file reusing

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32076: - Affects Version/s: 1.18.0 > Add file pool for concurrent file reusing >

[jira] [Updated] (FLINK-32076) Add file pool for concurrent file reusing

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32076: - Component/s: Runtime / Checkpointing Runtime / State Backends > Add file pool for concu

[jira] [Updated] (FLINK-32074) Support file merging across checkpoints

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32074: - Component/s: Runtime / Checkpointing Runtime / State Backends > Support file merging ac

[jira] [Updated] (FLINK-32075) Delete merged files on checkpoint abort

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32075: - Component/s: Runtime / Checkpointing Runtime / State Backends > Delete merged files on

[jira] [Updated] (FLINK-32075) Delete merged files on checkpoint abort

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32075: - Affects Version/s: 1.18.0 > Delete merged files on checkpoint abort > --

[jira] [Updated] (FLINK-32074) Support file merging across checkpoints

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32074: - Affects Version/s: 1.18.0 > Support file merging across checkpoints > --

[jira] [Updated] (FLINK-32073) Implement file merging in snapshot

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32073: - Component/s: Runtime / Checkpointing Runtime / State Backends > Implement file merging

[jira] [Updated] (FLINK-32073) Implement file merging in snapshot

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32073: - Affects Version/s: 1.18.0 > Implement file merging in snapshot > -- > >

[jira] [Updated] (FLINK-32073) Implement file merging in snapshot

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32073: - Fix Version/s: 1.18.0 > Implement file merging in snapshot > -- > >

[jira] [Updated] (FLINK-32072) Create and wire FileMergingSnapshotManager with TaskManagerServices

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32072: - Component/s: Runtime / Checkpointing Runtime / State Backends > Create and wire FileMer

[jira] [Updated] (FLINK-32072) Create and wire FileMergingSnapshotManager with TaskManagerServices

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32072: - Affects Version/s: 1.18.0 > Create and wire FileMergingSnapshotManager with TaskManagerServices > --

[jira] [Updated] (FLINK-32071) Implement the snapshot manager for merged checkpoint files in TM

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32071: - Component/s: Runtime / Checkpointing Runtime / State Backends > Implement the snapshot

[jira] [Updated] (FLINK-32071) Implement the snapshot manager for merged checkpoint files in TM

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32071: - Affects Version/s: 1.18.0 > Implement the snapshot manager for merged checkpoint files in TM > -

[jira] [Updated] (FLINK-32070) FLIP-306 Unified File Merging Mechanism for Checkpoints

2023-05-14 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-32070: - Component/s: Runtime / Checkpointing Runtime / State Backends Affects Ve

[jira] [Resolved] (FLINK-30729) AggregateITCase generates stacktraces of IllegalStateExceptions in Maven output but doesn't fail

2023-04-24 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei resolved FLINK-30729. -- Resolution: Fixed > AggregateITCase generates stacktraces of IllegalStateExceptions in Maven > output

[jira] [Commented] (FLINK-30729) AggregateITCase generates stacktraces of IllegalStateExceptions in Maven output but doesn't fail

2023-04-24 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17715819#comment-17715819 ] Yuan Mei commented on FLINK-30729: -- merged commit  [{{4ca3604}}|https://github.com/apac

[jira] [Updated] (FLINK-30729) AggregateITCase generates stacktraces of IllegalStateExceptions in Maven output but doesn't fail

2023-04-24 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-30729: - Fix Version/s: 1.17.1 > AggregateITCase generates stacktraces of IllegalStateExceptions in Maven > outp

[jira] [Updated] (FLINK-30729) AggregateITCase generates stacktraces of IllegalStateExceptions in Maven output but doesn't fail

2023-04-24 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-30729: - Issue Type: Improvement (was: Bug) > AggregateITCase generates stacktraces of IllegalStateExceptions in

[jira] [Assigned] (FLINK-30729) AggregateITCase generates stacktraces of IllegalStateExceptions in Maven output but doesn't fail

2023-04-24 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei reassigned FLINK-30729: Assignee: Yanfei Lei > AggregateITCase generates stacktraces of IllegalStateExceptions in Maven

[jira] [Updated] (FLINK-23411) Expose Flink checkpoint details metrics

2023-02-28 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei updated FLINK-23411: - Fix Version/s: 1.18.0 > Expose Flink checkpoint details metrics > --

[jira] [Resolved] (FLINK-30916) RocksDBStateUploaderTest.testUploadedSstCanBeCleanedUp failed with assertion

2023-02-06 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuan Mei resolved FLINK-30916. -- Resolution: Duplicate > RocksDBStateUploaderTest.testUploadedSstCanBeCleanedUp failed with assertion >

[jira] [Commented] (FLINK-30916) RocksDBStateUploaderTest.testUploadedSstCanBeCleanedUp failed with assertion

2023-02-06 Thread Yuan Mei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17685033#comment-17685033 ] Yuan Mei commented on FLINK-30916: -- Resolved in FLINK-30461 > RocksDBStateUploaderTest

  1   2   3   4   5   6   7   8   >