[jira] [Commented] (FLINK-35578) Release Frocksdb-8.10.0 official products

2024-09-26 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17884943#comment-17884943 ] Yue Ma commented on FLINK-35578: [~zakelly] It seems that almost all the tickets that ne

[jira] [Commented] (FLINK-35574) Setup base branch for FrocksDB-8.10

2024-09-26 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17884942#comment-17884942 ] Yue Ma commented on FLINK-35574: [~Zakelly] can you help mark this ticket as Resolved ? 

[jira] [Commented] (FLINK-36186) Speed up RocksDB close during manual compaction

2024-08-29 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-36186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17877960#comment-17877960 ] Yue Ma commented on FLINK-36186: I found that rocksdb does not have the JNI method for D

[jira] [Created] (FLINK-36186) Speed up RocksDB close during manual compaction

2024-08-29 Thread Yue Ma (Jira)
Yue Ma created FLINK-36186: -- Summary: Speed up RocksDB close during manual compaction Key: FLINK-36186 URL: https://issues.apache.org/jira/browse/FLINK-36186 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-35581) Remove comments from the code related to ingestDB

2024-08-29 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17877629#comment-17877629 ] Yue Ma commented on FLINK-35581: Now, we've updated the Frocksdb version to V8.10 , So I

[jira] [Commented] (FLINK-35575) FRocksDB supports disabling perf context during compilation

2024-08-06 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17871338#comment-17871338 ] Yue Ma commented on FLINK-35575: [~Zakelly]  Can you please help to take a look at this

[jira] [Comment Edited] (FLINK-35576) FRocksDB cherry pick IngestDB related commits

2024-07-22 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17867681#comment-17867681 ] Yue Ma edited comment on FLINK-35576 at 7/22/24 8:10 AM: - [~roma

[jira] [Commented] (FLINK-35576) FRocksDB cherry pick IngestDB related commits

2024-07-22 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17867681#comment-17867681 ] Yue Ma commented on FLINK-35576: update the pull request [https://github.com/ververica/f

[jira] [Commented] (FLINK-35576) FRocksDB cherry pick IngestDB related commits

2024-07-19 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17867252#comment-17867252 ] Yue Ma commented on FLINK-35576: [~roman] [~zakelly] I have read the descriptions of the

[jira] [Commented] (FLINK-35576) FRocksDB cherry pick IngestDB related commits

2024-07-15 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17866259#comment-17866259 ] Yue Ma commented on FLINK-35576: [~roman] I've finished the cherry-pick and fixed all th

[jira] [Commented] (FLINK-21436) Speed ​​up the restore of UnionListState

2024-07-11 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17865323#comment-17865323 ] Yue Ma commented on FLINK-21436: [~fanrui] Yes, i think you are right , Most of the oper

[jira] [Comment Edited] (FLINK-21436) Speed ​​up the restore of UnionListState

2024-07-11 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864966#comment-17864966 ] Yue Ma edited comment on FLINK-21436 at 7/11/24 8:45 AM: - [~fanr

[jira] [Comment Edited] (FLINK-21436) Speed ​​up the restore of UnionListState

2024-07-11 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864966#comment-17864966 ] Yue Ma edited comment on FLINK-21436 at 7/11/24 8:42 AM: - [~fanr

[jira] [Comment Edited] (FLINK-21436) Speed ​​up the restore of UnionListState

2024-07-11 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864966#comment-17864966 ] Yue Ma edited comment on FLINK-21436 at 7/11/24 8:42 AM: - [~fanr

[jira] [Commented] (FLINK-21436) Speed ​​up the restore of UnionListState

2024-07-11 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864966#comment-17864966 ] Yue Ma commented on FLINK-21436: [~fanrui] [~yunta] I just found this ticket , and has o

[jira] [Commented] (FLINK-35576) FRocksDB cherry pick IngestDB related commits

2024-07-11 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864949#comment-17864949 ] Yue Ma commented on FLINK-35576: [https://github.com/ververica/frocksdb/pull/77] [~Zake

[jira] [Comment Edited] (FLINK-35576) FRocksDB cherry pick IngestDB related commits

2024-07-10 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864520#comment-17864520 ] Yue Ma edited comment on FLINK-35576 at 7/10/24 12:00 PM: -- [~ro

[jira] [Comment Edited] (FLINK-35576) FRocksDB cherry pick IngestDB related commits

2024-07-10 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864520#comment-17864520 ] Yue Ma edited comment on FLINK-35576 at 7/10/24 7:54 AM: - [~roma

[jira] [Comment Edited] (FLINK-35576) FRocksDB cherry pick IngestDB related commits

2024-07-10 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864520#comment-17864520 ] Yue Ma edited comment on FLINK-35576 at 7/10/24 7:46 AM: - [~roma

[jira] [Commented] (FLINK-35576) FRocksDB cherry pick IngestDB related commits

2024-07-10 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17864520#comment-17864520 ] Yue Ma commented on FLINK-35576: [~roman] When I finished this cherry-pick, I found that

[jira] [Updated] (FLINK-35576) FRocksDB cherry pick IngestDB related commits

2024-07-04 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Ma updated FLINK-35576: --- Description: We support the API related to ingest DB in FRocksDb-8.10.0, but many of the fixes related to i

[jira] [Commented] (FLINK-35576) FRocksDB cherry pick IngestDB related commits

2024-07-02 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17862415#comment-17862415 ] Yue Ma commented on FLINK-35576: https://github.com/ververica/frocksdb/pull/77 > FRocks

[jira] [Commented] (FLINK-35575) FRocksDB supports disabling perf context during compilation

2024-07-02 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17862410#comment-17862410 ] Yue Ma commented on FLINK-35575: https://github.com/ververica/frocksdb/pull/76 > FRocks

[jira] [Commented] (FLINK-35574) Setup base branch for FrocksDB-8.10

2024-06-26 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17860327#comment-17860327 ] Yue Ma commented on FLINK-35574: [~Zakelly] Thanks for the reviewing . Can you please he

[jira] [Commented] (FLINK-35574) Setup base branch for FrocksDB-8.10

2024-06-23 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17859542#comment-17859542 ] Yue Ma commented on FLINK-35574: [~roman] If I don't fix these CIs inside this PR. I'm

[jira] [Comment Edited] (FLINK-35574) Setup base branch for FrocksDB-8.10

2024-06-23 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17859542#comment-17859542 ] Yue Ma edited comment on FLINK-35574 at 6/24/24 3:26 AM: - [~roma

[jira] [Updated] (FLINK-35574) Setup base branch for FrocksDB-8.10

2024-06-13 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Ma updated FLINK-35574: --- Description: As the first part of FLINK-35573, we need to prepare a base branch for FRocksDB-8.10.0 first.

[jira] [Comment Edited] (FLINK-35574) Setup base branch for FrocksDB-8.10

2024-06-12 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17854641#comment-17854641 ] Yue Ma edited comment on FLINK-35574 at 6/13/24 6:41 AM: - [~roma

[jira] [Commented] (FLINK-35574) Setup base branch for FrocksDB-8.10

2024-06-12 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17854641#comment-17854641 ] Yue Ma commented on FLINK-35574: [~roman]  can you please take a view this  PR https://

[jira] [Updated] (FLINK-35574) Setup base branch for FrocksDB-8.10

2024-06-12 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Ma updated FLINK-35574: --- Description: As the first part of FLINK-35573, we need to prepare a base branch for FRocksDB-8.10.0 first.

[jira] [Updated] (FLINK-35574) Setup base branch for FrocksDB-8.10

2024-06-12 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Ma updated FLINK-35574: --- Description: As the first part of FLINK-35573, we need to prepare a base branch for FRocksDB-8.10.0 first.

[jira] [Updated] (FLINK-35574) Setup base branch for FrocksDB-8.10

2024-06-12 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Ma updated FLINK-35574: --- Description: As the first part of FLINK-35573, we need to prepare a base branch for FRocksDB-8.10.0 first.

[jira] [Updated] (FLINK-35573) [FLIP-447] Upgrade FRocksDB from 6.20.3 to 8.10.0

2024-06-12 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Ma updated FLINK-35573: --- Description: The FLIP: [https://cwiki.apache.org/confluence/display/FLINK/FLIP-447%3A+Upgrade+FRocksDB+from

[jira] [Updated] (FLINK-35574) Setup base branch for FrocksDB-8.10

2024-06-12 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Ma updated FLINK-35574: --- Description: As the first part of FLINK-35573, we need to prepare a base branch for FRocksDB-8.10.0 first.

[jira] [Updated] (FLINK-35573) [FLIP-447] Upgrade FRocksDB from 6.20.3 to 8.10.0

2024-06-12 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Ma updated FLINK-35573: --- Description: The FLIP: [https://cwiki.apache.org/confluence/display/FLINK/FLIP-447%3A+Upgrade+FRocksDB+from

[jira] [Updated] (FLINK-35576) FRocksDB cherry pick IngestDB related commits

2024-06-12 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Ma updated FLINK-35576: --- Summary: FRocksDB cherry pick IngestDB related commits (was: FRocksdb cherry pick IngestDB related commits)

[jira] [Updated] (FLINK-35574) Setup base branch for FrocksDB-8.10

2024-06-12 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Ma updated FLINK-35574: --- Description: As the first part of FLINK-35573, we need to prepare a base branch for FRocksDB-8.10.0 first.

[jira] [Updated] (FLINK-35574) Setup base branch for FrocksDB-8.10

2024-06-12 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Ma updated FLINK-35574: --- Description: As the first part of FLINK-35573, we need to prepare a base branch for FRocksDB-8.10.0 first.

[jira] [Updated] (FLINK-35576) FRocksdb cherry pick IngestDB related commits

2024-06-12 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Ma updated FLINK-35576: --- Description: We support the API related to ingest DB in FRocksDb-8.10.0, but many of the fixes related to i

[jira] [Updated] (FLINK-35574) Setup base branch for FrocksDB-8.10

2024-06-12 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Ma updated FLINK-35574: --- Description: As the first part of FLINK-35573, we need to prepare a base branch for FRocksDB-8.10.0 first.

[jira] [Commented] (FLINK-33338) Bump FRocksDB version

2024-06-12 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-8?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17854337#comment-17854337 ] Yue Ma commented on FLINK-8: [~pnowojski] [~roman] [~srichter] As we discussed befor

[jira] [Created] (FLINK-35582) Marking ingestDB as the default recovery mode for rescaling

2024-06-12 Thread Yue Ma (Jira)
Yue Ma created FLINK-35582: -- Summary: Marking ingestDB as the default recovery mode for rescaling Key: FLINK-35582 URL: https://issues.apache.org/jira/browse/FLINK-35582 Project: Flink Issue Type:

[jira] [Created] (FLINK-35580) Fix ingestDB recovery mode related bugs

2024-06-12 Thread Yue Ma (Jira)
Yue Ma created FLINK-35580: -- Summary: Fix ingestDB recovery mode related bugs Key: FLINK-35580 URL: https://issues.apache.org/jira/browse/FLINK-35580 Project: Flink Issue Type: Sub-task Co

[jira] [Created] (FLINK-35581) Remove comments from the code related to ingestDB

2024-06-12 Thread Yue Ma (Jira)
Yue Ma created FLINK-35581: -- Summary: Remove comments from the code related to ingestDB Key: FLINK-35581 URL: https://issues.apache.org/jira/browse/FLINK-35581 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-35579) Update the FrocksDB version in FLINK

2024-06-12 Thread Yue Ma (Jira)
Yue Ma created FLINK-35579: -- Summary: Update the FrocksDB version in FLINK Key: FLINK-35579 URL: https://issues.apache.org/jira/browse/FLINK-35579 Project: Flink Issue Type: Sub-task Compo

[jira] [Created] (FLINK-35578) Release Frocksdb-8.10.0 official products

2024-06-12 Thread Yue Ma (Jira)
Yue Ma created FLINK-35578: -- Summary: Release Frocksdb-8.10.0 official products Key: FLINK-35578 URL: https://issues.apache.org/jira/browse/FLINK-35578 Project: Flink Issue Type: Sub-task

[jira] [Updated] (FLINK-35576) FRocksdb cherry pick IngestDB related commits

2024-06-12 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Ma updated FLINK-35576: --- Summary: FRocksdb cherry pick IngestDB related commits (was: FRocksdb Cherry pick IngestDB requires commit

[jira] [Updated] (FLINK-35574) Setup base branch for FrocksDB-8.10

2024-06-12 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Ma updated FLINK-35574: --- Summary: Setup base branch for FrocksDB-8.10 (was: Set up base branch for FrocksDB-8.10) > Setup base bran

[jira] [Created] (FLINK-35577) Setup the CI environment for FRocksDB-8.10

2024-06-12 Thread Yue Ma (Jira)
Yue Ma created FLINK-35577: -- Summary: Setup the CI environment for FRocksDB-8.10 Key: FLINK-35577 URL: https://issues.apache.org/jira/browse/FLINK-35577 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-35576) FRocksdb Cherry pick IngestDB requires commit

2024-06-12 Thread Yue Ma (Jira)
Yue Ma created FLINK-35576: -- Summary: FRocksdb Cherry pick IngestDB requires commit Key: FLINK-35576 URL: https://issues.apache.org/jira/browse/FLINK-35576 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-35575) FRocksDB supports disabling perf context during compilation

2024-06-12 Thread Yue Ma (Jira)
Yue Ma created FLINK-35575: -- Summary: FRocksDB supports disabling perf context during compilation Key: FLINK-35575 URL: https://issues.apache.org/jira/browse/FLINK-35575 Project: Flink Issue Type:

[jira] [Created] (FLINK-35574) Set up base branch for FrocksDB-8.10

2024-06-12 Thread Yue Ma (Jira)
Yue Ma created FLINK-35574: -- Summary: Set up base branch for FrocksDB-8.10 Key: FLINK-35574 URL: https://issues.apache.org/jira/browse/FLINK-35574 Project: Flink Issue Type: Sub-task Compo

[jira] [Created] (FLINK-35573) [FLIP-447] Upgrade FRocksDB from 6.20.3 to 8.10.0

2024-06-12 Thread Yue Ma (Jira)
Yue Ma created FLINK-35573: -- Summary: [FLIP-447] Upgrade FRocksDB from 6.20.3 to 8.10.0 Key: FLINK-35573 URL: https://issues.apache.org/jira/browse/FLINK-35573 Project: Flink Issue Type: Improvement

[jira] [Updated] (FLINK-35573) [FLIP-447] Upgrade FRocksDB from 6.20.3 to 8.10.0

2024-06-12 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Ma updated FLINK-35573: --- Description: The FLIP: [https://cwiki.apache.org/confluence/display/FLINK/FLIP-447%3A+Upgrade+FRocksDB+from

[jira] [Commented] (FLINK-34430) Akka frame size exceeded with many ByteStreamStateHandle being used

2024-02-17 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17818238#comment-17818238 ] Yue Ma commented on FLINK-34430: [~pnowojski] The reason for so many ssts here is that R

[jira] [Updated] (FLINK-34210) DefaultExecutionGraphBuilder#isCheckpointingEnabled may return Wrong Value when checkpoint disabled

2024-01-23 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Ma updated FLINK-34210: --- Description: The *DefaultExecutionGraphBuilder* will call  _{*}isCheckpointingEnabled{*}(JobGraph jobGraph)_

[jira] [Created] (FLINK-34210) DefaultExecutionGraphBuilder#isCheckpointingEnabled may return Wrong Value when checkpoint disabled

2024-01-23 Thread Yue Ma (Jira)
Yue Ma created FLINK-34210: -- Summary: DefaultExecutionGraphBuilder#isCheckpointingEnabled may return Wrong Value when checkpoint disabled Key: FLINK-34210 URL: https://issues.apache.org/jira/browse/FLINK-34210

[jira] [Commented] (FLINK-33819) Support setting CompressType in RocksDBStateBackend

2024-01-22 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17809419#comment-17809419 ] Yue Ma commented on FLINK-33819: [~pnowojski] [~masteryhx]  I conducted benchmark tests

[jira] [Commented] (FLINK-34050) Rocksdb state has space amplification after rescaling with DeleteRange

2024-01-10 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17805392#comment-17805392 ] Yue Ma commented on FLINK-34050: Hi [~lijinzhong]   Thanks for reporting this issue. We

[jira] [Updated] (FLINK-33337) Expose IngestDB and ClipDB in the official RocksDB API

2024-01-10 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Ma updated FLINK-7: --- Attachment: image-2024-01-11-12-03-14-308.png > Expose IngestDB and ClipDB in the official RocksDB API > ---

[jira] [Commented] (FLINK-33337) Expose IngestDB and ClipDB in the official RocksDB API

2024-01-10 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-7?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17805364#comment-17805364 ] Yue Ma commented on FLINK-7: Update: https://github.com/facebook/rocksdb/pull/12219

[jira] [Commented] (FLINK-33946) RocksDb sets setAvoidFlushDuringShutdown to true to speed up Task Cancel

2024-01-10 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17805355#comment-17805355 ] Yue Ma commented on FLINK-33946: [~masteryhx]  thanks , I would like to take this and  I

[jira] [Commented] (FLINK-33819) Support setting CompressType in RocksDBStateBackend

2024-01-10 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17805354#comment-17805354 ] Yue Ma commented on FLINK-33819: [~masteryhx]  thanks , I would like to take this and  I

[jira] [Commented] (FLINK-33946) RocksDb sets setAvoidFlushDuringShutdown to true to speed up Task Cancel

2024-01-09 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17805000#comment-17805000 ] Yue Ma commented on FLINK-33946: [~masteryhx]   could you please take a look at this tic

[jira] [Commented] (FLINK-33819) Support setting CompressType in RocksDBStateBackend

2024-01-09 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17804999#comment-17804999 ] Yue Ma commented on FLINK-33819: [~masteryhx]  [~pnowojski] [~srichter]  could you pleas

[jira] [Created] (FLINK-33946) RocksDb sets setAvoidFlushDuringShutdown to true to speed up Task Cancel

2023-12-26 Thread Yue Ma (Jira)
Yue Ma created FLINK-33946: -- Summary: RocksDb sets setAvoidFlushDuringShutdown to true to speed up Task Cancel Key: FLINK-33946 URL: https://issues.apache.org/jira/browse/FLINK-33946 Project: Flink

[jira] [Commented] (FLINK-33819) Support setting CompressType in RocksDBStateBackend

2023-12-18 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17798083#comment-17798083 ] Yue Ma commented on FLINK-33819: [~masteryhx] Thanks for replying. {quote}Linked FLINK-2

[jira] [Updated] (FLINK-33819) Support setting CompressType in RocksDBStateBackend

2023-12-13 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Ma updated FLINK-33819: --- Summary: Support setting CompressType in RocksDBStateBackend (was: Suppor setting CompressType in RocksDBSt

[jira] [Commented] (FLINK-27681) Improve the availability of Flink when the RocksDB file is corrupted.

2023-12-13 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17796527#comment-17796527 ] Yue Ma commented on FLINK-27681: [~pnowojski] Thanks for your suggestion, I think this i

[jira] [Updated] (FLINK-33819) Suppor setting CompressType in RocksDBStateBackend

2023-12-13 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Ma updated FLINK-33819: --- Description: Currently, RocksDBStateBackend does not support setting the compression level, and Snappy is u

[jira] [Updated] (FLINK-33819) Suppor setting CompressType in RocksDBStateBackend

2023-12-13 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Ma updated FLINK-33819: --- Attachment: image-2023-12-14-11-35-22-306.png > Suppor setting CompressType in RocksDBStateBackend > ---

[jira] [Created] (FLINK-33819) Suppor setting CompressType in RocksDBStateBackend

2023-12-13 Thread Yue Ma (Jira)
Yue Ma created FLINK-33819: -- Summary: Suppor setting CompressType in RocksDBStateBackend Key: FLINK-33819 URL: https://issues.apache.org/jira/browse/FLINK-33819 Project: Flink Issue Type: Improvemen

[jira] [Commented] (FLINK-33338) Bump FRocksDB version

2023-12-07 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-8?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17794507#comment-17794507 ] Yue Ma commented on FLINK-8: [~Yanfei Lei] Thank you very much for your help. What I

[jira] [Commented] (FLINK-27681) Improve the availability of Flink when the RocksDB file is corrupted.

2023-12-07 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17794505#comment-17794505 ] Yue Ma commented on FLINK-27681: {quote}And the corrupted file maybe just uploaded to re

[jira] [Commented] (FLINK-27681) Improve the availability of Flink when the RocksDB file is corrupted.

2023-12-05 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17793488#comment-17793488 ] Yue Ma commented on FLINK-27681: [~masteryhx] [~pnowojski] [~fanrui]  Thanks for the dis

[jira] [Commented] (FLINK-33672) Use MapState.entries() instead of keys() and get() in over window

2023-11-28 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17790464#comment-17790464 ] Yue Ma commented on FLINK-33672: Thanks to [~Zakelly]  for discovering this optimization

[jira] [Commented] (FLINK-27681) Improve the availability of Flink when the RocksDB file is corrupted.

2023-11-27 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17790359#comment-17790359 ] Yue Ma commented on FLINK-27681:   {quote}Fail job directly is fine for me, but I guess

[jira] [Commented] (FLINK-27681) Improve the availability of Flink when the RocksDB file is corrupted.

2023-11-27 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17789994#comment-17789994 ] Yue Ma commented on FLINK-27681: [~masteryhx] Thanks for the explaining , I agree with i

[jira] [Commented] (FLINK-27681) Improve the availability of Flink when the RocksDB file is corrupted.

2023-11-26 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17789892#comment-17789892 ] Yue Ma commented on FLINK-27681: Hi [~pnowojski] and [~fanrui] , thanks for your repiles

[jira] [Commented] (FLINK-27681) Improve the availability of Flink when the RocksDB file is corrupted.

2023-11-24 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17789390#comment-17789390 ] Yue Ma commented on FLINK-27681: [~fanrui] {quote}But I still don't know why the file is

[jira] [Commented] (FLINK-33338) Bump FRocksDB version

2023-11-23 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-8?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17789345#comment-17789345 ] Yue Ma commented on FLINK-8: [~pnowojski] Update:  Now All the changes we need are r

[jira] [Comment Edited] (FLINK-33338) Bump FRocksDB version

2023-11-23 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-8?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17789345#comment-17789345 ] Yue Ma edited comment on FLINK-8 at 11/24/23 6:49 AM: -- [~pn

[jira] [Commented] (FLINK-27681) Improve the availability of Flink when the RocksDB file is corrupted.

2023-11-21 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17788339#comment-17788339 ] Yue Ma commented on FLINK-27681: [~masteryhx] Sorry for the late reply, I submitted a dr

[jira] [Commented] (FLINK-33337) Expose IngestDB and ClipDB in the official RocksDB API

2023-11-08 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-7?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17783984#comment-17783984 ] Yue Ma commented on FLINK-7: [~pnowojski] yes ~ all of the required changes were mer

[jira] [Commented] (FLINK-33337) Expose IngestDB and ClipDB in the official RocksDB API

2023-11-06 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-7?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17783463#comment-17783463 ] Yue Ma commented on FLINK-7: Update: [https://github.com/facebook/rocksdb/pull/1164

[jira] [Commented] (FLINK-33337) Expose IngestDB and ClipDB in the official RocksDB API

2023-11-05 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-7?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17783089#comment-17783089 ] Yue Ma commented on FLINK-7: Update: [https://github.com/facebook/rocksdb/pull/11868

[jira] [Commented] (FLINK-26050) Too many small sst files in rocksdb state backend when using processing time window

2023-10-30 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17780918#comment-17780918 ] Yue Ma commented on FLINK-26050: [~wzqiang1332] I think may be you can try with Periodic

[jira] [Commented] (FLINK-27681) Improve the availability of Flink when the RocksDB file is corrupted.

2023-10-29 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17780811#comment-17780811 ] Yue Ma commented on FLINK-27681: [~masteryhx]   If we want to only check the checksum of

[jira] [Created] (FLINK-33126) Fix EventTimeAllWindowCheckpointingITCase jobName typo

2023-09-20 Thread Yue Ma (Jira)
Yue Ma created FLINK-33126: -- Summary: Fix EventTimeAllWindowCheckpointingITCase jobName typo Key: FLINK-33126 URL: https://issues.apache.org/jira/browse/FLINK-33126 Project: Flink Issue Type: Improv

[jira] [Updated] (FLINK-33126) Fix EventTimeAllWindowCheckpointingITCase jobName typo

2023-09-20 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Ma updated FLINK-33126: --- Issue Type: Bug (was: Improvement) > Fix EventTimeAllWindowCheckpointingITCase jobName typo > -

[jira] [Commented] (FLINK-27681) Improve the availability of Flink when the RocksDB file is corrupted.

2023-08-23 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17757850#comment-17757850 ] Yue Ma commented on FLINK-27681: [~masteryhx]  I'd like to contribute it I think there m

[jira] [Updated] (FLINK-27681) Improve the availability of Flink when the RocksDB file is corrupted.

2023-08-23 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Ma updated FLINK-27681: --- Attachment: image-2023-08-23-15-06-16-717.png > Improve the availability of Flink when the RocksDB file is c

[jira] [Commented] (FLINK-32833) Rocksdb CacheIndexAndFilterBlocks must be true when using shared memory

2023-08-12 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17753650#comment-17753650 ] Yue Ma commented on FLINK-32833: hi [~yunta]  thank you for your replying. I understand

[jira] [Created] (FLINK-32833) Rocksdb CacheIndexAndFilterBlocks must be true when using shared memory

2023-08-11 Thread Yue Ma (Jira)
Yue Ma created FLINK-32833: -- Summary: Rocksdb CacheIndexAndFilterBlocks must be true when using shared memory Key: FLINK-32833 URL: https://issues.apache.org/jira/browse/FLINK-32833 Project: Flink

[jira] [Updated] (FLINK-32833) Rocksdb CacheIndexAndFilterBlocks must be true when using shared memory

2023-08-11 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Ma updated FLINK-32833: --- Description: Currently in RocksDBResourceContainer#getColumnOptions, if sharedResources is used, blockBased

[jira] [Comment Edited] (FLINK-31238) Use IngestDB to speed up Rocksdb rescaling recovery

2023-08-08 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17752055#comment-17752055 ] Yue Ma edited comment on FLINK-31238 at 8/8/23 1:45 PM: [~pnowoj

[jira] [Comment Edited] (FLINK-31238) Use IngestDB to speed up Rocksdb rescaling recovery

2023-08-08 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17752055#comment-17752055 ] Yue Ma edited comment on FLINK-31238 at 8/8/23 1:43 PM: [~pnowoj

[jira] [Commented] (FLINK-31238) Use IngestDB to speed up Rocksdb rescaling recovery

2023-08-08 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17752055#comment-17752055 ] Yue Ma commented on FLINK-31238: [~pnowojski] [~srichter] [~yunta] [~masteryhx]  Sorry f

[jira] [Updated] (FLINK-31238) Use IngestDB to speed up Rocksdb rescaling recovery

2023-08-08 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Ma updated FLINK-31238: --- Attachment: image-2023-08-08-21-39-39-135.png > Use IngestDB to speed up Rocksdb rescaling recovery > -

[jira] [Updated] (FLINK-31238) Use IngestDB to speed up Rocksdb rescaling recovery

2023-08-08 Thread Yue Ma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Ma updated FLINK-31238: --- Attachment: image-2023-08-08-21-34-39-008.png > Use IngestDB to speed up Rocksdb rescaling recovery > -

  1   2   >