Re: [PR] [FLINK-34050][state] Clean up useless files in deleted ranges during rescaling for RocksdbStateBackend [flink]

2024-02-27 Thread via GitHub
StefanRRichter merged PR #24367: URL: https://github.com/apache/flink/pull/24367 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flin

Re: [PR] [FLINK-34050][state] Clean up useless files in deleted ranges during rescaling for RocksdbStateBackend [flink]

2024-02-26 Thread via GitHub
ljz2051 commented on PR #24367: URL: https://github.com/apache/flink/pull/24367#issuecomment-1965740854 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [FLINK-34050][state] Clean up useless files in deleted ranges during rescaling for RocksdbStateBackend [flink]

2024-02-26 Thread via GitHub
ljz2051 commented on code in PR #24367: URL: https://github.com/apache/flink/pull/24367#discussion_r1502571621 ## flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBIncrementalCheckpointUtils.java: ## @@ -153,13 +154,14

Re: [PR] [FLINK-34050][state] Clean up useless files in deleted ranges during rescaling for RocksdbStateBackend [flink]

2024-02-22 Thread via GitHub
StefanRRichter commented on code in PR #24367: URL: https://github.com/apache/flink/pull/24367#discussion_r1498971141 ## flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBIncrementalCheckpointUtils.java: ## @@ -153,13 +

Re: [PR] [FLINK-34050][state] Clean up useless files in deleted ranges during rescaling for RocksdbStateBackend [flink]

2024-02-22 Thread via GitHub
flinkbot commented on PR #24367: URL: https://github.com/apache/flink/pull/24367#issuecomment-1959065683 ## CI report: * e5e4c71c5902c3ce3e1dc43b17c4336483356904 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[PR] [FLINK-34050][state] Clean up useless files in deleted ranges during rescaling for RocksdbStateBackend [flink]

2024-02-22 Thread via GitHub
ljz2051 opened a new pull request, #24367: URL: https://github.com/apache/flink/pull/24367 ## What is the purpose of the change This pull request cleans up useless sst files within rocksdb during rescaling, which reclaims local disk space, reducing the space amplification problem cau