fredia commented on code in PR #24766: URL: https://github.com/apache/flink/pull/24766#discussion_r1598208386
########## docs/content/docs/dev/datastream/fault-tolerance/checkpointing.md: ########## @@ -292,4 +292,25 @@ The final checkpoint would be triggered immediately after all operators have rea without waiting for periodic triggering, but the job will need to wait for this final checkpoint to be completed. +## Unify file merging mechanism for checkpoints + +Flink 1.20 introduces a unified file merging mechanism for checkpointing, which allows scattered small checkpoint files +to be written into a single file, reducing the number of file creations and file deletions, helping to alleviate the pressure +of file system metadata management and file flooding problem. The unified fie merging mechanism can be enabled by setting +the property `state.checkpoints.file-merging.enabled` to `true`. **Note** that enabling this mechanism may lead to space amplification, +that is, the actual occupation on the file system will be larger than the checkpoint size. `state.checkpoints.file-merging.max-space-amplification` Review Comment: Right, thanks for the suggestion, I adjusted it as `actual state size`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
