[ https://issues.apache.org/jira/browse/FLINK-33819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17796992#comment-17796992 ]
Hangxiang Yu commented on FLINK-33819: -------------------------------------- Linked FLINK-20684 as it has been discussed before. Linked FLINK-11313 which talks about the LZ4 Compression which should be more usable than Snappy. IMO, it should improve performane if we disbale the compression of L0/L1 in some scenes. [~mayuehappy] Do you have some test results on it ? BTW, If we'd like to introduce such a option, it's better to guarantee the compalibility. > Support setting CompressType in RocksDBStateBackend > --------------------------------------------------- > > Key: FLINK-33819 > URL: https://issues.apache.org/jira/browse/FLINK-33819 > Project: Flink > Issue Type: Improvement > Components: Runtime / State Backends > Affects Versions: 1.18.0 > Reporter: Yue Ma > Priority: Major > Fix For: 1.19.0 > > Attachments: image-2023-12-14-11-32-32-968.png, > image-2023-12-14-11-35-22-306.png > > > Currently, RocksDBStateBackend does not support setting the compression > level, and Snappy is used for compression by default. But we have some > scenarios where compression will use a lot of CPU resources. Turning off > compression can significantly reduce CPU overhead. So we may need to support > a parameter for users to set the CompressType of Rocksdb. > !image-2023-12-14-11-35-22-306.png! -- This message was sent by Atlassian Jira (v8.20.10#820010)