Usamah Jassat created FLINK-28539: ------------------------------------- Summary: Enable CompactionDynamicLevelBytes in FLASH_SSD_OPTIMIZED Key: FLINK-28539 URL: https://issues.apache.org/jira/browse/FLINK-28539 Project: Flink Issue Type: Improvement Components: Runtime / State Backends Reporter: Usamah Jassat
Investigating the RocksDB predefined options I see that `setLevelCompactionDynamicLevelBytes` is set for SPINNING_DISK options but not FLASH_SSD_OPTIMIZED. >From my research it looks like this change would improve the Space >Amplification of RocksDB [1] (which can also lead to a trade-off from >read/write amplification [2]). It makes sense to me that this feature should >be enabled for SSD's as they tend to have less space compared to their HDD >counterparts. There is also an argument to be made to also disable it for SPINNING_DISK options as it could give increased read/write performance [2] [1] [http://rocksdb.org/blog/2015/07/23/dynamic-level.html] [2] [https://github.com/EighteenZi/rocksdb_wiki/blob/master/RocksDB-Tuning-Guide.md#amplification-factors] -- This message was sent by Atlassian Jira (v8.20.10#820010)