Jufang He created FLINK-34558: --------------------------------- Summary: Add RocksDB key/value size metrics Key: FLINK-34558 URL: https://issues.apache.org/jira/browse/FLINK-34558 Project: Flink Issue Type: Improvement Components: Runtime / State Backends Affects Versions: 1.19.0 Reporter: Jufang He
In some scenarios, the poor performance of RocksDB may be caused by too large key/value size, but now there is a lack of metrics for key/value size. By adding these metrics, we can conveniently calculate the distribution of key/value size, such as the average size and p99 size. To reduce the negative impact of adding metric on RocksDB performance, we could reduce the impact by supporting sampling. The possible implementation is as follows: After the RocksDB key/value serialization, we could obtain the byte array and report the size of the array through histogram metrics. -- This message was sent by Atlassian Jira (v8.20.10#820010)