Fang Yong created FLINK-32643:
---------------------------------
Summary: Introduce off-heap shared state cache across stateful
operators in TM
Key: FLINK-32643
URL: https://issues.apache.org/jira/browse/FLINK-32643
Project: Flink
Issue Type: Improvement
Components: Runtime / State Backends
Affects Versions: 1.19.0
Reporter: Fang Yong
Currently each stateful operator will create an independent db instance if it
uses rocksdb as state backend, and we can configure
`state.backend.rocksdb.block.cache-size` for each db to speed up state
performance. This parameter defaults to 8M, and we cannot set it too large,
such as 512M, this may cause OOM and each DB cannot effectively utilize memory.
To address this issue, we would like to introduce off-heap shared state cache
across multiple db instances for stateful operators in TM.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)