[ https://issues.apache.org/jira/browse/FLINK-5138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
zhijiang updated FLINK-5138: ---------------------------- Summary: Add the interface in state backend to estimate memory by hint of state size in ResourceSpec (was: The StateBackend provides the method to estimate memory usage based on hint of state size in ResourceSpec) > Add the interface in state backend to estimate memory by hint of state size > in ResourceSpec > ------------------------------------------------------------------------------------------- > > Key: FLINK-5138 > URL: https://issues.apache.org/jira/browse/FLINK-5138 > Project: Flink > Issue Type: Sub-task > Components: State Backends, Checkpointing > Reporter: zhijiang > Assignee: zhijiang > > Users may specify the state size in *setResource* API, then the different > *StateBackend* implementation should roughly estimate the different kinds of > memory usages based on the state size. This part of estimate memory will be > aggregated with other memories in *ResourceSpec*. There are two advantages to > do this: > - For RocksDB backend, the proper memory setting for RocksDB can get better > performance in read and write. > - This estimate memory will be considered when requesting resource for > container, so the total memory usage will not exceed the container limit. -- This message was sent by Atlassian JIRA (v6.3.15#6346)