Sihua Zhou created FLINK-8790: --------------------------------- Summary: Improve performance for recovery from incremental checkpoint Key: FLINK-8790 URL: https://issues.apache.org/jira/browse/FLINK-8790 Project: Flink Issue Type: Improvement Components: State Backends, Checkpointing Affects Versions: 1.5.0 Reporter: Sihua Zhou Assignee: Sihua Zhou Fix For: 1.5.0
When there are multi state handle to be restored, we can improve the performance as follow: 1. Choose the best state handle to init the target db 2. Use the other state handles to create temp db, and clip the db according to the target key group range (via rocksdb.deleteRange()), this can help use get rid of the `key group check` in `data insertion loop` and also help us get rid of traversing the useless record. -- This message was sent by Atlassian JIRA (v7.6.3#76005)