[ https://issues.apache.org/jira/browse/FLINK-32345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Stefan Richter closed FLINK-32345. ---------------------------------- Resolution: Fixed > Improve parallel download of RocksDB incremental state > ------------------------------------------------------ > > Key: FLINK-32345 > URL: https://issues.apache.org/jira/browse/FLINK-32345 > Project: Flink > Issue Type: Improvement > Components: Runtime / State Backends > Reporter: Stefan Richter > Assignee: Stefan Richter > Priority: Major > Labels: pull-request-available > Fix For: 1.18.0 > > > {{RocksDBStateDownloader}} is used to download the files for incremental > checkpoints in parallel. However, the parallelism is currently restricted to > a single {{IncrementalRemoteKeyedStateHandle}} and also a single state type > (shared, private) within the handle at a time. > We should support parallelization across multiple state types and across > multiple state handles. In particular, this can improve our download times > for scale-in. -- This message was sent by Atlassian Jira (v8.20.10#820010)