Jingsong Lee created FLINK-31252: ------------------------------------ Summary: Improve StaticFileStoreSplitEnumerator to assign batch splits Key: FLINK-31252 URL: https://issues.apache.org/jira/browse/FLINK-31252 Project: Flink Issue Type: Improvement Components: Table Store Reporter: Jingsong Lee Assignee: Jingsong Lee Fix For: table-store-0.4.0
{code:java} // The following batch assignment operation is for two things: // 1. It can be evenly distributed during batch reading to avoid scheduling problems (for // example, the current resource can only schedule part of the tasks) that cause some tasks // to fail to read data. // 2. Read with limit, if split is assigned one by one, it may cause the task to repeatedly // create SplitFetchers. After the task is created, it is found that it is idle and then // closed. Then, new split coming, it will create SplitFetcher and repeatedly read the data // of the limit number (the limit status is in the SplitFetcher). {code} -- This message was sent by Atlassian Jira (v8.20.10#820010)