Weijie Guo created FLINK-30902: ---------------------------------- Summary: Partition reuse does not take effect on edges of hybrid selective type Key: FLINK-30902 URL: https://issues.apache.org/jira/browse/FLINK-30902 Project: Flink Issue Type: Bug Components: Runtime / Coordination Affects Versions: 1.17.0 Reporter: Weijie Guo Assignee: Weijie Guo Fix For: 1.17.0
Partition reuse only take effect for re-consumable edge, but hybrid selective result partition is not re-consumable. This optimization is very important to reduce the cost of the shuffle write phase. In the previous implementation, we will only force the broadcast edge to be of hybrid full(re-consumable) in the 'ResultPartitionTypeFactory'. As a result, for ALL_ EXCHANGE_HYBRID_SELECTIVE job, partition reuse cannot take effect for non-broadcast edges. In fact, we expected to replace all the edges that can be reused with hybrid full result partition. -- This message was sent by Atlassian Jira (v8.20.10#820010)