Yuxin Tan created FLINK-28446: --------------------------------- Summary: Expose more information in PartitionDescriptor to support more optimized Shuffle Service Key: FLINK-28446 URL: https://issues.apache.org/jira/browse/FLINK-28446 Project: Flink Issue Type: Improvement Affects Versions: 1.16.0 Reporter: Yuxin Tan
To improve shuffle performance, more detailed fields should be added to PartitionDescriptor, for example, whether the partition is a broadcast partition or the distribution pattern of the intermediate result. After the detailed information is added, the Shuffle Service can use different Shuffle strategies in different situations, which may lead to better shuffle performance. In addition, we only add fields to PartitionDescriptor, which is compatible with the previous version, and the added fields are insensitive to earlier users. -- This message was sent by Atlassian Jira (v8.20.10#820010)