Yuxin Tan created FLINK-28446:
---------------------------------

             Summary: Expose more information in PartitionDescriptor to support 
more optimized Shuffle Service
                 Key: FLINK-28446
                 URL: https://issues.apache.org/jira/browse/FLINK-28446
             Project: Flink
          Issue Type: Improvement
    Affects Versions: 1.16.0
            Reporter: Yuxin Tan


To improve shuffle performance, more detailed fields should be added to 
PartitionDescriptor, for example, whether the partition is a broadcast 
partition or the distribution pattern of the intermediate result.

After the detailed information is added, the Shuffle Service can use different 
Shuffle strategies in different situations, which may lead to better shuffle 
performance.

In addition, we only add fields to PartitionDescriptor, which is compatible 
with the previous version, and the added fields are insensitive to earlier 
users.

 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to