shuai.xu created FLINK-11299: -------------------------------- Summary: Decide the result partition type dynamically Key: FLINK-11299 URL: https://issues.apache.org/jira/browse/FLINK-11299 Project: Flink Issue Type: Improvement Components: JobManager Reporter: shuai.xu
Now, the result partition type is decided when compiling JobGraph at the client. This's to say, whether to output the result of a task to its consumers by PIPELINED or BLOCKING is decided at client and can not be changed any more. However, it is usually seen in batch jobs that a task is configured PIPELINED but its consumers can not be started due to lack of resource, this will lead to failover now. So we proposal to support deciding the result partition type dynamically during runtime according to the resource of cluster and so on to increase the success rate of batch job. -- This message was sent by Atlassian JIRA (v7.6.3#76005)