Yingjie Cao created FLINK-29299: ----------------------------------- Summary: Fix the network memory size calculation issue in fine-grained resource mode Key: FLINK-29299 URL: https://issues.apache.org/jira/browse/FLINK-29299 Project: Flink Issue Type: Improvement Components: Runtime / Network Affects Versions: 1.16.0 Reporter: Yingjie Cao Fix For: 1.16.0
After FLINK-28663, one intermediate dataset can be consumed by multiple consumers, there is a case where one vertex can consume one intermediate dataset multiple times. However, currently in fine-grained resource mode, when computing the required network buffer size, the intermediate dataset is used as key to record the size of network buffer per input gate, which means it may allocate less network buffers than needed if two input gate of the same vertex consumes the same intermediate dataset. -- This message was sent by Atlassian Jira (v8.20.10#820010)