Hi all, Jinhao (cc'ed) and I are opening this thread to discuss FLIP-331: Support EndOfStreamWindows and isOutputOnEOF operator attribute to optimize task deployment. The design doc can be found at https://cwiki.apache.org/confluence/display/FLINK/FLIP-331%3A+Support+EndOfStreamWindows++and+isOutputOnEOF+operator+attribute+to+optimize+task+deployment .
This FLIP introduces isOutputOnEOF operator attribute that JobManager can use to optimize task deployment and resource utilization. In addition, it also adds EndOfStreamWindows that can be used with the DataStream APIs (e.g. cogroup, aggregate) to significantly increase throughput and reduce resource utilization. We would greatly appreciate any comment or feedback you may have on this proposal. Cheers, Dong