Hi, Thanks for summarising everything that was discussed so far and also for coming up with a good implementation plan! The plan looks good, it will unblock proper bundle support on Beam because we cannot wait for Flink to support bundles the way we like it.
I also want to quickly highlight these two issues because you mentioned bundle-processing and caching for GroupByKey/ReduceFnRunner as well: - https://issues.apache.org/jira/browse/BEAM-956: <https://issues.apache.org/jira/browse/BEAM-956:> Execute ReduceFnRunner Directly in Flink Runner - https://issues.apache.org/jira/browse/BEAM-1850: <https://issues.apache.org/jira/browse/BEAM-1850:> Improve interplay between PushbackSideInputRunner and GroupAlsoByWindowViaWindowSetDoFn They are not prerequisites for the bundling work but they are somewhat related. Best, Aljoscha - > On 13. Jun 2017, at 08:38, JingsongLee <[email protected]> wrote: > > Hi everyone, > I take a discussion to the implement of real bundle in Flink Runner. > https://docs.google.com/document/d/1UzELM4nFu8SIeu-QJkbs0sv7Uzd1Ux4aXXM3cw4s7po/edit?usp=sharing > Feel free to comment/edit it. > Best, JingsongLee
