[FLIP] Forward a flip to introduce minibatch optimization for Join
Hi all, Currently, when performing cascading connections in Flink, there is a pain point of record amplification as mentioned in discussion similar to https://lists.apache.org/thread/2021fmwhtotl0okmtyc5b7tndlp3khf9, I have implemented the optimization of POC and it works. I wonder to forward a FLIP to explain my plan. But there is no permission to create files in the Flink Improvement Proposals [1] space. I may need PMC to help me add permissions: My Jira account is xu_shuai_ The email is xushuai...@gmail.com .Thanks!
Re: [FLIP] Forward a flip to introduce minibatch optimization for Join
Hey, shuai I’ve added wiki permission for you, looking forward your streaming join optimization. Best, Leonard
Re: [FLIP] Forward a flip to introduce minibatch optimization for Join
Hi Leonard, Thanks for your help very much ! I have already started the discussion about FLIP-415: Introduce a new join operator to support minibatch[1]. And I’m looking forward to your feedback if you have some spare time to take a look. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-415%3A+Introduce+a+new+join+operator+to+support+minibatch Best, Xu Shuai > 2024年1月10日 17:47,Leonard Xu 写道: > > Hey, shuai > > I’ve added wiki permission for you, looking forward your streaming join > optimization. > > Best, > Leonard