Re: [FLIP] Forward a flip to introduce minibatch optimization for Join

2024-01-10 Thread shuai xu
Hi Leonard, Thanks for your help very much ! I have already started the discussion about FLIP-415: Introduce a new join operator to support minibatch[1]. And I’m looking forward to your feedback if you have some spare time to take a look. [1] https://cwiki.apache.org/confluence/display/FLINK

Re: [FLIP] Forward a flip to introduce minibatch optimization for Join

2024-01-10 Thread Leonard Xu
Hey, shuai I’ve added wiki permission for you, looking forward your streaming join optimization. Best, Leonard

[FLIP] Forward a flip to introduce minibatch optimization for Join

2024-01-10 Thread shuai xu
Hi all, Currently, when performing cascading connections in Flink, there is a pain point of record amplification as mentioned in discussion similar to https://lists.apache.org/thread/2021fmwhtotl0okmtyc5b7tndlp3khf9, I have implemented the optimization of POC and it works. I wonder to forward a