[FLIP] Forward a flip to introduce minibatch optimization for Join

[shuai xu]

Hi all,

Currently, when performing cascading connections in Flink, there is a pain 
point of record amplification as mentioned in discussion similar to 
https://lists.apache.org/thread/2021fmwhtotl0okmtyc5b7tndlp3khf9,
I have implemented the optimization of POC and it works. I wonder to forward a 
FLIP to explain my plan. But there is no permission to create files in the 
Flink Improvement Proposals [1] space. I may need PMC to help me add 
permissions: My Jira account is xu_shuai_ The email is xushuai...@gmail.com 
.Thanks!

Re: [FLIP] Forward a flip to introduce minibatch optimization for Join

[Leonard Xu]

Hey, shuai 

I’ve added wiki permission for you, looking forward your streaming join 
optimization.

Best,
Leonard

Re: [FLIP] Forward a flip to introduce minibatch optimization for Join

[shuai xu]

Hi Leonard,

Thanks for your help very much !

I have already started the discussion about FLIP-415: Introduce a new join 
operator to support minibatch[1]. 
And I’m looking forward to your feedback if you have some spare time to take a 
look.


[1]
https://cwiki.apache.org/confluence/display/FLINK/FLIP-415%3A+Introduce+a+new+join+operator+to+support+minibatch

Best,
Xu Shuai

> 2024年1月10日 17:47，Leonard Xu  写道：
> 
> Hey, shuai 
> 
> I’ve added wiki permission for you, looking forward your streaming join 
> optimization.
> 
> Best,
> Leonard