Re: [ANNOUNCE] Open source of remote shuffle project for Flink batch data processing

2021-12-05 Thread Lijie Wang
As one of the contributors of flink remote shuffle, I'm glad to hear all the warm responses! Welcome more people to try the flink remote shuffle and look forward to your feedback. Best, Lijie Yingjie Cao 于2021年12月1日周三 17:50写道: > Hi Jiangang, > > Great to hear that, welcome to work together to m

Re: [ANNOUNCE] Open source of remote shuffle project for Flink batch data processing

2021-12-01 Thread Yingjie Cao
Hi Jiangang, Great to hear that, welcome to work together to make the project better. Best, Yingjie 刘建刚 于2021年12月1日周三 下午3:27写道: > Good work for flink's batch processing! > Remote shuffle service can resolve the container lost problem and reduce > the running time for batch jobs once failover.

Re: [ANNOUNCE] Open source of remote shuffle project for Flink batch data processing

2021-11-30 Thread 刘建刚
Good work for flink's batch processing! Remote shuffle service can resolve the container lost problem and reduce the running time for batch jobs once failover. We have investigated the component a lot and welcome Flink's native solution. We will try it and help improve it. Thanks, Liu Jiangang Yi

Re: [ANNOUNCE] Open source of remote shuffle project for Flink batch data processing

2021-11-30 Thread Yun Gao
Subject:Re: [ANNOUNCE] Open source of remote shuffle project for Flink batch data processing Hi Jing, Great to hear that, collaborations and feedbacks are welcomed. Best, Yingjie Jing Zhang 于2021年12月1日周三 上午10:34写道: > Amazing! > Remote shuffle service is an important improvement for batc

Re: [ANNOUNCE] Open source of remote shuffle project for Flink batch data processing

2021-11-30 Thread Yingjie Cao
Hi Jing, Great to hear that, collaborations and feedbacks are welcomed. Best, Yingjie Jing Zhang 于2021年12月1日周三 上午10:34写道: > Amazing! > Remote shuffle service is an important improvement for batch data > processing experience on Flink. > It is also a strong requirement in our internal batch bus

Re: [ANNOUNCE] Open source of remote shuffle project for Flink batch data processing

2021-11-30 Thread Yingjie Cao
Hi Martijn, Yes, we will add it to flink-packages soon. Best, Yingjie Martijn Visser 于2021年12月1日周三 上午3:24写道: > Hi Yingjie, > > This is great, thanks for sharing. Will you also add it to > https://flink-packages.org/ ? > > Best regards, > > Martijn > > On Tue, 30 Nov 2021 at 17:31, Till Rohrman

Re: [ANNOUNCE] Open source of remote shuffle project for Flink batch data processing

2021-11-30 Thread Jingsong Li
Amazing! Thanks Yingjie and all contributors for your great work. Best, Jingsong On Wed, Dec 1, 2021 at 10:52 AM Yun Tang wrote: > > Great news! > Thanks for all the guys who contributed in this project. > > Best > Yun Tang > > On 2021/11/30 16:30:52 Till Rohrmann wrote: > > Great news, Yingjie

Re: [ANNOUNCE] Open source of remote shuffle project for Flink batch data processing

2021-11-30 Thread Jing Zhang
Amazing! Remote shuffle service is an important improvement for batch data processing experience on Flink. It is also a strong requirement in our internal batch business, we would try it soon and give you feedback. Best, Jing Zhang Martijn Visser 于2021年12月1日周三 上午3:25写道: > Hi Yingjie, > > This i

Re: [ANNOUNCE] Open source of remote shuffle project for Flink batch data processing

2021-11-30 Thread Martijn Visser
Hi Yingjie, This is great, thanks for sharing. Will you also add it to https://flink-packages.org/ ? Best regards, Martijn On Tue, 30 Nov 2021 at 17:31, Till Rohrmann wrote: > Great news, Yingjie. Thanks a lot for sharing this information with the > community and kudos to all the contributors

Re: [ANNOUNCE] Open source of remote shuffle project for Flink batch data processing

2021-11-30 Thread Till Rohrmann
Great news, Yingjie. Thanks a lot for sharing this information with the community and kudos to all the contributors of the external shuffle service :-) Cheers, Till On Tue, Nov 30, 2021 at 2:32 PM Yingjie Cao wrote: > Hi dev & users, > > We are happy to announce the open source of remote shuffl

[ANNOUNCE] Open source of remote shuffle project for Flink batch data processing

2021-11-30 Thread Yingjie Cao
Hi dev & users, We are happy to announce the open source of remote shuffle project [1] for Flink. The project is originated in Alibaba and the main motivation is to improve batch data processing for both performance & stability and further embrace cloud native. For more features about the project,