Re: Can Connected Components run on a streaming dataset using iterate delta?

2020-02-26 Thread Arvid Heise
Hi Kant, there has not been high demand yet and it's always a matter of priority for the scarce manpower. I'd probably get inspired by gelly and implement it on DataStream in your stead. On Sat, Feb 22, 2020 at 11:23 AM kant kodali wrote: > Hi, > > Thanks for that but Looks like it is already

Re: Can Connected Components run on a streaming dataset using iterate delta?

2020-02-22 Thread kant kodali
Hi, Thanks for that but Looks like it is already available https://github.com/vasia/gelly-streaming in streaming but I wonder why this is not part of Flink? there are no releases either. Thanks! On Tue, Feb 18, 2020 at 9:13 AM Yun Gao wrote: >Hi Kant, > > As far as I

Re: Can Connected Components run on a streaming dataset using iterate delta?

2020-02-18 Thread Yun Gao
Hi Kant, As far as I know, I think the current example connected components implementation based on DataSet API could not be extended to streaming data or incremental batch directly. From the algorithm's perspective, if the graph only add edge and never

Can Connected Components run on a streaming dataset using iterate delta?

2020-02-17 Thread kant kodali
Hi All, I am wondering if connected components can run on a streaming data? or say incremental batch? I see that with delta iteration not all vertices need to participate at every iteration