Re: [DISCUSS] Drop Gelly

2022-01-03 Thread Till Rohrmann
I haven't seen any changes or requests to/for Gelly in ages. Hence, I would assume that it is not really used and can be removed. +1 for dropping Gelly. Cheers, Till On Mon, Jan 3, 2022 at 2:20 PM Martijn Visser wrote: > Hi everyone, > > Flink is bundled with Gelly, a Graph API library [1]. Th

Re: [DISCUSS] Drop Gelly

2022-01-03 Thread David Anderson
Most of the inquiries I've had about Gelly in recent memory have been from folks looking for a streaming solution, and it's only been a handful. +1 for dropping Gelly David On Mon, Jan 3, 2022 at 2:41 PM Till Rohrmann wrote: > I haven't seen any changes or requests to/for Gelly in ages. Hence,

Re: [DISCUSS] Drop Gelly

2022-01-03 Thread Zhipeng Zhang
Hi everyone, Thanks for starting the discussion :) We (Alink team [1]) are actually using part of the Gelly library to support graph algorithms (connected component, single source shortest path, etc.) for users in Alibaba Inc. As DataSet API is going to be dropped, shall we also provide a new gr

Re: [DISCUSS] Drop Gelly

2022-01-03 Thread Martijn Visser
Hi Zhipeng, Good that you've reached out, I wasn't aware that Gelly is being used in Alink. Are you proposing to write a new graph library as a successor of Gelly and bundle that with Alink? Best regards, Martijn On Tue, 4 Jan 2022 at 02:57, Zhipeng Zhang wrote: > Hi everyone, > > Thanks for

Re: [DISCUSS] Drop Gelly

2022-01-04 Thread Lukáš Drbal
Hi everyone, We (team in seznam.cz) are actually using the Gelly library for batch anomaly detection in our graphs. It will be very nice to somehow keep this functionality, maybe in a separate repository. Is there any replacement? Best, Lukas On Mon, Jan 3, 2022 at 2:20 PM Martijn Visser wrote

Re: [DISCUSS] Drop Gelly

2022-01-04 Thread Zhipeng Zhang
Hi Martijin, Thanks for the feedback. I am not proposing to bundle the new graph library with Alink. I am +1 for dropping the DataSet-based Gelly library, but we probably need a new graph library in Flink for the possible migration. We haven't decided what to do yet and probably need more discus

Re: [DISCUSS] Drop Gelly

2022-01-04 Thread Jing Ge
Hi, thanks Martijn for bringing it up for discussion. I think we could make the discussion a little bit clearer by splitting it into two questions: 1. should Flink drop Gelly? 2. should Flink drop the graph computing? The answer of the first question could be yes, since there have been no change

Re: [DISCUSS] Drop Gelly

2022-01-04 Thread Martijn Visser
Hi Zhipeng, I think that we're seeing more code being externalised, for example with the Flink Remote Shuffle service [1] and the ongoing discussion on the external connector repository [2], it makes sense to go for your second option. Maybe it fits under Flink Extended [3]. The main question bec

Re: Re: [DISCUSS] Drop Gelly

2022-01-04 Thread Yun Gao
Hi, Very thanks for initiating the discussion! Also +1 to drop the current DataSet based Gelly library so that we could finally drop the legacy DataSet API. For whether to keep the graph computing ability, from my side graph query / graph computing and chaining them with the preprocessing pi