+1 Thanks for driving this.
Best, Yangze Guo On Fri, Sep 1, 2023 at 2:00 PM Xintong Song <tonysong...@gmail.com> wrote: > > +1 > > Best, > > Xintong > > > > On Fri, Sep 1, 2023 at 1:11 PM Dong Lin <lindon...@gmail.com> wrote: > > > Thanks Wencong for initiating the discussion. > > > > +1 for the proposal. > > > > On Fri, Sep 1, 2023 at 12:00 PM Wencong Liu <liuwencle...@163.com> wrote: > > > > > Hi devs, > > > > > > I would like to start a discussion on FLIP-357: Deprecate Iteration API > > of > > > DataStream [1]. > > > > > > Currently, the Iteration API of DataStream is incomplete. For instance, > > it > > > lacks support > > > for iteration in sync mode and exactly once semantics. Additionally, it > > > does not offer the > > > ability to set iteration termination conditions. As a result, it's hard > > > for developers to > > > build an iteration pipeline by DataStream in the practical applications > > > such as machine learning. > > > > > > FLIP-176: Unified Iteration to Support Algorithms [2] has introduced a > > > unified iteration library > > > in the Flink ML repository. This library addresses all the issues present > > > in the Iteration API of > > > DataStream and could provide solution for all the iteration use-cases. > > > However, maintaining two > > > separate implementations of iteration in both the Flink repository and > > the > > > Flink ML repository > > > would introduce unnecessary complexity and make it difficult to maintain > > > the Iteration API. > > > > > > As such I propose deprecating the Iteration API of DataStream and > > removing > > > it completely in the next > > > major version. In the future, if other modules in the Flink repository > > > require the use of the > > > Iteration API, we can consider extracting all Iteration implementations > > > from the Flink ML repository > > > into an independent module. > > > > > > Looking forward to your feedback. > > > > > > > > > [1] > > > > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-357%3A+Deprecate+Iteration+API+of+DataStream > > > [2] > > > > > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=184615300 > > > > > > Best regards, > > > > > > Wencong Liu > >
