Wencong Liu created FLINK-33144:
-----------------------------------
Summary: Deprecate Iteration API in DataStream
Key: FLINK-33144
URL: https://issues.apache.org/jira/browse/FLINK-33144
Project: Flink
Issue Type: Technical Debt
Components: API / DataStream
Affects Versions: 1.19.0
Reporter: Wencong Liu
Fix For: 1.19.0
Currently, the Iteration API of DataStream is incomplete. For instance, it
lacks support for iteration in sync mode and exactly once semantics.
Additionally, it does not offer the ability to set iteration termination
conditions. As a result, it's hard for developers to build an iteration
pipeline by DataStream in the practical applications such as machine learning.
[FLIP-176: Unified Iteration to Support
Algorithms|https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=184615300]
has introduced a unified iteration library in the Flink ML repository. This
library addresses all the issues present in the Iteration API of DataStream and
could provide solution for all the iteration use-cases. However, maintaining
two separate implementations of iteration in both the Flink repository and the
Flink ML repository would introduce unnecessary complexity and make it
difficult to maintain the Iteration API.
FLIP-357 has decided to deprecate the Iteration API of DataStream and remove it
completely in the next major version. In the future, if other modules in the
Flink repository require the use of the Iteration API, we can consider
extracting all Iteration implementations from the Flink ML repository into an
independent module.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
