[
https://issues.apache.org/jira/browse/FLINK-22326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17327031#comment-17327031
]
Lu Niu commented on FLINK-22326:
--------------------------------
[~trohrmann] Here is a short summary:
before 1.9: job contains iterate operator can checkpoint but iterate operator
might lead to data loss since it doesn't participate in checkpoint.
after 1.9: job contains iterate operator will fail checkpoint whenever feedback
QPS is low.
Is there any plan for better supporting iterate operator? We can help to
contribute if any. Thanks!
> Job contains Iterate Operator always fails on Checkpoint
> ---------------------------------------------------------
>
> Key: FLINK-22326
> URL: https://issues.apache.org/jira/browse/FLINK-22326
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Checkpointing
> Affects Versions: 1.11.1
> Reporter: Lu Niu
> Priority: Major
> Attachments: Screen Shot 2021-04-16 at 12.40.34 PM.png, Screen Shot
> 2021-04-16 at 12.43.38 PM.png
>
>
> Job contains Iterate Operator will always fail on checkpoint.
> How to reproduce:
> [https://gist.github.com/qqibrow/f297babadb0bb662ee398b9088870785]
> this is based on
> [https://github.com/apache/flink/blob/master/flink-examples/flink-examples-streaming/src/main/java/org/apache/flink/streaming/examples/iteration/IterateExample.java,]
> but a few line difference:
> 1. Make maxWaitTime large enough when create IterativeStream
> 2. No output back to Itertive Source
> Result:
> The same code is able to checkpoint in 1.9.1
> !Screen Shot 2021-04-16 at 12.43.38 PM.png!
>
> but always fail on checkpoint in 1.11
> !Screen Shot 2021-04-16 at 12.40.34 PM.png!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
