[ https://issues.apache.org/jira/browse/FLINK-2491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15874746#comment-15874746 ]
Stephan Ewen commented on FLINK-2491: ------------------------------------- [~srichter] For this to work properly, we need to take the status of sources into account for the checkpoint. There have been some discussions about how to do this in a more general way to allow checkpoints for batch programs as well. I think we should have a FLIP on that in the near future. > Operators are not participating in state checkpointing in some cases > -------------------------------------------------------------------- > > Key: FLINK-2491 > URL: https://issues.apache.org/jira/browse/FLINK-2491 > Project: Flink > Issue Type: Bug > Components: Streaming > Affects Versions: 0.10.0 > Reporter: Robert Metzger > Assignee: Márton Balassi > Priority: Critical > Fix For: 1.0.0 > > > While implementing a test case for the Kafka Consumer, I came across the > following bug: > Consider the following topology, with the operator parallelism in parentheses: > Source (2) --> Sink (1). > In this setup, the {{snapshotState()}} method is called on the source, but > not on the Sink. > The sink receives the generated data. > only one of the two sources is generating data. > I've implemented a test case for this, you can find it here: > https://github.com/rmetzger/flink/blob/para_checkpoint_bug/flink-tests/src/test/java/org/apache/flink/test/checkpointing/ParallelismChangeCheckpoinedITCase.java -- This message was sent by Atlassian JIRA (v6.3.15#6346)