[ https://issues.apache.org/jira/browse/FLINK-2491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17250134#comment-17250134 ]
Yun Gao commented on FLINK-2491: -------------------------------- Hi [~swapnilkhante], very sorry for the late reply. For delaying two checkpoints, one reference might be [this test|https://github.com/apache/flink/blob/313e20e8e03953a5e1cec9daa467f561ccfbd599/flink-connectors/flink-connector-files/src/test/java/org/apache/flink/connector/file/sink/StreamingExecutionFileSinkITCase.java#L105], and a simpler way might be just sleep a long time after the source function has send all the records. However, Based on my knowledge it might not be easy to add the similar logic to an existing table source, thus it might need to add some DataStream sources manually. > Checkpointing only works if all operators/tasks are still running > ----------------------------------------------------------------- > > Key: FLINK-2491 > URL: https://issues.apache.org/jira/browse/FLINK-2491 > Project: Flink > Issue Type: Bug > Components: Runtime / Checkpointing > Affects Versions: 0.10.0 > Reporter: Robert Metzger > Priority: Critical > Attachments: fix_checkpoint_not_working_if_tasks_are_finished.patch > > > While implementing a test case for the Kafka Consumer, I came across the > following bug: > Consider the following topology, with the operator parallelism in parentheses: > Source (2) --> Sink (1). > In this setup, the {{snapshotState()}} method is called on the source, but > not on the Sink. > The sink receives the generated data. > only one of the two sources is generating data. > I've implemented a test case for this, you can find it here: > https://github.com/rmetzger/flink/blob/para_checkpoint_bug/flink-tests/src/test/java/org/apache/flink/test/checkpointing/ParallelismChangeCheckpoinedITCase.java -- This message was sent by Atlassian Jira (v8.3.4#803005)