[ https://issues.apache.org/jira/browse/FLINK-2491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16755385#comment-16755385 ]
JC commented on FLINK-2491: --------------------------- I also came across this problem trying exactly the same as [~canhuang] , i want to expand the parallelism beyond my amount of kafka partitions, i am using Flink 1.5.4 with Apache Beam. Thanks > Checkpointing only works if all operators/tasks are still running > ----------------------------------------------------------------- > > Key: FLINK-2491 > URL: https://issues.apache.org/jira/browse/FLINK-2491 > Project: Flink > Issue Type: Bug > Components: DataStream API, State Backends, Checkpointing > Affects Versions: 0.10.0 > Reporter: Robert Metzger > Assignee: Márton Balassi > Priority: Critical > Attachments: fix_checkpoint_not_working_if_tasks_are_finished.patch > > > While implementing a test case for the Kafka Consumer, I came across the > following bug: > Consider the following topology, with the operator parallelism in parentheses: > Source (2) --> Sink (1). > In this setup, the {{snapshotState()}} method is called on the source, but > not on the Sink. > The sink receives the generated data. > only one of the two sources is generating data. > I've implemented a test case for this, you can find it here: > https://github.com/rmetzger/flink/blob/para_checkpoint_bug/flink-tests/src/test/java/org/apache/flink/test/checkpointing/ParallelismChangeCheckpoinedITCase.java -- This message was sent by Atlassian JIRA (v7.6.3#76005)