[jira] [Created] (FLINK-8523) Stop assigning floating buffers for blocked input channels in exactly-once mode

2018-01-29 Thread zhijiang (JIRA)
zhijiang created FLINK-8523: --- Summary: Stop assigning floating buffers for blocked input channels in exactly-once mode Key: FLINK-8523 URL: https://issues.apache.org/jira/browse/FLINK-8523 Project: Flink

Re: Kinesis consumer shard skew - FLINK-8516

2018-01-29 Thread Thomas Weise
> > > What do you mean by checkpoint “assignments”? The assignment from > shard-to-source is only fixed within a single execution of the job. We only > checkpoint the progress of each shard in the state. > Given that we support plugging in custom shard assignment hashing, then > the assignment coul

[jira] [Created] (FLINK-8522) DefaultOperatorStateBackend writes data in checkpoint that is never read.

2018-01-29 Thread Kostas Kloudas (JIRA)
Kostas Kloudas created FLINK-8522: - Summary: DefaultOperatorStateBackend writes data in checkpoint that is never read. Key: FLINK-8522 URL: https://issues.apache.org/jira/browse/FLINK-8522 Project: Fl

[jira] [Created] (FLINK-8521) FlinkKafkaProducer011ITCase.testRunOutOfProducersInThePool timed out on Travis

2018-01-29 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8521: Summary: FlinkKafkaProducer011ITCase.testRunOutOfProducersInThePool timed out on Travis Key: FLINK-8521 URL: https://issues.apache.org/jira/browse/FLINK-8521 Project:

Re: Kinesis consumer shard skew - FLINK-8516

2018-01-29 Thread Tzu-Li (Gordon) Tai
(Sorry, I accidentally sent out my un-finished reply too early. Here’s the full reply.) > Isn't the issue that some shard assignments may not have been checkpointed  > and so may end up in different subtasks when they are re-discovered?  That is part of the problem, yes. For example, it would al

Re: Kinesis consumer shard skew - FLINK-8516

2018-01-29 Thread Tzu-Li (Gordon) Tai
> Isn't the issue that some shard assignments may not have been checkpointed  > and so may end up in different subtasks when they are re-discovered?  That is part of the problem, yes. For example, it would also be problematic for shard discovery. If the assignment is non-deterministic, a source s

[jira] [Created] (FLINK-8520) CassandraConnectorITCase.testCassandraTableSink unstable on Travis

2018-01-29 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-8520: Summary: CassandraConnectorITCase.testCassandraTableSink unstable on Travis Key: FLINK-8520 URL: https://issues.apache.org/jira/browse/FLINK-8520 Project: Flink