Hi Edward, Thanks for brining this up, and I think your suggestion makes sense. The problem is that the Kafka consumer has no notion of "closed" partitions at the moment, so statically assigned partitions to the Kafka client is never removed and is always continuously requested for records.
For example, on the Kinesis consumer, there is a notion of closed shards, and therefore is not an issue there. I've created a JIRA to track this: https://issues.apache.org/jira/browse/FLINK-5720 Cheers, Gordon -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
