Hello, I've being working on a fix for this, I posted more details on the JIRA ticket.
Regards, Edward 2018-05-07 5:51 GMT+02:00 Tzu-Li (Gordon) Tai <tzuli...@apache.org>: > Ah, correct, sorry for the incorrect link. > Thanks Ted! > > > On 7 May 2018 at 11:43:12 AM, Ted Yu (yuzhih...@gmail.com) wrote: > > It seems the correct JIRA should be FLINK-9303 > <https://issues.apache.org/jira/browse/FLINK-9303> > > On Sun, May 6, 2018 at 8:29 PM, Tzu-Li (Gordon) Tai <tzuli...@apache.org> > wrote: > >> Hi Edward, >> >> Thanks for brining this up, and I think your suggestion makes sense. >> The problem is that the Kafka consumer has no notion of "closed" >> partitions >> at the moment, so statically assigned partitions to the Kafka client is >> never removed and is always continuously requested for records. >> >> For example, on the Kinesis consumer, there is a notion of closed shards, >> and therefore is not an issue there. >> >> I've created a JIRA to track this: >> https://issues.apache.org/jira/browse/FLINK-5720 >> >> Cheers, >> Gordon >> >> >> >> -- >> Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4. >> nabble.com/ >> > >
