Hi All, I have come across the case where my client will return a 0 size list from poll after an extended period of time of working properly. There is 100% new data being added to the topic when poll starts returning nothing. I am hoping someone might have some insight as to why this happens. About the issue: * this is on a per consumer group. A group will go bad, but others will be fine. * I am using the auto commit feature to manage offset commits. * restarting the client will temporarily fix the issue. It will consumer 100,000's of messages and then stop after an extended period of time. * Seeking to the beginning or end of the topic's queues fixes this often, but not always and has become less reliable for me lately. * the cluster size is 18 kafka nodes, 180 partitions per topic, 3 zookeepers. and we are using the kafka offset manager. * __consumer_offsets is 50 partitions/default
Any help would be greatly appreciated! Thanks, Zach
