We have a use case where we would want to to shutdown the consumers if they do not have anything to process. The process which these consumers are a part is still alive.
Once the consumer shutdown we see that the Zookeeper connections are not closed/cleaned. Since these consumer's will come back up again periodically and the process repeats. At some point we see that the rebalance starts failing since the old zookeeper client's are still in connected state. Wanted to know if anyone else has seen this problem. thanks Paresh