ConsumerConnector and 0.10 message format

2018-06-21 Thread Jeff Pollard
Hello all, We are in the process of upgrading all our consumers to version 0.10+. One of our pre-0.10 consumers still uses the deprecated ConsumerConnector API (I believe colloquially called the "old consumer"). We're unfortunately not able to upgrade this consumer to the new consumer API, as the

Rebalances despite frequent heartbeats

2016-07-24 Thread Jeff Pollard
I'm trying to track down an issue with one of our consumers. There are 4 threads in the same consumer group, which will run happily for a few hours before one of them crashes with the following exception: org.apache.kafka.clients.consumer.CommitFailedException: Commit cannot be completed due to gr

Consumer rebalance, despite frequent heartbeats

2016-07-21 Thread Jeff Pollard
I'm trying to track down an issue with one of our consumers. There are 4 threads (in 4 separate processes) in the same consumer group, which will run happily for a few hours before inevitably one of them crashes with the following exception: org.apache.kafka.clients.consumer.CommitFailedException: