Panos Skianis created KAFKA-5611:
------------------------------------
Summary: One or more consumers in a consumer-group stop consuming
after rebalancing
Key: KAFKA-5611
URL: https://issues.apache.org/jira/browse/KAFKA-5611
Project: Kafka
Issue Type: Bug
Affects Versions: 0.10.2.0
Reporter: Panos Skianis
Attachments: kka02, Server 1, Server 2, Server 3
Scenario:
- 3 servers running 1 consumer each under the same consumer groupId.
- Servers seem to be consuming messages happily but then there is a timeout
to an external service that causes our app to restart the Kafka Consumer on one
of the servers (this is by design). That causes rebalancing of the group and
upon restart of one of the Consumers seem to "block".
- Server 3 is where the problems occur.
- Problem fixes itself either by restarting one of the 3 servers or cause the
group to rebalance again by using the console consumer with the autocommit set
to false and using the same group.
Note:
- Haven't managed to recreate it at will yet.
- Mainly happens in production environment, often enough. Hence I do not have
any logs with DEBUG/TRACE statements yet.
- Extracts from log of each app server are attached. Also the log of the kafka
that seems to be dealing with the related group and generations.
- See COMMENT lines in the files for further info.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
