Joseph Holsten created KAFKA-2019:
-------------------------------------
Summary: RoundRobinAssignor clusters by consumer
Key: KAFKA-2019
URL: https://issues.apache.org/jira/browse/KAFKA-2019
Project: Kafka
Issue Type: Bug
Components: consumer
Reporter: Joseph Holsten
Assignee: Neha Narkhede
Priority: Minor
When rolling out a change today, I noticed that some of my consumers are
"greedy", taking far more partitions than others.
The cause is that the RoundRobinAssignor is using a list of ConsumerThreadIds
sorted by toString, which is {{ "%s-%d".format(consumer, threadId)}}. This
causes each consumer's threads to be adjacent to each other.
One possible fix would be to define ConsumerThreadId.hashCode, and sort by that.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
