[
https://issues.apache.org/jira/browse/KAFKA-19560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
mooner updated KAFKA-19560:
---------------------------
Description:
h3. {color:#172b4d}I have already set
[auto.leader.rebalance.enable|https://kafka.apache.org/documentation/#brokerconfigs_auto.leader.rebalance.enable]
to true, but the leader of the __consumer_offsets topic is not balanced at
all, remaining on only one node or two nodes.{color}
*3.5.0 version,The leader is only on nodes 1 and 0 and will not be balanced to
node 2. :*
Topic: __consumer_offsets TopicId: 480x8Ow1Qwyb-YvuWWqwVQ PartitionCount: 50
ReplicationFactor: 3 Configs:
compression.type=producer,deletion.filterDeadGroup.enable=true,min.insync.replicas=1,cleanup.policy=compact,segment.bytes=104857600,max.message.bytes=15728658,index.interval.bytes=4096,unclean.leader.election.enable=false,retention.bytes=1073741824
Topic: __consumer_offsetsPartition: 0Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 1Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 2Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 3Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 4Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 5Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 6Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 7Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 8Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 9Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 10Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 11Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 12Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 13Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 14Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 15Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 16Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 17Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 18Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 19Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 20Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 21Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 22Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 23Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 24Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 25Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 26Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 27Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 28Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 29Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 30Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 31Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 32Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 33Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 34Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 35Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 36Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 37Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 38Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 39Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 40Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 41Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 42Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 43Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 44Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 45Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 46Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 47Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 48Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 49Leader: 0Replicas: 0,1,2Isr: 0,2,1
was:
I have already set
[auto.leader.rebalance.enable|https://kafka.apache.org/documentation/#brokerconfigs_auto.leader.rebalance.enable]
to true
, but the leader of the __consumer_offsets topic is not balanced at all,
remaining on only one node or two nodes.
3.5.0 version,The leader is only on nodes 1 and 0 and will not be balanced to
node 2. :
Topic: __consumer_offsets TopicId: 480x8Ow1Qwyb-YvuWWqwVQ PartitionCount: 50
ReplicationFactor: 3 Configs:
compression.type=producer,deletion.filterDeadGroup.enable=true,min.insync.replicas=1,cleanup.policy=compact,segment.bytes=104857600,max.message.bytes=15728658,index.interval.bytes=4096,unclean.leader.election.enable=false,retention.bytes=1073741824
Topic: __consumer_offsetsPartition: 0Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 1Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 2Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 3Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 4Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 5Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 6Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 7Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 8Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 9Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 10Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 11Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 12Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 13Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 14Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 15Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 16Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 17Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 18Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 19Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 20Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 21Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 22Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 23Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 24Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 25Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 26Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 27Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 28Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 29Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 30Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 31Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 32Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 33Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 34Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 35Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 36Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 37Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 38Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 39Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 40Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 41Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 42Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 43Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 44Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 45Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 46Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 47Leader: 0Replicas: 0,1,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 48Leader: 1Replicas: 1,0,2Isr: 0,2,1
Topic: __consumer_offsetsPartition: 49Leader: 0Replicas: 0,1,2Isr: 0,2,1
> leader of the __consumer_offsets topic is not balanced
> ------------------------------------------------------
>
> Key: KAFKA-19560
> URL: https://issues.apache.org/jira/browse/KAFKA-19560
> Project: Kafka
> Issue Type: Bug
> Reporter: mooner
> Priority: Major
>
> h3. {color:#172b4d}I have already set
> [auto.leader.rebalance.enable|https://kafka.apache.org/documentation/#brokerconfigs_auto.leader.rebalance.enable]
> to true, but the leader of the __consumer_offsets topic is not balanced at
> all, remaining on only one node or two nodes.{color}
> *3.5.0 version,The leader is only on nodes 1 and 0 and will not be balanced
> to node 2. :*
> Topic: __consumer_offsets TopicId: 480x8Ow1Qwyb-YvuWWqwVQ PartitionCount: 50
> ReplicationFactor: 3 Configs:
> compression.type=producer,deletion.filterDeadGroup.enable=true,min.insync.replicas=1,cleanup.policy=compact,segment.bytes=104857600,max.message.bytes=15728658,index.interval.bytes=4096,unclean.leader.election.enable=false,retention.bytes=1073741824
> Topic: __consumer_offsetsPartition: 0Leader: 0Replicas: 0,1,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 1Leader: 1Replicas: 1,0,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 2Leader: 0Replicas: 0,1,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 3Leader: 1Replicas: 1,0,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 4Leader: 1Replicas: 1,0,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 5Leader: 0Replicas: 0,1,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 6Leader: 0Replicas: 0,1,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 7Leader: 1Replicas: 1,0,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 8Leader: 1Replicas: 1,0,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 9Leader: 0Replicas: 0,1,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 10Leader: 1Replicas: 1,0,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 11Leader: 0Replicas: 0,1,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 12Leader: 0Replicas: 0,1,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 13Leader: 1Replicas: 1,0,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 14Leader: 1Replicas: 1,0,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 15Leader: 0Replicas: 0,1,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 16Leader: 0Replicas: 0,1,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 17Leader: 1Replicas: 1,0,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 18Leader: 1Replicas: 1,0,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 19Leader: 0Replicas: 0,1,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 20Leader: 0Replicas: 0,1,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 21Leader: 1Replicas: 1,0,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 22Leader: 0Replicas: 0,1,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 23Leader: 1Replicas: 1,0,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 24Leader: 1Replicas: 1,0,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 25Leader: 0Replicas: 0,1,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 26Leader: 1Replicas: 1,0,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 27Leader: 0Replicas: 0,1,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 28Leader: 1Replicas: 1,0,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 29Leader: 0Replicas: 0,1,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 30Leader: 0Replicas: 0,1,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 31Leader: 1Replicas: 1,0,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 32Leader: 1Replicas: 1,0,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 33Leader: 0Replicas: 0,1,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 34Leader: 1Replicas: 1,0,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 35Leader: 0Replicas: 0,1,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 36Leader: 1Replicas: 1,0,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 37Leader: 0Replicas: 0,1,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 38Leader: 0Replicas: 0,1,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 39Leader: 1Replicas: 1,0,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 40Leader: 0Replicas: 0,1,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 41Leader: 1Replicas: 1,0,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 42Leader: 0Replicas: 0,1,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 43Leader: 1Replicas: 1,0,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 44Leader: 1Replicas: 1,0,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 45Leader: 0Replicas: 0,1,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 46Leader: 1Replicas: 1,0,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 47Leader: 0Replicas: 0,1,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 48Leader: 1Replicas: 1,0,2Isr: 0,2,1
> Topic: __consumer_offsetsPartition: 49Leader: 0Replicas: 0,1,2Isr: 0,2,1
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
