Re: Need a help in understanding __consumer_offsets topic creation in Kafka Cluster

[Prasannalakshmi Sugumaran]

Hi,



We are using Kafka 0.9.0.2, and by default log cleaner is not enabled. When
we enable the log cleaner, internal topic “__consumer_offsets” (around 1TB
in size)starts compaction, and during compaction we are unable to
consume/produce messages. Also, consumer groups failed in leader election.



Partitions – 6

Kafka nodes – 3

Zookeeper – 3

Replication factor – 3



- Prasanna