[ https://issues.apache.org/jira/browse/KAFKA-3000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15061168#comment-15061168 ]
Maxim Vladimirskiy commented on KAFKA-3000: ------------------------------------------- After I set log.cleaner.enable=true the size of the __consumer_offsets started to go down rapidly. Thanks a lot Grant. And you should definitely remove this option all together, it does not make sense to have a cleaner disabled. If a user neither has compacted topics nor using offset management it should not be a huge performance hit to have an idle cleaner sticking around, unless you screwed up implementing it a big time, just joking :). Keep up the good work. Kafka is great! > __consumer_offsets topic grows indefinitely > ------------------------------------------- > > Key: KAFKA-3000 > URL: https://issues.apache.org/jira/browse/KAFKA-3000 > Project: Kafka > Issue Type: Bug > Components: offset manager > Affects Versions: 0.8.2.1 > Environment: Ubuntu 14.04, 5 node kafka cluster + 5 node ZooKeeper > cluster. ZooKeeper and Kafka coexist on 5 cloud boxes. > Reporter: Maxim Vladimirskiy > Assignee: Grant Henke > > Old segments of the __consumer_offsets topic seem to be never deleted. As of > Dec 16, 2015, there are segments dating back to when we started use Kafka - > Oct 26, 2015. However the idx for the respective oldest segment file is just > about an hour fresh. All offset related settings are default. -- This message was sent by Atlassian JIRA (v6.3.4#6332)