[
https://issues.apache.org/jira/browse/KAFKA-3000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15061168#comment-15061168
]
Maxim Vladimirskiy commented on KAFKA-3000:
-------------------------------------------
After I set log.cleaner.enable=true the size of the __consumer_offsets started
to go down rapidly. Thanks a lot Grant. And you should definitely remove this
option all together, it does not make sense to have a cleaner disabled. If a
user neither has compacted topics nor using offset management it should not be
a huge performance hit to have an idle cleaner sticking around, unless you
screwed up implementing it a big time, just joking :). Keep up the good work.
Kafka is great!
> __consumer_offsets topic grows indefinitely
> -------------------------------------------
>
> Key: KAFKA-3000
> URL: https://issues.apache.org/jira/browse/KAFKA-3000
> Project: Kafka
> Issue Type: Bug
> Components: offset manager
> Affects Versions: 0.8.2.1
> Environment: Ubuntu 14.04, 5 node kafka cluster + 5 node ZooKeeper
> cluster. ZooKeeper and Kafka coexist on 5 cloud boxes.
> Reporter: Maxim Vladimirskiy
> Assignee: Grant Henke
>
> Old segments of the __consumer_offsets topic seem to be never deleted. As of
> Dec 16, 2015, there are segments dating back to when we started use Kafka -
> Oct 26, 2015. However the idx for the respective oldest segment file is just
> about an hour fresh. All offset related settings are default.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
