[ 
https://issues.apache.org/jira/browse/KAFKA-3000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15061168#comment-15061168
 ] 

Maxim Vladimirskiy commented on KAFKA-3000:
-------------------------------------------

After I set log.cleaner.enable=true the size of the __consumer_offsets started 
to go down rapidly. Thanks a lot Grant. And you should definitely remove this 
option all together, it does not make sense to have a cleaner disabled. If a 
user neither has compacted topics nor using offset management it should not be 
a huge performance hit to have an idle cleaner sticking around, unless you 
screwed up implementing it a big time, just joking :). Keep up the good work. 
Kafka is great!

> __consumer_offsets topic grows indefinitely
> -------------------------------------------
>
>                 Key: KAFKA-3000
>                 URL: https://issues.apache.org/jira/browse/KAFKA-3000
>             Project: Kafka
>          Issue Type: Bug
>          Components: offset manager
>    Affects Versions: 0.8.2.1
>         Environment: Ubuntu 14.04, 5 node kafka cluster + 5 node ZooKeeper 
> cluster. ZooKeeper and Kafka coexist on 5 cloud boxes.
>            Reporter: Maxim Vladimirskiy
>            Assignee: Grant Henke
>
> Old segments of the __consumer_offsets topic seem to be never deleted. As of 
> Dec 16, 2015, there are segments dating back to when we started use Kafka - 
> Oct 26, 2015. However the idx for the respective oldest segment file is just 
> about an hour fresh. All offset related settings are default.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to