Re: Kafka consumer offset topic index not getting deleted

2018-09-26 Thread Satish Duggana
>>Offsets.retention.minutes (default is 7 days, not 24 hours). In 0.11.x , default value was 24 hrs, it is changed to 7 days in 2.0[1]. Kaushik mentions that they are using 0.11.xx 1. http://kafka.apache.org/documentation/#upgrade_200_notable On Mon, Sep 24, 2018 at 8:42 PM, Kaushik Nambiar

Re: Kafka consumer offset topic index not getting deleted

2018-09-24 Thread Kaushik Nambiar
Hello, Thankyou for your reply. I have attached a text file containing the data within the server.properties file. Also I could see that it was the .log files within the __consumer_offset topic that were sizing around 100 mb each. So due to many such log files,the disk is getting maxed out. Your

Re: Kafka consumer offset topic index not getting deleted

2018-09-24 Thread M. Manna
What are your settings for: 1) Offsets.retention.check.interval.ms 2) Offsets.retention.minutes (default is 7 days, not 24 hours). Also, did this occur even after you restarted any individual brokers? Please share the server.properties "As is" for your case. Regards, On Mon, 24 Sep 2018 at

Kafka consumer offset topic index not getting deleted

2018-09-24 Thread Kaushik Nambiar
Hello, I am using a Kafka with version 0.11.xx. When I check the logs I can see the index segments for user defined topics are getting deleted. But I cannot find the indices for the consumer_offset topic getting deleted. That's causing around GBs of data getting accumulated in our persistent disk.