Re: retention.ms not working for a single topic

2019-06-20 Thread Tom Vernon
For reference, the cause of this turned out to be a corrupt timeindex file on the earliest segment in the partition. Although Kafka didn't flag the files as being corrupt, they clearly weren't correct as they had a filesize of 12bytes instead of several MB. It was fixed by stopping Kafka, removing

Re: retention.ms not working for a single topic

2019-06-19 Thread Tom Vernon
uesday, June 18, 2019 12:06 PM > To: users@kafka.apache.org > Subject: retention.ms not working for a single topic > > Hi, I have several 2.2.0 Kafka clusters, each with several topics. One of > the topics has retention.ms=60480 (7days) set at the topic level and > also log.retentio

Re: retention.ms not working for a single topic

2019-06-19 Thread Babu Turlapati
m: Tom Vernon Sent: Tuesday, June 18, 2019 12:06 PM To: users@kafka.apache.org Subject: retention.ms not working for a single topic Hi, I have several 2.2.0 Kafka clusters, each with several topics. One of the topics has retention.ms=60480 (7days) set at the topic level and also log.retention.ms=604

RE: retention.ms not working for a single topic

2019-06-18 Thread ASHOK MACHERLA
Hi Can you check segment.ms for that problem topic. And send me that topic details , check topic describe command. Sent from Outlook. From: Tom Vernon Sent: Tuesday, June 18, 2019 9:35:57 PM To: users@kafka.apache.org Subject: retention.ms not working

retention.ms not working for a single topic

2019-06-18 Thread Tom Vernon
Hi, I have several 2.2.0 Kafka clusters, each with several topics. One of the topics has retention.ms=60480 (7days) set at the topic level and also log.retention.ms=60480 (7 days) set at the cluster level. There are no other hour/day retention settings in place. The log files for this