Steve Kecskes created KAFKA-9249: ------------------------------------ Summary: Data exists in topic longer than retention time Key: KAFKA-9249 URL: https://issues.apache.org/jira/browse/KAFKA-9249 Project: Kafka Issue Type: Bug Affects Versions: 2.3.1 Reporter: Steve Kecskes
I am experiencing an issue where data on some topic longer than the retention time is not being cleaned. The topic "Instrument" has the following configuration {panel} h4. Topic Summary {panel} |Replication|1| |Number of Partitions|5| |Sum of partition offsets|3,715,976| |Total number of Brokers|1| |Number of Brokers for Topic|1| |Preferred Replicas %|100| |Brokers Skewed %|0| |Brokers Leader Skewed %|0| |Brokers Spread %|100| |Under-replicated %|0| |Leader Size| | ||Config||Value|| |min.cleanable.dirty.ratio|0.1| |cleanup.policy|compact,delete| |retention.ms|777600000| |delete.retention.ms|600000| |segment.bytes|5000000| |segment.ms|1800000| When reading from the topic, the first message LogAppendTime is: 2019-10-22 14:08:39.986 +0800 - this is over 30days old. The retention.ms on the topic is equal to 9 days. It was 10, I cahnged it to 9 to see if i could trigger a cleanup. Am I missing something further here? -- This message was sent by Atlassian Jira (v8.3.4#803005)