Andrew Otto created KAFKA-3802:
----------------------------------
Summary: log mtimes reset on broker restart
Key: KAFKA-3802
URL: https://issues.apache.org/jira/browse/KAFKA-3802
Project: Kafka
Issue Type: Bug
Affects Versions: 0.9.0.1
Reporter: Andrew Otto
Folks over in
http://mail-archives.apache.org/mod_mbox/kafka-users/201605.mbox/%3CCAO8=cz0ragjad1acx4geqcwj+rkd1gmdavkjwytwthkszfg...@mail.gmail.com%3E
are commenting about this issue.
In 0.9, any data log file that was on
disk before the broker has it's mtime modified to the time of the broker
restart.
This causes problems with log retention, as all the files then look like
they contain recent data to kafka. We use the default log retention of 7
days, but if all the files are touched at the same time, this can cause us
to retain up to 2 weeks of log data, which can fill up our disks.
This happens *most* of the time, but seemingly not all. We have seen broker
restarts where mtimes were not changed.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
