Harald, I note that your last modified times are all the same. Are you maybe using Java 7? There's some details here that a JDK bug in Java 7 causes the last modified time to get updated on broker restart: https://issues.apache.org/jira/browse/KAFKA-3802
On Fri, Aug 5, 2016 at 6:12 AM, Harald Kirsch <harald.kir...@raytion.com> wrote: > Hi, > > experimenting with log compaction, I see Kafka go through all the steps, > in particular I see positive messages in log-cleaner.log and *.deleted > files. Yet once the *.deleted segment files have disappeared, the segment > and index files with size 0 are still kept. > > I stopped and restarted Kafka and saw several rounds of the log cleaner go > by, but the empty files stay: > > -rw-rw-r-- 1 0 Aug 5 11:58 00000000000000000000.index > -rw-rw-r-- 1 0 Aug 5 11:58 00000000000000000000.log > -rw-rw-r-- 1 0 Aug 5 11:58 00000000000000000051.index > -rw-rw-r-- 1 0 Aug 5 11:58 00000000000000000051.log > -rw-rw-r-- 1 0 Aug 5 11:58 00000000000000000096.index > -rw-rw-r-- 1 0 Aug 5 11:58 00000000000000000096.log > [... snip ...] > -rw-rw-r-- 1 92041 Aug 5 11:58 00000000000000000680.log > -rw-rw-r-- 1 0 Aug 5 11:58 00000000000000000727.index > -rw-rw-r-- 1 199822 Aug 5 11:58 00000000000000000727.log > -rw-rw-r-- 1 10485760 Aug 5 11:58 00000000000000000781.index > -rw-rw-r-- 1 95972 Aug 5 11:58 00000000000000000781.log > > Is this expected behavior or is there yet another configuration option > that defines when these get purged? > > Harald. > -- Dustin Cote confluent.io
