Re: log retention and rollover

created KAFKA-1480 . Thanks! it's also generally better to have consistent/matching time unit for these two configs. On Mon, Jun 2, 2014 at 4:22 PM, Guozhang Wang wrote: > Steven, > > We initially set the rolling criterion based on hours to avo

Re: log retention and rollover

Steven, We initially set the rolling criterion based on hours to avoid too frequent log rolling and in turn too small segment files. For your case this may be reasonable to set the rolling criterion on minutes. Could you file a JIRA? Guozhang On Mon, Jun 2, 2014 at 4:00 PM, Steven Wu wrote: >

log retention and rollover

This might be a bit unusual. We have a topic that we only need to keep last 5 minutes of msgs so that replay from beginning is fast. Although retention.ms has time unit of minute, segment.ms ONLY has time unit of hour. If I understand cleanup correctly, it can only delete files that are rolled ove