[ https://issues.apache.org/jira/browse/KAFKA-979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13942375#comment-13942375 ]
Jay Kreps commented on KAFKA-979: --------------------------------- KAFKA-615 isn't quite suffient. We still do fsync on log roll it just is done asynchronously. So if you have 1000 partitions and they all roll due to time-based roll you still get a kind of I/O storm. > Add jitter for time based rolling > --------------------------------- > > Key: KAFKA-979 > URL: https://issues.apache.org/jira/browse/KAFKA-979 > Project: Kafka > Issue Type: Bug > Reporter: Sriram Subramanian > Assignee: Sriram Subramanian > Labels: newbie > > Currently, for low volume topics time based rolling happens at the same time. > This causes a lot of IO on a typical cluster and creates back pressure. We > need to add a jitter to prevent them from happening at the same time. -- This message was sent by Atlassian JIRA (v6.2#6252)