[ https://issues.apache.org/jira/browse/KAFKA-281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13226577#comment-13226577 ]
Taylor Gautier commented on KAFKA-281: -------------------------------------- Yes. There's not just a hard limit - there is a practical limit. We've found that EXT3 that limit is around 20k. The limit has to do with some of the low level posix apis and how they are implemented, I saw a post some time ago about how to make this better, but for the time being it's generally inefficient in most filesystems to have large numbers of files/directories in a single directory. Also, as you point out, it makes it next to impossible to easily add additional storage since there is only basically one mount point. > support multiple root log directories > ------------------------------------- > > Key: KAFKA-281 > URL: https://issues.apache.org/jira/browse/KAFKA-281 > Project: Kafka > Issue Type: Improvement > Components: core > Reporter: Jun Rao > > Currently, the log layout is {log.dir}/topicname-partitionid and one can only > specify 1 {log.dir}. This limits the # of topics we can have per broker. We > can potentially support multiple directories for {log.dir} and just assign > topics using hashing or round-robin. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira