[
https://issues.apache.org/jira/browse/KAFKA-281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13226577#comment-13226577
]
Taylor Gautier commented on KAFKA-281:
--------------------------------------
Yes. There's not just a hard limit - there is a practical limit. We've found
that EXT3 that limit is around 20k. The limit has to do with some of the low
level posix apis and how they are implemented, I saw a post some time ago about
how to make this better, but for the time being it's generally inefficient in
most filesystems to have large numbers of files/directories in a single
directory.
Also, as you point out, it makes it next to impossible to easily add additional
storage since there is only basically one mount point.
> support multiple root log directories
> -------------------------------------
>
> Key: KAFKA-281
> URL: https://issues.apache.org/jira/browse/KAFKA-281
> Project: Kafka
> Issue Type: Improvement
> Components: core
> Reporter: Jun Rao
>
> Currently, the log layout is {log.dir}/topicname-partitionid and one can only
> specify 1 {log.dir}. This limits the # of topics we can have per broker. We
> can potentially support multiple directories for {log.dir} and just assign
> topics using hashing or round-robin.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
