Stream naming conventions?

2015-02-24 Thread Taylor Gautier
Hello all, Just wondering if those with a good amount of experience using Kafka in production with many streams have converged on any sort of naming convention.  If so would you be willing to share? Thanks in advance, Taylor

Stream naming conventions?

2015-02-24 Thread Taylor Gautier
Hello all, Just wondering if those with a good amount of experience using Kafka in production with many streams have converged on any sort of naming convention. If so would you be willing to share? Thanks in advance, Taylor Gautier

Re: Using Kafka for data messages

2013-06-13 Thread Taylor Gautier
Spot on. This one was of the areas that we had to workaround. Remember that there is a 1:1 relationship of topics to directories and most file systems don't like 10s of thousands of directories. We found on practice that 60k per machine was a practical limit using I believe EXT3FS On