So as I noted, it really does depend on what you need. In the case of a
small number of topics, I would say to make the number of partitions be a
multiple of the number of brokers. That will balance them in the cluster,
while still giving you some freedom to have larger partition counts for
larger
Thanks for the info, Todd. This is very useful. Please see my question
inline:
On Mon, Apr 6, 2015 at 10:24 AM, Todd Palino wrote:
>
> - Partition count (leader and follower combined) on each broker should
> stay under 4000
>
> As far as topic volume goes, it varies widely. We have topics
Luckily, I was just reviewing a lot of this information for my ApacheCon
talk next week. Those slides, and the video (I hope) will be published as
soon as the talk is done. I'll give you the information I have from
LinkedIn's point of view, but out of order :)
Our Kafka brokers are all the same mo
Hello,
I am trying to understand some of the common Kafka deployment sizes
("small", "medium", "large") and configuration to come up with a set of common
templates for deployment on Linux. Some of the Qs to answer are:
- Number of nodes in the cluster
- Machine Specs (cpu, memory, num
