Kim, Here's a good blog post from Confluent with advice on how to choose the number of partitions.
http://www.confluent.io/blog/how-to-choose-the-number-of-topicspartitions-in-a-kafka-cluster/ -James > On Mar 1, 2016, at 4:11 PM, BYEONG-GI KIM <bg...@bluedigm.com> wrote: > > Hello. > > I have questions about how many partitions are optimal while using kafka. > As far as I know, even if there are multiple consumers that belong to a > consumer group, say *group_A*, only one consumer can receive a kafka > message produced by a producer if there is a partition. So, as a result, > multiple partitions are required in order to distribute the message to all > the consumers in group_A if I want the consumers to get the message. > > Is it right? > > I'm considering developing several kafka consumer applications, e.g., > message saver, message analyzer, etc., so a message from a producer must be > consumed by those kinds of consumers. > > Any advice and help would be really appreciated. > > Thanks in advance! > > Best regards > > Kim ________________________________ This email and any attachments may contain confidential and privileged material for the sole use of the intended recipient. Any review, copying, or distribution of this email (or any attachments) by others is prohibited. If you are not the intended recipient, please contact the sender immediately and permanently delete this email and any attachments. No employee or agent of TiVo Inc. is authorized to conclude any binding agreement on behalf of TiVo Inc. by email. Binding agreements with TiVo Inc. may only be made by a signed written agreement.
