questions about replication factor of __consumer_offsets topic

of our consumers while we change the replication factor of this special topic? I think that's our next step here is to decrease to the default of 3. Regards, Dennis Ordanov

best practices for replication factor / partitions __consumer_offsets

Hi, Are there any best practices or how to size __consumer_offsets and the associated replication factor? Regards, Dennis O.

Copying messages from a single partition topic to a multi-partition topic

anyone have any other way to solve this problem or a better way of using the kafka tools? Thanks Dennis

Re: are consumer offsets stored in a log?

This will force a rewrite of those monitoring tools and UI tools that read offsets from Zookeeper in order directly to get lag information for reporting on consumer clients. It seems a good thing to know this is coming down the pipe. Dennis On Wed, Jun 4, 2014 at 6:50 PM, Neha Narkhede

How does Kafka decide which Consumer out of multiple Consumer clients to assign to a single topic partition

algorithm working after each Consumer is registered. In this case, where there is only one topic-partition, is it possible to predict what Consumer client will own the topic? How is that rebalancing done? Thanks Dennis

Re: How does Kafka decide which Consumer out of multiple Consumer clients to assign to a single topic partition

internal ip address each time, then the consumer instances will sort in different order with respect to the machine names from one deployment to another. Dennis On Thu, Aug 22, 2013 at 9:31 AM, Guozhang Wang wangg...@gmail.com wrote: Hello Dennis, The rebalance on each consumer works by first

Re: How does Kafka decide which Consumer out of multiple Consumer clients to assign to a single topic partition

-CanIpredicttheresultsoftheconsumerrebabalance%3F Dennis, please let me know if this does not fully answer your question. Guozhang On Thu, Aug 22, 2013 at 9:29 AM, Neha Narkhede neha.narkh...@gmail.com wrote: We range partition a sorted list of topic-partitions over a sorted list of consumer instances

Re: Kafka issue with Reconnect due to socket error

side around the same time? Thanks, Jun On Mon, Jul 8, 2013 at 10:25 AM, Dennis Haller dhal...@talemetry.com wrote: I have a 4-broker Kafka system running in Amazon EC2, and we are using Kafka 0.8 beta1. Most of the standard default configurations remain unchanged. Running the kafka

zookeeper loading

too much traffic to one ZK node if the same zk.connect list is used everywhere in a multi-broker system? Regards Dennis