Re: Consuming from a replica

2013-11-27 Thread hsy...@gmail.com
What I did for my project is I have a thread send metadata request to a random broker and monitor the metadata change periodically. The good thing is, to my knowledge, any broker in the cluster know the metadata for all the topics served in this cluster. Another options is you can always query zook

Re: Consuming from a replica

2013-11-27 Thread Jun Rao
Currently, regular consumers can only fetch from the leader replica. Otherwise, they will get an error in response. We allow some special consumers to read from follower replicas, but this is really for testing. Are you thinking of load balancing? Currently, we do load balancing across partitions.

Consuming from a replica

2013-11-27 Thread Simon Cooper
Hi, I've been looking at the SimpleConsumer example, and that I've noticed that it always reads from the leader, and reacts to leader changes by reconnecting to the new leader. Is it possible to read from a replica in ISR that's not the leader? If so, how does the consumer get notified the repl