RE: Reg Broker information.

2014-06-29 Thread Balasubramanian Jayaraman
Thanks Yury. It worked. Bala -Original Message- From: Yury Ruchin [mailto:yuri.ruc...@gmail.com] Sent: Thursday, June 26, 2014 8:52 PM To: users@kafka.apache.org Subject: Re: Reg Broker information. In ZK shell the following command: ls /brokers/ids will give you a list like this: [0

Re: kafka splunk integration

2014-06-29 Thread Damien Dallimore
clay teahouse writes: > > Hello All, > Is there a kafka splunk loader/consumer/subscriber? I read in the > powered-by page for kafka, that square outputs kafka logs to splunk. Does > anyone know how this is done? > > thanks, > Clay > Hot off the press : http://damiendallimore.github.io/#kafk

Reg Kafka Replication

2014-06-29 Thread Balasubramanian Jayaraman
Hi, I have created a topic with the number of partitions as 5 and replication factor as 3. I have 5 Kafka brokers up and running. What happens if a broker with broker id '0' is down ? My observation is as follows. 1. The brokers are running as before and responding to the producers as

Re: Reg Kafka Replication

2014-06-29 Thread Daniel Compton
Hi Balasubramanian > Why the (topics/partition) combination which has broker with id 0 in their > replication list does not find a new broker and replicate the messages? Is > this the intended behavior of Kafka ? Do you mean, why does Broker 0 stay in the replication set for partitions when it

Kafka producer performance test sending 0x0 byte messages

2014-06-29 Thread Daniel Compton
Hi folks I was doing some performance testing using the built in Kafka performance tester and it seems like it sends messages of size n bytes but with all bytes having the value 0x0. Is that correct? Reading the source seemed to indicate that too but I'm not a Scala developer so I could be wron

Stopping thread on consumer timeout

2014-06-29 Thread Daniel Compton
I'm doing some testing to reconcile the results of mirror maker replication between two Kafka clusters across an unreliable (Internet) link using Clojure. In this case, we run our production tests, wait for MM replication to finish, then drain the topics on both sides of the network and compare