Re: Kafka Metrics in 0.8

2013-07-30 Thread Jun Rao
Could you run kafka-list-topics to see whether the leader of those partitions are distributed on both brokers? Thanks, Jun On Mon, Jul 29, 2013 at 10:48 PM, Hanish Bansal < hanish.bansal.agar...@gmail.com> wrote: > Yes, Kafka data shows up in the log dir in kafka-2. We are having 2 > partition

Re: Kafka Metrics in 0.8

2013-07-29 Thread Hanish Bansal
Yes, Kafka data shows up in the log dir in kafka-2. We are having 2 partitions on all brokers. On Mon, Jul 29, 2013 at 8:25 PM, Jun Rao wrote: > Does the Kafka data show up in the log dir in kafka-2? Since only the > leader can serve any traffic, if there is only have one partition or all > lea

Re: Kafka Metrics in 0.8

2013-07-29 Thread Jun Rao
Does the Kafka data show up in the log dir in kafka-2? Since only the leader can serve any traffic, if there is only have one partition or all leaders are on one broker, not all metrics (e.g., produce/fetch rate) will show up on both brokers. Thanks, Jun On Mon, Jul 29, 2013 at 6:04 AM, Hanish

Re: Kafka Metrics in 0.8

2013-07-29 Thread Hanish Bansal
Hi All, As kafka-0.8's main feature in data replication. We are running two kafka nodes(lets say: kafka-1 and kafka-2) in cluster mode. If we produce data into kafka using replication factor=2 then its replica is created on second machine. I am using jconsole to monitor kafka. if messages are go

Re: Kafka Metrics in 0.8

2013-07-03 Thread Hanish Bansal
Thanks Jun On Tue, Jul 2, 2013 at 2:35 PM, Jun Rao wrote: > In 0.8, there are more mbeans than 0.7. > > Thanks, > > Jun > > > On Mon, Jul 1, 2013 at 9:06 PM, Hanish Bansal < > hanish.bansal.agar...@gmail.com> wrote: > > > Okay i'll try for same. > > > > Also want to know that in kafka-0.7 there

Re: Kafka Metrics in 0.8

2013-07-02 Thread Jun Rao
In 0.8, there are more mbeans than 0.7. Thanks, Jun On Mon, Jul 1, 2013 at 9:06 PM, Hanish Bansal < hanish.bansal.agar...@gmail.com> wrote: > Okay i'll try for same. > > Also want to know that in kafka-0.7 there is single MBean - > SocketServerStats which provides all kafka Metrics. But in Kaf

Re: Kafka Metrics in 0.8

2013-07-01 Thread Hanish Bansal
Okay i'll try for same. Also want to know that in kafka-0.7 there is single MBean - SocketServerStats which provides all kafka Metrics. But in Kafka-0-8 there are individual MBeans (like AllTopicsBytesInPerSec, AllTopicsBytesOutPerSec etc.) for getting each parameter like ByteInRate, ByteOutRate e

Re: Kafka Metrics in 0.8

2013-07-01 Thread Jun Rao
It seems that the mbean name that you used is wrong. The mbean names registered by metrics 2.2.0 have quotes in them. Thanks, Jun On Mon, Jul 1, 2013 at 4:31 AM, Hanish Bansal < hanish.bansal.agar...@gmail.com> wrote: > Hi > > I am getting various kafka parameters (like NumFetchRequests, > Fet

Kafka Metrics in 0.8

2013-07-01 Thread Hanish Bansal
Hi I am getting various kafka parameters (like NumFetchRequests, FetchRequestsPerSecond, ProduceRequestsPerSecond etc.) through JMX in case of kafka-0.7. In kafka-0.8 i am doing the same but not able to get parameters. There are some changes in reporting metrics in kafka-0.8 as compared to kafka