Re: Kafka Monitoring, 0.7 vs. 0.8 JMX

2013-05-08 Thread Jun Rao
; From: Jun Rao > >To: "users@kafka.apache.org" > >Sent: Wednesday, May 8, 2013 11:20 AM > >Subject: Re: Kafka Monitoring, 0.7 vs. 0.8 JMX > > > > > >0.8 JMX is different from 0.7. In 0.8, all jmx beans are exposed through > >metrics. One can a

Re: Kafka Monitoring, 0.7 vs. 0.8 JMX

2013-05-08 Thread Jun Rao
fka.apache.org" > >Sent: Wednesday, May 8, 2013 11:20 AM > >Subject: Re: Kafka Monitoring, 0.7 vs. 0.8 JMX > > > > > >0.8 JMX is different from 0.7. In 0.8, all jmx beans are exposed through > >metrics. One can attach a metric reporter for monitoring. > &g

Re: Kafka Monitoring, 0.7 vs. 0.8 JMX

2013-05-08 Thread David DeMaagd
I think there's really two angles to look at this from... 1) What is 'important' to monitor? Meaning, what subset of these are important/critical for being able to tell system health (things you want to set alerts on), what subset are nice to have for overall health and capacity planning (things

Re: Kafka Monitoring, 0.7 vs. 0.8 JMX

2013-05-08 Thread Dragos Manolescu
>From the JmxReporter section of the metrics manual: Warning We don¹t recommend that you try to gather metrics from your production environment. JMX¹s RPC API is fragile and bonkers. For development purposes and browsing, though, it can be very useful. -Dragos On 5/8/13 2:10 PM, "Otis Gospodne

Re: Kafka Monitoring, 0.7 vs. 0.8 JMX

2013-05-08 Thread Otis Gospodnetic
m/spm  > > From: Jun Rao >To: "users@kafka.apache.org" >Sent: Wednesday, May 8, 2013 11:20 AM >Subject: Re: Kafka Monitoring, 0.7 vs. 0.8 JMX > > >0.8 JMX is different from 0.7. In 0.8, all jmx beans are exposed through >met

Re: Kafka Monitoring, 0.7 vs. 0.8 JMX

2013-05-08 Thread Jun Rao
See http://metrics.codahale.com/getting-started/#reporting-via-http Thanks, Jun On Wed, May 8, 2013 at 9:03 AM, Dennis Haller wrote: > What exactly is a metric reporter - something in log4j? > > Thanks > Dennis > > > > On Wed, May 8, 2013 at 8:20 AM, Jun Rao wrote: > > > 0.8 JMX is different

Re: Kafka Monitoring, 0.7 vs. 0.8 JMX

2013-05-08 Thread Dennis Haller
What exactly is a metric reporter - something in log4j? Thanks Dennis On Wed, May 8, 2013 at 8:20 AM, Jun Rao wrote: > 0.8 JMX is different from 0.7. In 0.8, all jmx beans are exposed through > metrics. One can attach a metric reporter for monitoring. > > Thanks, > > Jun > > > On Tue, May 7,

Re: Kafka Monitoring, 0.7 vs. 0.8 JMX

2013-05-08 Thread Jun Rao
0.8 JMX is different from 0.7. In 0.8, all jmx beans are exposed through metrics. One can attach a metric reporter for monitoring. Thanks, Jun On Tue, May 7, 2013 at 1:45 PM, Otis Gospodnetic wrote: > Hi, > > We're considering adding Kafka monitoring to SPM (see > http://sematext.com/spm/inde

Kafka Monitoring, 0.7 vs. 0.8 JMX

2013-05-07 Thread Otis Gospodnetic
Hi, We're considering adding Kafka monitoring to SPM (see http://sematext.com/spm/index.html ). We use Kafka ourselves and would like to see our Kafka metrics in SPM along with Hadoop, HBase, Solr, and other metrics we monitor. My questions: * What do people currently use for monitoring Kafka? *