Could you run kafka-list-topics to see whether the leader of those
partitions are distributed on both brokers?
Thanks,
Jun
On Mon, Jul 29, 2013 at 10:48 PM, Hanish Bansal <
hanish.bansal.agar...@gmail.com> wrote:
> Yes, Kafka data shows up in the log dir in kafka-2. We are having 2
> partitions on all brokers.
>
>
> On Mon, Jul 29, 2013 at 8:25 PM, Jun Rao <jun...@gmail.com> wrote:
>
> > Does the Kafka data show up in the log dir in kafka-2? Since only the
> > leader can serve any traffic, if there is only have one partition or all
> > leaders are on one broker, not all metrics (e.g., produce/fetch rate)
> will
> > show up on both brokers.
> >
> > Thanks,
> >
> > Jun
> >
> >
> > On Mon, Jul 29, 2013 at 6:04 AM, Hanish Bansal <
> > hanish.bansal.agar...@gmail.com> wrote:
> >
> > > Hi All,
> > >
> > > As kafka-0.8's main feature in data replication.
> > >
> > > We are running two kafka nodes(lets say: kafka-1 and kafka-2) in
> cluster
> > > mode. If we produce data into kafka using replication factor=2 then its
> > > replica is created on second machine.
> > >
> > > I am using jconsole to monitor kafka. if messages are going on kafka-1
> > then
> > > i am able to see kafka metrics on jconsole of kafka-1. But by
> connecting
> > to
> > > jconsole for kafka-2 i am not seeing any metrics, i want to know why it
> > is
> > > happening ??
> > >
> > > For more clarity i am asking same question in other way:
> > > If one kafka node is storing replicas of data, then will it be visible
> on
> > > jconsole or not ?
> > >
> > >
> > >
> > >
> > >
> > >
> > > On Wed, Jul 3, 2013 at 1:06 PM, Hanish Bansal <
> > > hanish.bansal.agar...@gmail.com> wrote:
> > >
> > > > Thanks Jun
> > > >
> > > >
> > > > On Tue, Jul 2, 2013 at 2:35 PM, Jun Rao <jun...@gmail.com> wrote:
> > > >
> > > >> In 0.8, there are more mbeans than 0.7.
> > > >>
> > > >> Thanks,
> > > >>
> > > >> Jun
> > > >>
> > > >>
> > > >> On Mon, Jul 1, 2013 at 9:06 PM, Hanish Bansal <
> > > >> hanish.bansal.agar...@gmail.com> wrote:
> > > >>
> > > >> > Okay i'll try for same.
> > > >> >
> > > >> > Also want to know that in kafka-0.7 there is single MBean -
> > > >> > SocketServerStats which provides all kafka Metrics. But in
> Kafka-0-8
> > > >> there
> > > >> > are individual MBeans (like AllTopicsBytesInPerSec,
> > > >> AllTopicsBytesOutPerSec
> > > >> > etc.) for getting each parameter like ByteInRate, ByteOutRate etc.
> > > >> >
> > > >> > Does kafka-0.8 provide any single MBean from which we can get all
> > > >> > parameters?
> > > >> >
> > > >> >
> > > >> >
> > > >> >
> > > >> > On Mon, Jul 1, 2013 at 3:47 PM, Jun Rao <jun...@gmail.com> wrote:
> > > >> >
> > > >> > > It seems that the mbean name that you used is wrong. The mbean
> > names
> > > >> > > registered by metrics 2.2.0 have quotes in them.
> > > >> > >
> > > >> > > Thanks,
> > > >> > >
> > > >> > > Jun
> > > >> > >
> > > >> > >
> > > >> > > On Mon, Jul 1, 2013 at 4:31 AM, Hanish Bansal <
> > > >> > > hanish.bansal.agar...@gmail.com> wrote:
> > > >> > >
> > > >> > > > Hi
> > > >> > > >
> > > >> > > > I am getting various kafka parameters (like NumFetchRequests,
> > > >> > > > FetchRequestsPerSecond, ProduceRequestsPerSecond etc.) through
> > JMX
> > > >> in
> > > >> > > case
> > > >> > > > of kafka-0.7.
> > > >> > > >
> > > >> > > > In kafka-0.8 i am doing the same but not able to get
> parameters.
> > > >> > > >
> > > >> > > > There are some changes in reporting metrics in kafka-0.8 as
> > > >> compared to
> > > >> > > > kafka-0.7. I have already noticed that. According to changes
> in
> > > >> > > kafka-0.8 i
> > > >> > > > am trying to get kafka metrics using JMX through jmxtrans api.
> > > >> > > >
> > > >> > > > Here is sample java code of getting jmx parameters using
> > jmxtrans
> > > >> api:
> > > >> > > >
> > > >> > > > Server kafkaJMXServer = new Server("127.0.0.1",
> "9999");
> > > >> > > > Query query1 = new Query();
> > > >> > > >
> > > >> > > >
> > > >> > > >
> > > >> > >
> > > >> >
> > > >>
> > >
> >
> query1.setObj("kafka.server:type=BrokerTopicMetrics,name=AllTopicsBytesInPerSec");
> > > >> > > > query1.addAttr("MeanRate");
> > > >> > > > kafkaJMXServer.addQuery(query1);
> > > >> > > > JmxProcess process = new JmxProcess(kafkaJMXServer);
> > > >> > > > JmxUtils.execute(process);
> > > >> > > > System.out.println(query1.getResults());
> > > >> > > >
> > > >> > > > Please let me know what i am missing?
> > > >> > > >
> > > >> > > > --
> > > >> > > > *Thanks & Regards*
> > > >> > > > *Hanish Bansal*
> > > >> > > >
> > > >> > >
> > > >> >
> > > >> >
> > > >> >
> > > >> > --
> > > >> > *Thanks & Regards*
> > > >> > *Hanish Bansal*
> > > >> >
> > > >>
> > > >
> > > >
> > > >
> > > > --
> > > > *Thanks & Regards*
> > > > *Hanish Bansal*
> > > >
> > >
> > >
> > >
> > > --
> > > *Thanks & Regards*
> > > *Hanish Bansal*
> > >
> >
>
>
>
> --
> *Thanks & Regards*
> *Hanish Bansal*
>
