Re: mBean to monitor message per partitions in topic

..) > > > > I try to find the solution to create "сlever" load-balancer via > > partitioner.class... > > > > Thanks in advance, Aleksey Ryabkov > > > > > > -Исходное сообщение----- > > От: Jun Rao [mailto:jun...@gmail.com] > > О

Re: mBean to monitor message per partitions in topic

... > > - compare average unread messages in topic per broker with > > current unread messages in topic for broker we can create more clever > > load balancer... > > > > > > But what can you tell about performance?... How fast I can get > >

HA: mBean to monitor message per partitions in topic

, 2014 7:34 AM Кому: users@kafka.apache.org Тема: Re: mBean to monitor message per partitions in topic If you open up jmx (e.g. jconsole) in a consumer instance, you will see the jmx of name *-ConsumerLag. Thanks, Jun On Thu, May 29, 2014 at 8:53 AM, Рябков Алексей Николаевич < a.ryab...@ntc

Re: mBean to monitor message per partitions in topic

ice for optimization? > > > Thanks, Aleksey Ryabkov > > > -Исходное сообщение- > От: Jun Rao [mailto:jun...@gmail.com] > Отправлено: Thursday, May 29, 2014 8:34 AM > Кому: users@kafka.apache.org > Тема: Re: mBean to monitor message per partitions in topic >

HA: mBean to monitor message per partitions in topic

--Исходное сообщение- От: Jun Rao [mailto:jun...@gmail.com] Отправлено: Thursday, May 29, 2014 8:34 AM Кому: users@kafka.apache.org Тема: Re: mBean to monitor message per partitions in topic There is a per-partition jmx (*-ConsumerLag) in the consumer that reports unconsumed messages per partitio

Re: mBean to monitor message per partitions in topic

There is a per-partition jmx (*-ConsumerLag) in the consumer that reports unconsumed messages per partition. Thanks, Jun On Wed, May 28, 2014 at 8:13 AM, Рябков Алексей Николаевич < a.ryab...@ntc-vulkan.ru> wrote: > Hello! > > How can I get information about unfetched message per partition in

Re: mBean to monitor message per partitions in topic

You can take a look at the consumer offset checker tool, which reads the consumed offsets in ZK and the data size in broker to compute the lag. You can re-use that logic to implement the partitioner. Guozhang On Wed, May 28, 2014 at 8:13 AM, Рябков Алексей Николаевич < a.ryab...@ntc-vulkan.ru> w

mBean to monitor message per partitions in topic

Hello! How can I get information about unfetched message per partition in topic? I wish to use such information to create my custom partitioner.class to balance messages between partitions With best regards, Aleksey Ryabkov