Re: Consumer Group rebalancing events

2020-09-03 Thread Devaki, Srinivas
Hi Tess D'erberwill, Таисия Дорошенков,

Thanks a lot for the reply on this, one major issue I found with our
existing metrics is that they are not granular enough i.e if the
rebalancing finishes under 10 seconds then I might lose that event in the
metrics if my metrics scrape interval is 10 seconds.

Any suggestions around how to log the exact events than metrics(major
concern is around losing the events)

Thanks

On Tue, Aug 25, 2020 at 7:59 PM Tess D'erberwill 
wrote:

> Hi, Srinivas Devaki !
>
> There are Kafka JMX metrics - NumGroupsCompletingRebalance and
> NumGroupsPreparingRebalance. I think you can monitor them by some
> application and calculate statistic.
> As for us - we added Jolokia agent to our Kafka docker image and Jolokia
> expose all JMX metrics via HTTP. We run additional service which gets
> necessary metrics from this endpoint and analyse them.
>
> On 2020/08/23 16:39:35, "Devaki, Srinivas" 
> wrote:
> > Hi Folks,
> >
> > I’m trying to find the consumer group rebalancing events, so to plot how
> > much time consumer groups usually take in rebalancing during application
> > deployments.
> >
> > I’ve tried to check the logs of `server.log`, `controller.log`,
> > `state-change.log`. but couldn’t find anything about rebalancing.
> >
> >
> > Thanks & Regards
> > Srinivas Devaki
> > sre @ zomato
> >
>


Re: Consumer Group rebalancing events

2020-08-25 Thread Tess D'erberwill
Hi, Srinivas Devaki !

There are Kafka JMX metrics - NumGroupsCompletingRebalance and 
NumGroupsPreparingRebalance. I think you can monitor them by some application 
and calculate statistic. 
As for us - we added Jolokia agent to our Kafka docker image and Jolokia expose 
all JMX metrics via HTTP. We run additional service which gets necessary 
metrics from this endpoint and analyse them.

On 2020/08/23 16:39:35, "Devaki, Srinivas"  wrote: 
> Hi Folks,
> 
> I’m trying to find the consumer group rebalancing events, so to plot how
> much time consumer groups usually take in rebalancing during application
> deployments.
> 
> I’ve tried to check the logs of `server.log`, `controller.log`,
> `state-change.log`. but couldn’t find anything about rebalancing.
> 
> 
> Thanks & Regards
> Srinivas Devaki
> sre @ zomato
> 


Re: Consumer Group rebalancing events

2020-08-25 Thread Таисия Дорошенкова

 Hi,  Srinivas Devaki!

There are Kafka JMX metrics - NumGroupsCompletingRebalance and 
NumGroupsPreparingRebalance. I think you can monitor them by some application 
and calculate statistic.
As for us - we added Jolokia agent to our Kafka docker image and Jolokia expose 
all JMX metrics via HHTP. We run additional service which gets necessary 
metrics from this endpoint and analyse them.
--  
С уважением, Таисия Дорошенкова


On 2020/08/23 16:39:35, "Devaki, Srinivas" < me@eightnoteight.space > wrote:
> Hi Folks,
>
> I’m trying to find the consumer group rebalancing events, so to plot how
> much time consumer groups usually take in rebalancing during application
> deployments.
>
> I’ve tried to check the logs of `server.log`, `controller.log`,
> `state-change.log`. but couldn’t find anything about rebalancing.
>
>
> Thanks & Regards
> Srinivas Devaki
> sre @ zomato
>

Consumer Group rebalancing events

2020-08-23 Thread Devaki, Srinivas
Hi Folks,

I’m trying to find the consumer group rebalancing events, so to plot how
much time consumer groups usually take in rebalancing during application
deployments.

I’ve tried to check the logs of `server.log`, `controller.log`,
`state-change.log`. but couldn’t find anything about rebalancing.


Thanks & Regards
Srinivas Devaki
sre @ zomato