Hi Tess D'erberwill, Таисия Дорошенков, Thanks a lot for the reply on this, one major issue I found with our existing metrics is that they are not granular enough i.e if the rebalancing finishes under 10 seconds then I might lose that event in the metrics if my metrics scrape interval is 10 seconds.
Any suggestions around how to log the exact events than metrics(major concern is around losing the events) Thanks On Tue, Aug 25, 2020 at 7:59 PM Tess D'erberwill <tessderberw...@gmail.com> wrote: > Hi, Srinivas Devaki ! > > There are Kafka JMX metrics - NumGroupsCompletingRebalance and > NumGroupsPreparingRebalance. I think you can monitor them by some > application and calculate statistic. > As for us - we added Jolokia agent to our Kafka docker image and Jolokia > expose all JMX metrics via HTTP. We run additional service which gets > necessary metrics from this endpoint and analyse them. > > On 2020/08/23 16:39:35, "Devaki, Srinivas" <me@eightnoteight.space> > wrote: > > Hi Folks, > > > > I’m trying to find the consumer group rebalancing events, so to plot how > > much time consumer groups usually take in rebalancing during application > > deployments. > > > > I’ve tried to check the logs of `server.log`, `controller.log`, > > `state-change.log`. but couldn’t find anything about rebalancing. > > > > > > Thanks & Regards > > Srinivas Devaki > > sre @ zomato > > >
