[ https://issues.apache.org/jira/browse/KAFKA-13936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542381#comment-17542381 ]
Prashanth Joseph Babu commented on KAFKA-13936: ----------------------------------------------- [~mjsax] Apologies for not being specific . by kafka-ui I meant https://github.com/provectus/kafka-ui . We're seeing the same data as kafka-ui tool when we query the broker directly via kafka-cli. We're seeing a huge difference in numbers though , for a partition it would be around 10,000 in the streams application but around 600,000 in the broker side. > Invalid consumer lag when monitoring from a kafka streams application > --------------------------------------------------------------------- > > Key: KAFKA-13936 > URL: https://issues.apache.org/jira/browse/KAFKA-13936 > Project: Kafka > Issue Type: Bug > Components: streams > Reporter: Prashanth Joseph Babu > Priority: Major > > I have a kafka streams application and I'm trying to monitor the consumer lag > via stream metrics. > Here's some code snippet > {code:java} > metrics = streams.metrics(); > lag = 0; > for (Metric m : metrics.values()) { > tags = m.metricName().tags(); > if ( m.metricName().name().equals(MONITOR_CONSUMER_LAG) && > tags.containsKey(MONTOR_TAG_TOPIC) && > tags.get(MONTOR_TAG_TOPIC).equals(inputTopic) ) { > partitionLag = > Float.valueOf(m.metricValue().toString()).floatValue(); > if ( !partitionLag.isNaN() ) { > lag += partitionLag; > } > } > } > {code} > Here MONITOR_CONSUMER_LAG is {{{}records-lag-max{}}}. > However these numbers dont match with the consumer lag we see in the kafka UI > . is records-lag-max the right metric to track for a kafka streams > application when the objective is to get consumer lag? -- This message was sent by Atlassian Jira (v8.20.7#820007)