[jira] [Commented] (KAFKA-7451) Missing JMX metrics
[
https://issues.apache.org/jira/browse/KAFKA-7451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16631802#comment-16631802
]
Jork Zijlstra commented on KAFKA-7451:
--
I updated my config according to the documentation and noticed 2 things.
1) missing metrics "records-lead-min" in
kafka.consumer:type=consumer-fetch-manager-metrics,client-id="\{client-id}".
I think this is because we are missing the entire
kafka.consumer:type=consumer-fetch-manager-metrics,partition="\{partition}",topic="\{topic}",client-id="\{client-id}"
metrics, so the aggregation "records-lead-min" also doesn't happen
2) missing metrics "bufferpool-wait-time" in
kafka.producer:type=producer-metrics,client-id=([-.\w]+).
We do see "bufferpool-wait-time-total" being exported
> Missing JMX metrics
> ---
>
> Key: KAFKA-7451
> URL: https://issues.apache.org/jira/browse/KAFKA-7451
> Project: Kafka
> Issue Type: Bug
> Components: consumer
>Affects Versions: 1.0.1
>Reporter: Jork Zijlstra
>Priority: Minor
> Attachments: consumer-metrics.png, consumer-node-metrics.png
>
>
> We are trying to use the jmx metrics that are being exported using the
> documentation located at:
> [https://docs.confluent.io/current/kafka/monitoring.html]
> According to the docs there should be a "request-latency-avg" and
> "request-latency-max" available on "MBean:
> kafka.consumer:type=consumer-metrics,client-id=([-.w]+)". However what we see
> is that these metrics aren't there.
> What I have noticed is that these are only available on
> "kafka.consumer:type=consumer-node-metrics,client-id=*,node-id=*". So the per
> node metrics, while according to the documentation they shouldn't exist there.
> See attached screenshots.
>
> So I was wondering if the documentation is wrong or are the metrics not
> exported properly?
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (KAFKA-7451) Missing JMX metrics
[ https://issues.apache.org/jira/browse/KAFKA-7451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16631673#comment-16631673 ] Jork Zijlstra commented on KAFKA-7451: -- Thnx, it seem we where using the wrong documentation. The documentation you provided indeed show the metrics to be on the consumer-node-metrics not on the consumer-metrics. > Missing JMX metrics > --- > > Key: KAFKA-7451 > URL: https://issues.apache.org/jira/browse/KAFKA-7451 > Project: Kafka > Issue Type: Bug > Components: consumer >Affects Versions: 1.0.1 >Reporter: Jork Zijlstra >Priority: Minor > Attachments: consumer-metrics.png, consumer-node-metrics.png > > > We are trying to use the jmx metrics that are being exported using the > documentation located at: > [https://docs.confluent.io/current/kafka/monitoring.html] > According to the docs there should be a "request-latency-avg" and > "request-latency-max" available on "MBean: > kafka.consumer:type=consumer-metrics,client-id=([-.w]+)". However what we see > is that these metrics aren't there. > What I have noticed is that these are only available on > "kafka.consumer:type=consumer-node-metrics,client-id=*,node-id=*". So the per > node metrics, while according to the documentation they shouldn't exist there. > See attached screenshots. > > So I was wondering if the documentation is wrong or are the metrics not > exported properly? > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (KAFKA-7451) Missing JMX metrics
Jork Zijlstra created KAFKA-7451: Summary: Missing JMX metrics Key: KAFKA-7451 URL: https://issues.apache.org/jira/browse/KAFKA-7451 Project: Kafka Issue Type: Bug Components: consumer Affects Versions: 1.0.1 Reporter: Jork Zijlstra Attachments: consumer-metrics.png, consumer-node-metrics.png We are trying to use the jmx metrics that are being exported using the documentation located at: [https://docs.confluent.io/current/kafka/monitoring.html] According to the docs there should be a "request-latency-avg" and "request-latency-max" available on "MBean: kafka.consumer:type=consumer-metrics,client-id=([-.w]+)". However what we see is that these metrics aren't there. What I have noticed is that these are only available on "kafka.consumer:type=consumer-node-metrics,client-id=*,node-id=*". So the per node metrics, while according to the documentation they shouldn't exist there. See attached screenshots. So I was wondering if the documentation is wrong or are the metrics not exported properly? -- This message was sent by Atlassian JIRA (v7.6.3#76005)
