Hello folks,

   My question is about Kafka client metrics exported by Flink. According
to the Flink documentation
<https://ci.apache.org/projects/flink/flink-docs-stable/dev/connectors/kafka.html#kafka-connector-metrics>:
"The producers export Kafka’s internal metrics through Flink’s metric
system for all supported versions. The consumers export all metrics
starting from Kafka version 0.9. The Kafka documentation lists all exported
metrics in its documentation
<http://kafka.apache.org/documentation/#selector_monitoring>", which points
to Kafka documentation for all exported metrics. In the referenced Kafka
doc, there are three types of metrics that are exported, partition level,
topic level and client level. For example, for consumer fetch metrics,
three categories are:
kafka.consumer:type=consumer-fetch-manager-metrics,client-id="{client-id}"
kafka.consumer:type=consumer-fetch-manager-metrics,client-id="{client-id}",topic="{topic}"
kafka.consumer:type=consumer-fetch-manager-metrics,partition="{partition}",topic="{topic}",client-id="{client-id}"

But somehow I only see client-level metrics, not topic- or partition-level
ones. Does anyone know why that is the case? Does Flink filter exported
Kafka metrics?

Reply via email to