And one more thing, I do see the Kafka metrics in the dashboard.
From: Jayesh Thakrar <[email protected]>
To: "[email protected]" <[email protected]>
Sent: Wednesday, May 6, 2015 9:53 PM
Subject: Kafka broker metrics not appearing in REST API
Hi,
I have installed 2 clusters with Ambari and Storm and Kafka.After the install,
I was able to get metrics for both Storm and Kafka via REST API.This worked
fine for a week, but since the past 2 days, I have not been getting Kafka
metrics.
I need the metrics to push to an OpenTSDB cluster.I do get host metrics and
Nimbus metrics but not KAFKA_BROKER metrics.
I did have maintenance turned on for some time, but maintenance is turned off
now.
[jthakrar@dtord01hdp0101d ~]$ curl --user admin:admin
'http://dtord01flm01p:8080/api/v1/clusters/ord_flume_kafka_prod/components/NIMBUS?fields=metrics'{
"href" :
"http://dtord01flm01p:8080/api/v1/clusters/ord_flume_kafka_prod/components/NIMBUS?fields=metrics";,
"ServiceComponentInfo" : { "cluster_name" : "ord_flume_kafka_prod",
"component_name" : "NIMBUS", "service_name" : "STORM" }, "metrics" : {
"storm" : { "nimbus" : { "freeslots" : 54.0, "supervisors" :
27.0, "topologies" : 0.0, "totalexecutors" : 0.0,
"totalslots" : 54.0, "totaltasks" : 0.0, "usedslots" : 0.0 }
} }}
[jthakrar@dtord01hdp0101d ~]$ curl --user admin:admin
'http://dtord01flm01p:8080/api/v1/clusters/ord_flume_kafka_prod/components/KAFKA_BROKER?fields=metrics'{
"href" :
"http://dtord01flm01p:8080/api/v1/clusters/ord_flume_kafka_prod/components/KAFKA_BROKER?fields=metrics";,
"ServiceComponentInfo" : { "cluster_name" : "ord_flume_kafka_prod",
"component_name" : "KAFKA_BROKER", "service_name" : "KAFKA" }}
[jthakrar@dtord01hdp0101d ~]$ curl --user admin:admin
'http://dtord01flm01p:8080/api/v1/clusters/ord_flume_kafka_prod/components/SUPERVISOR?fields=metrics'{
"href" :
"http://dtord01flm01p:8080/api/v1/clusters/ord_flume_kafka_prod/components/SUPERVISOR?fields=metrics";,
"ServiceComponentInfo" : { "cluster_name" : "ord_flume_kafka_prod",
"component_name" : "SUPERVISOR", "service_name" : "STORM" }
