you can add the following in storm.yaml to enable
LoggingMetricsConsumer
topology.metrics.consumer.register:
- class: "backtype.storm.metric.LoggingMetricsConsumer"
parallelism.hint: 1
storm UI doesn't display user provided metrics and it doesn't
also keep the historical data about the metrics , if the
cluster is restarted topology stats will be reset.
you can find bit more info on this page
[1]http://blog.relateiq.com/monitoring-storm/
-Harsha
On Fri, Sep 19, 2014, at 03:12 PM, Raphael Hsieh wrote:
Hi,
Using Storm/Trident, how do I register a metrics consumer to
log the data I get in the StormUI ?
I want to look at historical data of my topology, for example
the execute latency of the topology over time, as this would
give me good insight as to where things might be going wrong
when the system breaks.
I have been following the steps outlined in the BigData
CookBook
here: [2]http://www.bigdata-cookbook.com/post/72320512609/storm
-metrics-how-to
However I am not wanting to create my own metrics, instead I
just want to log the metrics that already exist built in to
Storm. It is unclear to me how I am supposed to go about doing
that.
Thanks
--
Raphael Hsieh
References
1. http://blog.relateiq.com/monitoring-storm/
2. http://www.bigdata-cookbook.com/post/72320512609/storm-metrics-how-to
