Hi Mark, I have the required code already in place that gathers the Storm metrics via Nimbus api calls. What I am looking for is a way to forward those to Ganglia to display on Ganglia web screen.
Thanks Bijoy On Tue, Jan 21, 2014 at 6:31 AM, Mark Greene <m...@evertrue.com> wrote: > Hey Bijoy, > > Not sure how you would go about capturing number of spouts/bolts but we've > done some custom metrics capturing with respect to latencies inside spouts > and bolts. > > For spouts, when you override the open method, you have access to a > TopologyContext object. This is where you can add a TaskHook. We use this > as a callback to record latencies for spout. > > For bolts similar situation but for the prepare method. > > You just also need to be aware that the sampling rate of these callback > hooks are controlled from within the Topology Config object via conf. > setStatsSampleRate(double). > > > On Mon, Jan 20, 2014 at 12:05 PM, bijoy deb <bijoy.comput...@gmail.com>wrote: > >> Hi, >> >> I am trying to use Ganglia to capture all the metrics that are displayed >> in Storm UI. I am not quite sure on how to do that.I was able to integrate >> Cassandra with Ganglia,where I just need to specify the metric name I want >> to capture in a cassandra config file and Ganglia displays that metric.Is >> there anything similar for Storm as well? I know its possible to capture >> the JVM,Memory stats of the Storm cluster,but I am more interested in Storm >> specific parameters such as Nimbus config,Number of spouts/bolts,Tuples >> emitted,Tuples acked,Latency,etc. >> >> Any help in this regard will be highly appreciated. >> > >
