Re: [Proposal] Enabling time series analysis on spark metrics

Precisely. Found a JIRA in this regard : SPARK-10610 On Wed, Mar 2, 2016 at 3:36 AM, Reynold Xin wrote: > Is the suggestion just to use a different config (and maybe fallback to > appid) in order to publish metrics? Seems

Re: [Proposal] Enabling time series analysis on spark metrics

Is the suggestion just to use a different config (and maybe fallback to appid) in order to publish metrics? Seems reasonable. On Tue, Mar 1, 2016 at 8:17 AM, Karan Kumar wrote: > +dev mailing list > > Time series analysis on metrics becomes quite useful when running

Re: [Proposal] Enabling time series analysis on spark metrics

+dev mailing list Time series analysis on metrics becomes quite useful when running spark jobs using a workflow manager like oozie. Would love to take this up if the community thinks its worthwhile. On Tue, Feb 23, 2016 at 2:59 PM, Karan Kumar wrote: > HI > > Spark

[Proposal] Enabling time series analysis on spark metrics

HI Spark at the moment uses application ID to report metrics. I was thinking that if we can create an option to export metrics on a user-controlled key. This will allow us to do time series analysis on counters by dumping these counters in a DB such as graphite. One of the approaches I had in