[ https://issues.apache.org/jira/browse/SPARK-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14167541#comment-14167541 ]
Sreepathi Prasanna commented on SPARK-3901: ------------------------------------------- For this, we need a SocketReporter class in coda hale which I have submitted a request for. https://github.com/dropwizard/metrics/pull/685 Once this is reviewed and merged into coda hale, we can use a socketsink class to send the metrics over socket. > Add SocketSink capability for Spark metrics > ------------------------------------------- > > Key: SPARK-3901 > URL: https://issues.apache.org/jira/browse/SPARK-3901 > Project: Spark > Issue Type: New Feature > Components: Spark Core > Affects Versions: 1.0.0, 1.1.0 > Reporter: Sreepathi Prasanna > Priority: Minor > Fix For: 1.1.1 > > Original Estimate: 48h > Remaining Estimate: 48h > > Spark depends on Coda hale metrics library to collect metrics. Today we can > send metrics to console, csv and jmx. We use chukwa as a monitoring framework > to monitor the hadoop services. To extend the the framework to collect spark > metrics, we need additional socketsink capability which is not there at the > moment in Spark. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org