[ https://issues.apache.org/jira/browse/SPARK-18364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16622447#comment-16622447 ]
Parth Gandhi commented on SPARK-18364: -------------------------------------- I have put up a PR following up on Andrew Ash's work here: [https://github.com/apache/spark/pull/22498.] I have added additional metrics on top of Andrew's metrics like numRegisteredConnections which indicate the number of registered connections to the shuffle service and numActiveConnections which indicate the number of active connections to the shuffle service at any given point in time. I see that there has been another PR that is put up so I am fine if that gets merged first and the additional metrics that I have added could be added on top of them. Thank you. > Expose metrics for YarnShuffleService > ------------------------------------- > > Key: SPARK-18364 > URL: https://issues.apache.org/jira/browse/SPARK-18364 > Project: Spark > Issue Type: Improvement > Components: YARN > Affects Versions: 2.0.1 > Reporter: Steven Rand > Priority: Major > Original Estimate: 336h > Remaining Estimate: 336h > > ExternalShuffleService exposes metrics as of SPARK-16405. However, > YarnShuffleService does not. > The work of instrumenting ExternalShuffleBlockHandler was already done in > SPARK-16405, so this JIRA is for creating a MetricsSystem in > YarnShuffleService similarly to how ExternalShuffleService already does it. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org