[
https://issues.apache.org/jira/browse/SPARK-18364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16622447#comment-16622447
]
Parth Gandhi commented on SPARK-18364:
--------------------------------------
I have put up a PR following up on Andrew Ash's work here:
[https://github.com/apache/spark/pull/22498.] I have added additional metrics
on top of Andrew's metrics like numRegisteredConnections which indicate the
number of registered connections to the shuffle service and
numActiveConnections which indicate the number of active connections to the
shuffle service at any given point in time. I see that there has been another
PR that is put up so I am fine if that gets merged first and the additional
metrics that I have added could be added on top of them. Thank you.
> Expose metrics for YarnShuffleService
> -------------------------------------
>
> Key: SPARK-18364
> URL: https://issues.apache.org/jira/browse/SPARK-18364
> Project: Spark
> Issue Type: Improvement
> Components: YARN
> Affects Versions: 2.0.1
> Reporter: Steven Rand
> Priority: Major
> Original Estimate: 336h
> Remaining Estimate: 336h
>
> ExternalShuffleService exposes metrics as of SPARK-16405. However,
> YarnShuffleService does not.
> The work of instrumenting ExternalShuffleBlockHandler was already done in
> SPARK-16405, so this JIRA is for creating a MetricsSystem in
> YarnShuffleService similarly to how ExternalShuffleService already does it.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
