[ 
https://issues.apache.org/jira/browse/MAPREDUCE-5696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13856997#comment-13856997
 ] 

Hitesh Shah commented on MAPREDUCE-5696:
----------------------------------------

The introduction of localization counters in the env is akin to introducing a 
new API in YARN. Could you split this jira out into 2. One in YARN for the YARN 
changes where the new API/interface is introduced and this jira could be 
leveraged for the MR specific changes. 

> Add Localization counters to MR
> -------------------------------
>
>                 Key: MAPREDUCE-5696
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5696
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>            Reporter: Gera Shegalov
>            Assignee: Gera Shegalov
>         Attachments: LocalizationCounters.png, MAPREDUCE-5696.v01.patch
>
>
> Users are often unaware of localization cost that their jobs incur. To 
> measure effectiveness of localization caches it is necessary to expose the 
> overhead in the form of user-visible metrics. The purpose of this JIRA is to 
> compliment YARN-1529. While YARN-1529 attempts to provide a cluster-wide view 
> to cluster admins, this JIRA focuses on exposing the localization overhead on 
> per-job basis to the job owner/user.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Reply via email to