[ 
https://issues.apache.org/jira/browse/MAPREDUCE-3255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13135191#comment-13135191
 ] 

Milind Bhandarkar commented on MAPREDUCE-3255:
----------------------------------------------

By making the counter megabyte-seconds, we will expose the *current* resource 
model, which will definitely change in future. Instead, I prefer 
container-seconds. The resource usage of the container can be obtained from 
getResourceUsage().
                
> MR2 needs a counter analogous to "slot seconds"
> -----------------------------------------------
>
>                 Key: MAPREDUCE-3255
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3255
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv2
>    Affects Versions: 0.23.0
>            Reporter: Todd Lipcon
>
> In older versions of MR, we have a SLOT_MILLIS counter which counts how many 
> seconds each task (and job) used of map/reduce slots. Since we no longer have 
> the concept of a "slot" in MR2, we should change this counter to be something 
> like "RAM-megabyte-seconds" - ie each task is charged for its resource 
> requirement * the number of seconds it occupied those resources.
> Ideally these would be collected by the NodeManager rather than the children, 
> so that they could be used for billing purposes, but a first cut of the 
> counters through the MR framework itself would probably still be useful in 
> more trusting environments.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to