[jira] [Commented] (YARN-3332) [Umbrella] Unified Resource Statistics Collection per node

[Karthik Kambatla (JIRA)]

    [ 
https://issues.apache.org/jira/browse/YARN-3332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14521926#comment-14521926
 ] 

Karthik Kambatla commented on YARN-3332:
----------------------------------------

[~vinodkv] - did you start implementing this? I would like to be involved in 
the work here - either implementing parts of it or reviewing most of it. 

> [Umbrella] Unified Resource Statistics Collection per node
> ----------------------------------------------------------
>
>                 Key: YARN-3332
>                 URL: https://issues.apache.org/jira/browse/YARN-3332
>             Project: Hadoop YARN
>          Issue Type: Improvement
>            Reporter: Vinod Kumar Vavilapalli
>            Assignee: Vinod Kumar Vavilapalli
>         Attachments: Design - UnifiedResourceStatisticsCollection.pdf
>
>
> Today in YARN, NodeManager collects statistics like per container resource 
> usage and overall physical resources available on the machine. Currently this 
> is used internally in YARN by the NodeManager for only a limited usage: 
> automatically determining the capacity of resources on node and enforcing 
> memory usage to what is reserved per container.
> This proposal is to extend the existing architecture and collect statistics 
> for usage b​eyond​ the existing use­cases.
> Proposal attached in comments.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)