[ 
https://issues.apache.org/jira/browse/YARN-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15197440#comment-15197440
 ] 

Varun Vasudev commented on YARN-3926:
-------------------------------------

[~asuresh] - I was speaking with [~leftnoteasy] offline. I suspect we'll have 
to support 3 modes for the RM-NM handshake which admins can configure  -
# Strict - the RM and NM resource types must match
# RM subset - as long the NM resource types are a superset of the RM, the 
handshake proceeds - I believe this will address your concerns. Correct?
# Allow mismatch - the handshake will not fail due to missing resource types - 
missing resource types are presumed to be of value 0 by the RM.

Does that make sense?

> Extend the YARN resource model for easier resource-type management and 
> profiles
> -------------------------------------------------------------------------------
>
>                 Key: YARN-3926
>                 URL: https://issues.apache.org/jira/browse/YARN-3926
>             Project: Hadoop YARN
>          Issue Type: New Feature
>          Components: nodemanager, resourcemanager
>            Reporter: Varun Vasudev
>            Assignee: Varun Vasudev
>         Attachments: Proposal for modifying resource model and profiles.pdf
>
>
> Currently, there are efforts to add support for various resource-types such 
> as disk(YARN-2139), network(YARN-2140), and  HDFS bandwidth(YARN-2681). These 
> efforts all aim to add support for a new resource type and are fairly 
> involved efforts. In addition, once support is added, it becomes harder for 
> users to specify the resources they need. All existing jobs have to be 
> modified, or have to use the minimum allocation.
> This ticket is a proposal to extend the YARN resource model to a more 
> flexible model which makes it easier to support additional resource-types. It 
> also considers the related aspect of “resource profiles” which allow users to 
> easily specify the various resources they need for any given container.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to