[ 
https://issues.apache.org/jira/browse/YARN-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Varun Vasudev updated YARN-2440:
--------------------------------
    Attachment: apache-yarn-2440.6.patch

Uploaded new patch to address Vinod's comments.

{quote}
{noformat}
   <property>
  +    <description>Percentage of CPU that can be allocated
  +    for containers. This setting allows users to limit the number of
  +    physical cores that YARN containers use. Currently functional only
  +    on Linux using cgroups. The default is to use 100% of CPU.
  +    </description>
  +    <name>yarn.nodemanager.resource.percentage-physical-cpu-limit</name>
  +    <value>100</value>
  +  </property>
{noformat}

"the number of physical cores" part isn't really right. It actually is 75% 
across all cores, for e.g. We have this sort of "number of physical cores" 
description in multiple places, let's fix that? For instance, in 
NodeManagerHardwareUtils, yarn-default.xml etc.

{quote}

Fixed.

{quote}
Also,
    NM_CONTAINERS_CPU_PERC -> NM_RESOURCE_PHYSICAL_CPU_LIMIT
    Similarly rename DEFAULT_NM_CONTAINERS_CPU_PERC
{quote}

Done, I'd prefer to have percentage as part of the name. I've changed it to 
NM_RESOURCE_PERCENTAGE_PHYSICAL_CPU_LIMIT and 
DEFAULT_NM_RESOURCE_PERCENTAGE_PHYSICAL_CPU_LIMIT.

> Cgroups should allow YARN containers to be limited to allocated cores
> ---------------------------------------------------------------------
>
>                 Key: YARN-2440
>                 URL: https://issues.apache.org/jira/browse/YARN-2440
>             Project: Hadoop YARN
>          Issue Type: Bug
>            Reporter: Varun Vasudev
>            Assignee: Varun Vasudev
>         Attachments: apache-yarn-2440.0.patch, apache-yarn-2440.1.patch, 
> apache-yarn-2440.2.patch, apache-yarn-2440.3.patch, apache-yarn-2440.4.patch, 
> apache-yarn-2440.5.patch, apache-yarn-2440.6.patch, 
> screenshot-current-implementation.jpg
>
>
> The current cgroups implementation does not limit YARN containers to the 
> cores allocated in yarn-site.xml.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to