[ https://issues.apache.org/jira/browse/YARN-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Varun Vasudev updated YARN-2440: -------------------------------- Attachment: apache-yarn-2440.6.patch Uploaded new patch to address Vinod's comments. {quote} {noformat} <property> + <description>Percentage of CPU that can be allocated + for containers. This setting allows users to limit the number of + physical cores that YARN containers use. Currently functional only + on Linux using cgroups. The default is to use 100% of CPU. + </description> + <name>yarn.nodemanager.resource.percentage-physical-cpu-limit</name> + <value>100</value> + </property> {noformat} "the number of physical cores" part isn't really right. It actually is 75% across all cores, for e.g. We have this sort of "number of physical cores" description in multiple places, let's fix that? For instance, in NodeManagerHardwareUtils, yarn-default.xml etc. {quote} Fixed. {quote} Also, NM_CONTAINERS_CPU_PERC -> NM_RESOURCE_PHYSICAL_CPU_LIMIT Similarly rename DEFAULT_NM_CONTAINERS_CPU_PERC {quote} Done, I'd prefer to have percentage as part of the name. I've changed it to NM_RESOURCE_PERCENTAGE_PHYSICAL_CPU_LIMIT and DEFAULT_NM_RESOURCE_PERCENTAGE_PHYSICAL_CPU_LIMIT. > Cgroups should allow YARN containers to be limited to allocated cores > --------------------------------------------------------------------- > > Key: YARN-2440 > URL: https://issues.apache.org/jira/browse/YARN-2440 > Project: Hadoop YARN > Issue Type: Bug > Reporter: Varun Vasudev > Assignee: Varun Vasudev > Attachments: apache-yarn-2440.0.patch, apache-yarn-2440.1.patch, > apache-yarn-2440.2.patch, apache-yarn-2440.3.patch, apache-yarn-2440.4.patch, > apache-yarn-2440.5.patch, apache-yarn-2440.6.patch, > screenshot-current-implementation.jpg > > > The current cgroups implementation does not limit YARN containers to the > cores allocated in yarn-site.xml. -- This message was sent by Atlassian JIRA (v6.3.4#6332)