[ https://issues.apache.org/jira/browse/YARN-1003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13726100#comment-13726100 ]
Sandy Ryza commented on YARN-1003: ---------------------------------- This makes it so that we don't need to use the resources we currently have as proxies for the ones we don't. If we add resources like disk and network I/O, this will become much less necessary, but I still think a high number of containers will put load on a system in ways that we won't account for. Open file descriptors for example. If my machine has 8 GB, I might want to allow a 512 MB container to fit in between a 4 GB one and a 3.5 GB one, but might not want to allow 16 512 MB containers. > Add a maxContainersPerNode config to the Fair Scheduler > ------------------------------------------------------- > > Key: YARN-1003 > URL: https://issues.apache.org/jira/browse/YARN-1003 > Project: Hadoop YARN > Issue Type: Improvement > Components: scheduler > Affects Versions: 2.1.0-beta > Reporter: Sandy Ryza > Assignee: Karthik Kambatla > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira