[ https://issues.apache.org/jira/browse/MAPREDUCE-5279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14139253#comment-14139253 ]
Zhijie Shen commented on MAPREDUCE-5279: ---------------------------------------- [~vvasudev], I will take a look at the patch. > Jobs can deadlock if headroom is limited by cpu instead of memory > ----------------------------------------------------------------- > > Key: MAPREDUCE-5279 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-5279 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: mrv2, scheduler > Affects Versions: 2.0.3-alpha > Reporter: Peng Zhang > Assignee: Peng Zhang > Priority: Critical > Attachments: MAPREDUCE-5279-v2.patch, MAPREDUCE-5279.patch, > apache-mapreduce-5279.3.patch, apache-mapreduce-5279.4.patch, > apache-mapreduce-5279.5.patch > > > YARN-2 imported cpu dimension scheduling, but MR RMContainerAllocator doesn't > take into account virtual cores while scheduling reduce tasks. > This may cause more reduce tasks to be scheduled because memory is enough. > And on a small cluster, this will end with deadlock, all running containers > are reduce tasks but map phase is not finished. -- This message was sent by Atlassian JIRA (v6.3.4#6332)