[ https://issues.apache.org/jira/browse/MAPREDUCE-1018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12877336#action_12877336 ]
Vinod K V commented on MAPREDUCE-1018: -------------------------------------- This patch needs to be split across projects after MAPREDUCE-1404. I tried doing it myself for the sake of reviewing. Few links are broken in capacity_scheduler.html and cluster_setup.html. I couldn't merge changes to mapred_tutorial.xml easily, and so couldn't review it at all. The changes in capacity_scheduler.xml and cluster_setup.xml mostly look good. capacity_scheduler.xml - _"That is, the task is scheduled only if the following constraint is satisfied:"_ Can we also somehow mention here that high memory jobs can occupy multiple slots? I felt that isn't getting conveyed here, but was clear in Rahul's patch. If we do this, then we should also mention setup and cleanup tasks always occupying only a single slot. cluster_setup.xml - The documentation related to setting java.opts and ulimits w.r.t memory usage is (accidentally?) removed by your patch. > Document changes to the memory management and scheduling model > -------------------------------------------------------------- > > Key: MAPREDUCE-1018 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-1018 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: documentation > Affects Versions: 0.21.0 > Reporter: Hemanth Yamijala > Assignee: Hemanth Yamijala > Priority: Blocker > Fix For: 0.21.0 > > Attachments: MAPRED-1018-1.patch, MAPRED-1018-2.patch, > MAPRED-1018-3.patch, MAPRED-1018-4.patch.txt, MAPRED-1018-5.patch.txt, > MAPRED-1018-6.patch.txt, MAPRED-1018-7.patch.txt, MAPRED-1018-8.patch.txt, > MAPRED-1018-commons.patch > > > There were changes done for the configuration, monitoring and scheduling of > high ram jobs. This must be documented in the mapred-defaults.xml and also on > forrest documentation -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.