[
https://issues.apache.org/jira/browse/MAPREDUCE-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12936124#action_12936124
]
Matei Zaharia commented on MAPREDUCE-2198:
------------------------------------------
The approach in the patch looks good, but I have two questions:
- How can you run the FairSchedulerShell from the command line? It doesn't seem
to have a main method (so just using bin/hadoop
org.apache.hadoop.mapred.FairSchedulerShell doesn't work), and I don't see it
registered as a tool anywhere.
- Will the slot counts set by the scheduler be visible in the JobTracker web
UI? It looks like jobtracker.jsp looks at ClusterMetrics and machines.jsp looks
at TaskTrackerStatus objects.
> Allow FairScheduler to control the number of slots on each TaskTracker
> ----------------------------------------------------------------------
>
> Key: MAPREDUCE-2198
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2198
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: contrib/fair-share
> Affects Versions: 0.23.0
> Reporter: Scott Chen
> Assignee: Scott Chen
> Fix For: 0.23.0
>
> Attachments: MAPREDUCE-2198.txt
>
>
> We can set the number of slots on the TaskTracker to be high and let
> FairScheduler handles the slots.
> This approach allows us to change the number of slots on each node
> dynamically.
> The administrator can change the number of slots with a CLI tool.
> One use case of this is for upgrading the MapReduce.
> Instead of restarting the cluster, we can run the new MapReduce on the same
> cluster.
> And use the CLI tool to gradually migrate the slots.
> This way we don't lost the progress fo the jobs that's already executed.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
