FairScheduler should allow separate configuration of node and rack locality
wait time
-------------------------------------------------------------------------------------
Key: MAPREDUCE-1761
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1761
Project: Hadoop Map/Reduce
Issue Type: Improvement
Affects Versions: 0.22.0
Reporter: Scott Chen
Assignee: Scott Chen
Fix For: 0.22.0
It would be nice that we can separately assign rack locality wait time.
In our use case, we would set node locality wait to zero and wait only rack
locality.
I propose that we add two parameters
mapred.fairscheduler.locality.delay.nodetorack
mapred.fairscheduler.locality.delay.racktoany
This allows specifying the wait time on each stage.
And we can use
mapred.fairscheduler.locality.delay
as the default value of the above fields so that this is backward compatible.
Thoughts?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
