Hi Guys,
I was trying to setup a cluster so that two jobs can run simultaneously.
The conf :
number of nodes : 4(say)
mapred.tasktracker.map.tasks.maximum=2
and in the joblClient
mapred.map.tasks=4 (# of nodes)
I also have a condition, that each job should have only one map-task per
node
In short, created 8 map slots and set the number of mappers to 4.
So now, we have two jobs running simultaneously
However, I realized that, if a tasktracker happens to die, potentially,
I will have 2 map-tasks running on a node
Setting mapred.tasktracker.map.tasks.maximum=1 in Jobclient has no
effect. It is tasktracker property and cant be changed per job
Any ideas on how to have 2 jobs running simultaneously ?
-Sagar
