Hi, Thanks for the answer. I know it is the way to set the capacity of each node, however, I want to know, how can we make Torque manager that we will run more than 1 mapred tasks on each machine. Because if we dont do this, torque will assign other cores on this machine to other tasks, which may cause a competition for cores.
Do you know how to solve this? Thanks. On Thu, Apr 15, 2010 at 7:01 PM, Hemanth Yamijala <yhema...@gmail.com>wrote: > Song, > > > HOD is good, and can manage a large virtual cluster on a huge > physical > > cluster. but the problem is, it doesnt apply more than one core for each > > machine, and I have already recieved complaint from our admin! > > > > I assume what you want is the Map/Reduce cluster that is started by > HOD to use more than core on each machine. You can configure this in > the gridservice-mapred section, setting the property server-params. > For example, if you want to configure 4 map and 2 reduce slots per > node, you can say: > > [gridservice-mapred] > server-params = > > mapred.tasktracker.map.tasks.maximum=4,mapred.tasktracker.reduce.tasks.maximum=2, > > That said, since you have not specified any values for these > parameters, Hadoop's defaults should be picked up, and they default to > 2 map and 2 reduce slots. Hence, it should already be using more than > one core. Are you seeing that the JobTracker administration page is > not showing multiple map and reduce slots per node ? >
