hadoop 0.16.4
Why are mapred.reduce.tasks and mapred.map.tasks always showing up
as "2"?
I have the same config on all nodes.
hadoop-site.xml contains the following parameters:
<property>
<name>mapred.map.tasks</name>
<value>67</value>
<description>The default number of map tasks per job. Typically set
to a prime several times greater than number of available hosts.
Ignored when mapred.job.tracker is "local".
</description>
</property>
<property>
<name>mapred.reduce.tasks</name>
<value>23</value>
<description>The default number of reduce tasks per job. Typically set
to a prime close to the number of available hosts. Ignored when
mapred.job.tracker is "local".
</description>
</property>
<property>
<name>mapred.job.tracker</name>
<value>idx1-r70:50030</value> <!-- mapred.job.tracker -->
<description>The host and port that the MapReduce job tracker runs
at. If "local", then jobs are run in-process as a single map
and reduce task.
</description>
</property>
--
James Graham (Greywolf) |
650.930.1138|925.768.4053 *
[EMAIL PROTECTED] |
Check out what people are saying about SearchMe! -- click below
http://www.searchme.com/stack/109aa