Thanks for the answer. It looks like the values are setup correctly.
I see /mapred/local directory created successfully as well. Do I need
to explicity define a value in hadoop-site.xml?
hadoop-default.xml:
mapred.local.dir
${hadoop.tmp.dir}/mapred/local
and in hadoop-site.xml:
Hi Scott,
Your reducer classes are unable to read map outputs. You may check
"mapred.local.dir" property in your conf/hadoop-default.xml and
conf/hadoop-site.xml . These directories should be valid directories in
your slaves. You can give multiple folders with comma separated values.
- Prasad.
So its not just at 16%, but depends on the task:
2008-10-30 13:58:29,702 INFO org.apache.hadoop.mapred.TaskTracker:
attempt_200810301345_0001_r_00_0 0.25675678% reduce > copy (57 of
74 at 13.58 MB/s) >
2008-10-30 13:58:29,357 WARN org.apache.hadoop.mapred.TaskTracker:
getMapOutput(atte
I'm growing very frustrated with a simple cluster setup. I can get
the cluster setup on two machines, but have troubles when trying to
extend the installation to 3 or more boxes. I keep seeing the below
errors. It seems the reduce tasks can't get access to the data.
I can't seem to figur