Re: Frustrated with Cluster Setup: Reduce Tasks Stop at 16% - could not find taskTracker/jobcache...

2008-10-30 Thread Scott Whitecross
Thanks for the answer. It looks like the values are setup correctly. I see /mapred/local directory created successfully as well. Do I need to explicity define a value in hadoop-site.xml? hadoop-default.xml: mapred.local.dir ${hadoop.tmp.dir}/mapred/local and in hadoop-site.xml:

Re: Frustrated with Cluster Setup: Reduce Tasks Stop at 16% - could not find taskTracker/jobcache...

2008-10-30 Thread pvvpr
Hi Scott, Your reducer classes are unable to read map outputs. You may check "mapred.local.dir" property in your conf/hadoop-default.xml and conf/hadoop-site.xml . These directories should be valid directories in your slaves. You can give multiple folders with comma separated values. - Prasad.

Re: Frustrated with Cluster Setup: Reduce Tasks Stop at 16% - could not find taskTracker/jobcache...

2008-10-30 Thread Scott Whitecross
So its not just at 16%, but depends on the task: 2008-10-30 13:58:29,702 INFO org.apache.hadoop.mapred.TaskTracker: attempt_200810301345_0001_r_00_0 0.25675678% reduce > copy (57 of 74 at 13.58 MB/s) > 2008-10-30 13:58:29,357 WARN org.apache.hadoop.mapred.TaskTracker: getMapOutput(atte

Frustrated with Cluster Setup: Reduce Tasks Stop at 16%

2008-10-30 Thread Scott Whitecross
I'm growing very frustrated with a simple cluster setup. I can get the cluster setup on two machines, but have troubles when trying to extend the installation to 3 or more boxes. I keep seeing the below errors. It seems the reduce tasks can't get access to the data. I can't seem to figur