Re: Frustrated with Cluster Setup: Reduce Tasks Stop at 16% - could not find taskTracker/jobcache...

2008-10-30 Thread Scott Whitecross
So its not just at 16%, but depends on the task: 2008-10-30 13:58:29,702 INFO org.apache.hadoop.mapred.TaskTracker: attempt_200810301345_0001_r_00_0 0.25675678% reduce copy (57 of 74 at 13.58 MB/s) 2008-10-30 13:58:29,357 WARN org.apache.hadoop.mapred.TaskTracker:

Re: Frustrated with Cluster Setup: Reduce Tasks Stop at 16% - could not find taskTracker/jobcache...

2008-10-30 Thread pvvpr
Hi Scott, Your reducer classes are unable to read map outputs. You may check mapred.local.dir property in your conf/hadoop-default.xml and conf/hadoop-site.xml . These directories should be valid directories in your slaves. You can give multiple folders with comma separated values. - Prasad.

Re: Frustrated with Cluster Setup: Reduce Tasks Stop at 16% - could not find taskTracker/jobcache...

2008-10-30 Thread Scott Whitecross
Thanks for the answer. It looks like the values are setup correctly. I see /mapred/local directory created successfully as well. Do I need to explicity define a value in hadoop-site.xml? hadoop-default.xml: property namemapred.local.dir/name value${hadoop.tmp.dir}/mapred/local/value