Edward Capriolo wrote:
Steve,
I ran into something with this parameter that is troublesome.
If I remember correctly mapred.local.dir used by both TaskTracker and
JobTracker.
This was a subtle problem for me because I am not able to share my
hadoop-site.xml between these nodes.
For example, right now I am sharing my configuration so I did not have
to branch it. This makes it impossible for me to do:
-Dmapred.job.tracker=local
Because each datanode does not have the same directory structure as my
JobTracker. Should mapred.local.dir be split into two separate
variables?
it takes a list so could list dirs that are valid on different machines
mapred.local.dir=/jobtracker/local, /tt/local
or play with symlinks on the machines to make their filesystems look
more consistent
