Mapred.system.dir: should JT start without it?

2013-08-15 Thread Jay Vyas
Is there a startup for contract mapreduce making its own mapred.system.dir ? Also, it seems that the jobtracker can startup even if this directory was not created / doesn't exist - I'm thinking that if that's the case, JT should fail up front.

Re: mapred.system.dir

2010-02-12 Thread Aaron Kimball
able names like blk_4546857325993894516 will be stored there. These "blk" files represent chunks of "real" complete user-accessible files in HDFS-proper. mapred.system.dir is a filesystem path like "/system/mapred" which is served by the HDFS, where files used by MapReduce appear. The pur

Re: mapred.system.dir

2010-02-12 Thread Eric Sammer
On 2/12/10 8:40 AM, Edson Ramiro wrote: > Hi all, > > I'm setting up a Hadoop Cluster and some doubts have > arisen about hadoop configuration. > > The Hadoop Cluster Setup [1] says that the mapred.system.dir must > be in the HDFS and be accessible from both the serv

mapred.system.dir

2010-02-12 Thread Edson Ramiro
Hi all, I'm setting up a Hadoop Cluster and some doubts have arisen about hadoop configuration. The Hadoop Cluster Setup [1] says that the mapred.system.dir must be in the HDFS and be accessible from both the server and clients. Where is the HDFS directory? is the dfs.data.dir? sho