h
>To: common-user@hadoop.apache.org
>Sent: Tuesday, March 27, 2012 5:18 AM
>Subject: Re: Separating mapper intermediate files
>
>Thanks Harsh.
>
>I set the mapred.local.dir as you suggested. It creates 4 folders in it for
>jobtracker, tasktracker, tt_private etc. i coul
.local.dir but
> > am
> > not sure how to use what. I would really appreciate if someone could tell
> > me
> > exactly which parameters to modify to achieve the goal.
>
> --
> Harsh J
>
>
> If you reply to this email, your message will be added t
Hello Aayush,
Three things that'd help clear your confusion:
1. dfs.data.dir controls where HDFS blocks are to be stored. Set this
to a partition1 path.
2. mapred.local.dir controls where intermediate task data go to. Set
this to a partition2 path.
> Furthermore, can someone also tell me how to s
, can someone also tell me how to save intermediate mapper
files(spill outputs) and where are they saved.
Thanks in advance for any help.
--
View this message in context:
http://hadoop-common.472056.n3.nabble.com/Separating-mapper-intermediate-files-tp3859787p3859787.html
Sent from the Users
