Hi,
Make sure to also set mapred.local.dir to the same set of output
directories, this is were the intermediate key-value pairs are stored!
Regards, Dieter
2013/12/16 Tao Xiao xiaotao.cs@gmail.com
I have ten disks per node,and I don't know what value I should set to
hadoop.tmp.dir. Some
hadoop.tmp.dir is a directory created on local file system
For example if you have set hadoop.tmp.dir property to /home/training/hadoop
This directory will be created when you format the namenode by running
the command
hadoop namenode -format
When you open this folder
you will see two
Thanks.
In order to spread I/O among multiple disks, should I assign a
comma-separated list of directories which are located on different disks to
hadoop.tmp.dir？
for example,
property
namehadoop.tmp.dir/name
Hi Tao,
No, you need to set mapred.local.dir in the mapred-site.xml with comma
separated list of path to spread I/O .
On Mon, Dec 16, 2013 at 5:11 PM, Tao Xiao xiaotao.cs@gmail.com wrote:
Thanks.
In order to spread I/O among multiple disks, should I assign a
comma-separated list of
@gmail.com]
Sent: 16 December 2013 14:42
To: user@hadoop.apache.org
Subject: Re: How to set hadoop.tmp.dir if I have multiple disks per node?
Thanks.
In order to spread I/O among multiple disks, should I assign a comma-separated
list of directories which are located on different disks
hadoop.tmp.dir if I have multiple disks per
node?
Thanks.
In order to spread I/O among multiple disks, should I assign a
comma-separated list of directories which are located on different disks to
hadoop.tmp.dir？
for example,
property
namehadoop.tmp.dir/name
value/mnt/disk1
And
/hadoop/data1/yarn/nm-local-dir
Cheers,
Vinayakumar B
*From:* Tao Xiao [mailto:xiaotao.cs@gmail.com]
*Sent:* 16 December 2013 14:42
*To:* user@hadoop.apache.org
*Subject:* Re: How to set hadoop.tmp.dir if I have multiple disks per
node?
Thanks.
In order to spread I/O among
@hadoop.apache.org
*Subject:* Re: How to set hadoop.tmp.dir if I have multiple disks per
node?
Thanks.
In order to spread I/O among multiple disks, should I assign a
comma-separated list of directories which are located on different disks to
hadoop.tmp.dir？
for example,
property
You can set the hadoop tmp dir to a directory or a disk you can mount the
disk and put path of that to the configuration file.
link /mnt
and you should set right permission for the mounted disk.
*Thanks Regards*
∞
Shashwat Shriparv
On Mon, Dec 16, 2013 at 12:32 PM, Tao Xiao
