Re: the default value for param "mapreduce.reduce.shuffle.input.buffer.percent"

2014-06-25 Thread wzc
hi Sudhakara: Thank you for your reply. I've lost the old job information which I thought "mapreduce.reduce.shuffle.input.buffer.percent" was set to 0.9 in. I cant make it to read hard coded value from MergeManagerImpl.java. So maybe I made a mistake. Thanks. 2014-05-17 1:45 GMT+08:00 sudhakar

the default value for param "mapreduce.reduce.shuffle.input.buffer.percent"

2014-05-16 Thread wzc
Hi, I find the defualt value for "mapreduce.reduce.shuffle.input.buffer.percent" is 0.7 in mapred-default.xml but 0.9 in MergeManagerImpl.java. I wonder which default value should I choose ? I think 0.9 maybe too high ? Any help is appreciated. Thanks.

Re: the default value for param "mapreduce.reduce.shuffle.input.buffer.percent"

2014-05-16 Thread sudhakara st
"mapreduce.reduce.shuffle.input.buffer.percent" paramenter value is going go sets by reading the mapred-site.xml, if you not specified value in mapred-site.xml it reads value from mapred-default.xml. Its value in mapred-default.xml is 0.7. So default value is 0.7. For various reason mapreduce.redu