Hi Andrew, YARN has a minimum allocation, which is controlled by yarn.scheduler.minimum-allocation-mb and defaults to 1024. All requests are rounded up to the nearest multiple of this number.
-Sandy On Fri, May 31, 2013 at 12:35 PM, Yuzhang Han <[email protected]>wrote: > Hi, > > Can anyone tell me how to configure the capacity of containers? Which > parameters should be set? > > I use the following command with -Dmapreduce.map.memory.mb=512, but why is > the map container size always 1024? > > $HADOOP_COMMON_HOME/bin/hadoop jar > > $HADOOP_MAPRED_HOME/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.0.4-alpha.jar > randomwriter -Dmapreduce.job.user.name=$USER > -Dmapreduce.randomwriter.bytespermap=10000 -Ddfs.block.size=536870912 > -Dmapreduce.map.memory.mb=512 output > > Thank you, > Andrew >
