another question is ,i set the yarn.scheduler.minimum-allocation-mb is 2GB,so the container size will at less 2GB ,but i see appMaster container only use 1GB heap size why?
# ps -ef|grep 8062 yarn 8062 8047 5 09:04 ? 00:00:09 /usr/java/jdk1.7.0_25/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.mapreduce.container.log.dir=/data/mrlocal/1/yarn/logs/application_1386139114497_0024/container_1386139114497_0024_01_000001 -Dyarn.app.mapreduce.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster On Thu, Dec 5, 2013 at 5:04 AM, Jian He <j...@hortonworks.com> wrote: > you can probably try increasing > "yarn.scheduler.capacity.maximum-am-resource-percent", > This controls the max concurrently running AMs. > > Thanks, > Jian > > > On Wed, Dec 4, 2013 at 1:33 AM, ch huang <justlo...@gmail.com> wrote: > >> hi,maillist : >> i use yarn framework and capacity scheduler ,and i have >> two queue ,one for hive and the other for big MR job >> in hive queue it's work fine,because hive task is very faster ,but what >> i think is user A submitted two big MR job ,so first big job eat >> all the resource belongs to the queue ,the other big MR job should wait >> until first job finished ,how can i let the same user 's MR job can run >> parallel? >> > > > CONFIDENTIALITY NOTICE > NOTICE: This message is intended for the use of the individual or entity > to which it is addressed and may contain information that is confidential, > privileged and exempt from disclosure under applicable law. If the reader > of this message is not the intended recipient, you are hereby notified that > any printing, copying, dissemination, distribution, disclosure or > forwarding of this communication is strictly prohibited. If you have > received this communication in error, please contact the sender immediately > and delete it from your system. Thank You.
