RE: Questions with regards to Yarn/Hadoop

2015-08-26 Thread Naganarasimha G R (Naga)
mapreduce.map.output.compress=true mapreduce.map.output.compress.codec=org.apache.hadoop.io.compress.SnappyCodec Hope it helps ! + Naga From: Omid Alipourfard [ecyn...@gmail.com] Sent: Wednesday, August 26, 2015 10:07 To: user@hadoop.apache.org Subject: Re: Questions with regards to Yarn

Re: Questions with regards to Yarn/Hadoop

2015-08-25 Thread Omid Alipourfard
Hi Naga, Thanks much. This can explain why I am seeing the behavior. Application Manager is using 1.5GB of memory on the idle machine which leaves no space for other containers to run on that machine. To answer your other questions: * Memory configuration of AM container

RE: Questions with regards to Yarn/Hadoop

2015-08-25 Thread Naganarasimha G R (Naga)
Hi Omid, Seems like the machine which was running slow might have the AM container also and possibly 2GB is assigned to it. Can you share the following details : * Memory configuration of AM container * Containers which are running in the idling machine, is it always the same machine or