mapreduce.map.output.compress=true
mapreduce.map.output.compress.codec=org.apache.hadoop.io.compress.SnappyCodec
Hope it helps !
+ Naga
From: Omid Alipourfard [ecyn...@gmail.com]
Sent: Wednesday, August 26, 2015 10:07
To: user@hadoop.apache.org
Subject: Re: Questions with regards to Yarn
Hi Naga,
Thanks much. This can explain why I am seeing the behavior. Application
Manager is using 1.5GB of memory on the idle machine which leaves no space
for other containers to run on that machine.
To answer your other questions:
* Memory configuration of AM container
Hi Omid,
Seems like the machine which was running slow might have the AM container also
and possibly 2GB is assigned to it.
Can you share the following details :
* Memory configuration of AM container
* Containers which are running in the idling machine, is it always the same
machine or