Re: yarn uses nodes non symetrically

2015-11-18 Thread Eric Payne
Nicolae It depends on how big your AM container is compared to the task 
containers. By default, the AM container size is 1.5GB and the map/reduce 
containers are 1GB. You can adjust these by setting 
yarn.app.mapreduce.am.resource.mb, mapreduce.map.memory.mb, and 
mapreduce.map.memory.mb. If you make them smaller, make sure you also adjust 
the -Xmx values for the mapreduce.*.java.opts properties as well.Thanks,
-Eric
 


  From: Nicolae Marasoiu <nicolae.maras...@adswizz.com>
 To: "user@hadoop.apache.org" <user@hadoop.apache.org> 
 Sent: Tuesday, November 17, 2015 8:01 AM
 Subject: yarn uses nodes non symetrically
   
 #yiv7260601419 #yiv7260601419 -- P 
{margin-top:0;margin-bottom:0;}#yiv7260601419 Hi,
My nodes are identical, and the yarn-site.xml are identical too.However, 
between slaves, one is used to the full but the other, around half, meaning: 
one gets 4 containers, the other gets 3 (and one of them is the app master 
which is quite idle), and I don't know why.
Thanks,Nicu

   


yarn uses nodes non symetrically

2015-11-17 Thread Nicolae Marasoiu
Hi,


My nodes are identical, and the yarn-site.xml are identical too.

However, between slaves, one is used to the full but the other, around half, 
meaning: one gets 4 containers, the other gets 3 (and one of them is the app 
master which is quite idle), and I don't know why.


Thanks,

Nicu