becomes the next constraint. Really the xeon chipsets are
really good.
HTH
-Mike
From: matthew.go...@monsanto.com
To: common-user@hadoop.apache.org
Subject: RE: Performance Tunning
Date: Tue, 28 Jun 2011 14:46:40 +
Mike,
I'm not really sure I have seen a community consensus around
-
From: Michael Segel [mailto:michael_se...@hotmail.com]
Sent: Tuesday, June 28, 2011 1:31 PM
To: common-user@hadoop.apache.org
Subject: RE: Performance Tunning
Matthew,
I understood that Juan was talking about a 2 socket quad core box. We run
boxes with the e5500 (xeon quad core ) chips. Linux
If you are running default configurations then you are only getting 2 mappers
and 1 reducer per node. The rule of thumb I have gone on (and back up by the
definitive guide) is 2 processes per core so: tasktracker/datanode and 6 slots
left. How you break it up from there is your call but I would
Matt,
Thanks for your help!
I think I get it now, but this part is a bit confusing:
*
*
*so: tasktracker/datanode and 6 slots left. How you break it up from there
is your call but I would suggest either 4 mappers / 2 reducers or 5 mappers
/ 1 reducer.*
*
*
If it's 2 processes per core, then it's:
Ok,
So I tried putting the following config in the mapred-site.xml of all of my
nodes
configuration
property
namemapred.job.tracker/name
valuename-node:54311/value
/property
property
namemapred.map.tasks/name
value7/value
/property
property
