Hi! I have a question about fine-tunining hadoop performance on 8-core machines. I have 2 machines I am testing. One is 8-core Xeon and another is 8-core Opteron. 16Gb RAM each. They both run mapreduce and dfs nodes. Currently I've set up each of them to run 32 map and 8 reduce tasks. Also, HADOOP_HEAPSIZE=2048.
I see CPU is under utilized. If there is a guideline how I can find optimal number of tasks and memory setting for this kind of hardware. Also, since we going to my more machines like this, I need to decided whenever buy Xeons or Opterons. Any advise on that? Sincerely, Vadim P.S. I am using Hadoop 19 and java version "1.6.0_12": Java(TM) SE Runtime Environment (build 1.6.0_12-b04) Java HotSpot(TM) 64-Bit Server VM (build 11.2-b01, mixed mode)
