Hi!

I have a question about fine-tunining hadoop performance on 8-core machines.
I have 2 machines I am testing. One is 8-core Xeon and another is 8-core
Opteron. 16Gb RAM each. They both run mapreduce and dfs nodes. Currently
I've set up each of them to run 32 map and 8 reduce tasks.
Also, HADOOP_HEAPSIZE=2048.

I see CPU is under utilized. If there is a guideline how I can find optimal
number of tasks and memory setting for this kind of hardware.

Also, since we going to my more machines like this, I need to decided
whenever buy Xeons or Opterons. Any advise on that?

Sincerely,
Vadim

P.S. I am using Hadoop 19 and java version "1.6.0_12":
Java(TM) SE Runtime Environment (build 1.6.0_12-b04)
Java HotSpot(TM) 64-Bit Server VM (build 11.2-b01, mixed mode)

Reply via email to