Only 24 map and 8 reduce tasks for 38 data nodes? are you sure that's
right? Sounds VERY low for a cluster that size.
We have only 10 c2100's and are running I believe 140 map and 70 reduce
slots so far with pretty decent performance.
On 10/02/2012 12:55 PM, Alexander Pivovarov wrote:
38 data nodes + 2 Name Nodes
> >
> > Data Node:
> > Dell PowerEdge C2100 series
> > 2 x XEON x5670
> > 48 GB RAM ECC (12x4GB 1333MHz)
> > 12 x 2 TB 7200 RPM SATA HDD (with hot swap) JBOD
> > Intel Gigabit ET Dual port PCIe x4
> > Redundant Power Supply
> > Hadoop CDH3
> > max map tasks 24
> > max reduce tasks 8
