Re: Hadoop cluster build, machine specs

2008-04-04 Thread Bradford Stephens
Greetings,

It really depends on your budget. What are you looking to spend? $5k?
$20k? Hadoop is about bringing the calculations to your data, so the
more machines you can have, the better.

In general, I'd recommend Dual-Core Opterons and 2-4 GB of RAM with an
SATA hard drive. My company just ordered five such machines from Dell
for Hadoop goodness, and I think the total came to around eight grand.

Another alternative is Amazon EC2 and S3, of course. It all depends on
what you want to do.


On Fri, Apr 4, 2008 at 5:27 PM, Ted Dziuba <[EMAIL PROTECTED]> wrote:
> Hi all,
>
>  I'm looking to build a small, 5-10 node cluster to run mostly CPU-bound
> Hadoop jobs.  I'm shying away from the 8-core behemoth type machines for
> cost reasons.  But what about dual core machines?  32 or 64 bits?
>
>  I'm still in the planning stages, so any advice would be greatly
> appreciated.
>
>  Thanks,
>
>  Ted
>


Hadoop cluster build, machine specs

2008-04-04 Thread Ted Dziuba

Hi all,

I'm looking to build a small, 5-10 node cluster to run mostly CPU-bound 
Hadoop jobs.  I'm shying away from the 8-core behemoth type machines for 
cost reasons.  But what about dual core machines?  32 or 64 bits?


I'm still in the planning stages, so any advice would be greatly 
appreciated.


Thanks,

Ted