hosted environment running set of VMs.
~Brad
-Original Message-
From: Prashant Kommireddi [mailto:prash1...@gmail.com]
Sent: Tuesday, December 13, 2011 9:46 AM
To: common-user@hadoop.apache.org
Subject: Re: More cores Vs More Nodes ?
Hi Brad, how many taskstrackers did you have
copy of Up Front by Bill Maudlin. There's
a cartoon that really fits you.
Later
To: common-user@hadoop.apache.org
Subject: RE: More cores Vs More Nodes ?
From: tdeut...@us.ibm.com
Date: Wed, 14 Dec 2011 11:40:51 -0800
Your eagerness to insult is throwing you off track here Michael
a bad question because it forces you to realize
that there are definitely lots of other options. that you have to consider.
HTH
-Mike
Date: Tue, 13 Dec 2011 20:25:17 -0600
Subject: Re: More cores Vs More Nodes ?
From: airb...@gmail.com
To: common-user@hadoop.apache.org
Hi Brad
@hadoop.apache.org
Subject: RE: More cores Vs More Nodes ?
From: tdeut...@us.ibm.com
Date: Tue, 13 Dec 2011 09:46:49 -0800
It also helps to know the profile of your job in how you spec the
machines. So in addition to Brad's response you should consider if you
think your jobs will be more storage
its better to avoid building purpose built clusters. You end up not
being able to easily recycle the hardware in to new clusters easily.
But hey what do I know? ;-)
To: common-user@hadoop.apache.org
Subject: RE: More cores Vs More Nodes ?
From: tdeut...@us.ibm.com
Date: Tue, 13 Dec 2011
Putting aside any smarmy responses for a moment - sorry that job(s)
wasn't understood as equating to purpose.
If you are building a general purpose sandbox then I think we all agree on
building a balanced general purpose cluster. But if you have production
use cases in mind then you darn well
for a
specific job unless you know that you're going to be running that specific job
or set of jobs (24x7X365) [And yes, I came across such a use case...]
HTH
-Mike
From: bbock...@cse.unl.edu
Subject: Re: More cores Vs More Nodes ?
Date: Wed, 14 Dec 2011 07:41:25 -0600
To: common-user
and 'truisms'.
Unless you've had your hands dirty and at customer's sites you're going to find
the real world is a different place. ;-)
But hey! What do I know?
To: common-user@hadoop.apache.org
Subject: RE: More cores Vs More Nodes ?
From: tdeut...@us.ibm.com
Date: Wed, 14 Dec 2011 07:56:30 -0800
) [And yes, I came across such a use
case...]
HTH
-Mike
From: bbock...@cse.unl.edu
Subject: Re: More cores Vs More Nodes ?
Date: Wed, 14 Dec 2011 07:41:25 -0600
To: common-user@hadoop.apache.org
Actually, there are varying degrees here.
If you have a successful project, you will find other
Your eagerness to insult is throwing you off track here Michael.
For example, the workload profile of a cluster doing heavy NLP is very
different than one doing serving as a destination for large scale
application/web logs. Ditto for PC risk modeling vs smart meter use
cases, etc etc...Those
.
~Brad
-Original Message-
From: Prashant Kommireddi [mailto:prash1...@gmail.com]
Sent: Tuesday, December 13, 2011 9:46 AM
To: common-user@hadoop.apache.org
Subject: Re: More cores Vs More Nodes ?
Hi Brad, how many taskstrackers did you have on each node in both cases?
Thanks
Subject: Re: More cores Vs More Nodes ?
You're using OS virtualization in your test. Are you using it in production?
Russell Jurney
twitter.com/rjurney
russell.jur...@gmail.com
datasyndrome.com
On Dec 13, 2011, at 5:16 PM, Brad Sarsfield b...@bing.com wrote:
The experiment was done in a cloud
.
~Brad
-Original Message-
From: praveenesh kumar [mailto:praveen...@gmail.com]
Sent: Monday, December 12, 2011 8:51 PM
To: common-user@hadoop.apache.org
Subject: More cores Vs More Nodes ?
Hey Guys,
So I have a very naive question in my mind regarding Hadoop cluster nodes ?
more cores
@hadoop.apache.org
Subject: More cores Vs More Nodes ?
Hey Guys,
So I have a very naive question in my mind regarding Hadoop cluster nodes ?
more cores or more nodes - Shall I spend money on going from 2-4 core
machines, or spend money on buying more nodes less core eg. say 2 machines
Management
Big Data Technologies
IBM
3565 Harbor Blvd
Costa Mesa, CA 92626-1420
tdeut...@us.ibm.com
Brad Sarsfield b...@bing.com
12/13/2011 09:41 AM
Please respond to
common-user@hadoop.apache.org
To
common-user@hadoop.apache.org common-user@hadoop.apache.org
cc
Subject
RE: More cores Vs More Nodes
PM
To: common-user@hadoop.apache.org
Subject: More cores Vs More Nodes ?
Hey Guys,
So I have a very naive question in my mind regarding Hadoop cluster nodes ?
more cores or more nodes - Shall I spend money on going from 2-4 core
machines, or spend money on buying more nodes less core eg. say
To: common-user@hadoop.apache.org
Subject: More cores Vs More Nodes ?
Hey Guys,
So I have a very naive question in my mind regarding Hadoop cluster
nodes ?
more cores or more nodes - Shall I spend money on going from 2-4 core
machines, or spend money on buying more nodes less core eg. say 2
/13/2011 09:41 AM
Please respond to
common-user@hadoop.apache.org
To
common-user@hadoop.apache.org common-user@hadoop.apache.org
cc
Subject
RE: More cores Vs More Nodes ?
Praveenesh,
Your question is not naïve; in fact, optimal hardware design can
ultimately be a very difficult
running set of VMs.
~Brad
-Original Message-
From: Prashant Kommireddi [mailto:prash1...@gmail.com]
Sent: Tuesday, December 13, 2011 9:46 AM
To: common-user@hadoop.apache.org
Subject: Re: More cores Vs More Nodes ?
Hi Brad, how many taskstrackers did you have on each node in both cases
-
From: Prashant Kommireddi [mailto:prash1...@gmail.com]
Sent: Tuesday, December 13, 2011 9:46 AM
To: common-user@hadoop.apache.org
Subject: Re: More cores Vs More Nodes ?
Hi Brad, how many taskstrackers did you have on each node in both cases?
Thanks,
Prashant
Sent from my iPhone
Hey Guys,
So I have a very naive question in my mind regarding Hadoop cluster nodes ?
more cores or more nodes – Shall I spend money on going from 2-4 core
machines, or spend money on buying more nodes less core eg. say 2
machines of 2 cores for example?
Thanks,
Praveenesh
21 matches
Mail list logo
