Re: Spindle per Cores

2012-10-12 Thread Ted Dunning
It depends on your distribution. Some distributions are more efficient at driving spindles than others. Ratios as high as 2 spindles per core are sometimes quite reasonable. On Fri, Oct 12, 2012 at 10:46 AM, Patai Sangbutsarakum silvianhad...@gmail.com wrote: I have read around about the

Re: Spindle per Cores

2012-10-12 Thread Patai Sangbutsarakum
@hadoop.apache.orgmailto:user@hadoop.apache.org Date: Fri, 12 Oct 2012 12:11:56 -0700 To: user@hadoop.apache.orgmailto:user@hadoop.apache.org Subject: Re: Spindle per Cores It depends on your distribution. Some distributions are more efficient at driving spindles than others. Ratios as high as 2 spindles per core

RE: Spindle per Cores

2012-10-12 Thread Hank Cohen
that the mix was optimal? Hank Cohen Altior Inc. -Original Message- From: Patai Sangbutsarakum [mailto:silvianhad...@gmail.com] Sent: Friday, October 12, 2012 10:46 AM To: user@hadoop.apache.org Subject: Spindle per Cores I have read around about the hardware recommendation for hadoop cluster. One

Re: Spindle per Cores

2012-10-12 Thread Ted Dunning
To: user@hadoop.apache.org Subject: Spindle per Cores I have read around about the hardware recommendation for hadoop cluster. One of them is recommend 1:1 ratio between spindle per core. Intel CPU come with Hyperthread which will double the number cores on one physical CPU. eg. 8 cores

RE: Spindle per Cores

2012-10-12 Thread Jeffrey Buell
are true (that is, no other bottlenecks), consider adding more drives. Jeff -Original Message- From: Hank Cohen [mailto:hank.co...@altior.com] Sent: Friday, October 12, 2012 1:46 PM To: user@hadoop.apache.org Subject: RE: Spindle per Cores What empirical evidence

Re: Spindle per Cores

2012-10-12 Thread Michael Segel
: Friday, October 12, 2012 1:46 PM To: user@hadoop.apache.org Subject: RE: Spindle per Cores What empirical evidence is there for this rule of thumb? In other words, what tests or metrics would indicate an optimal spindle/core ratio and how dependent is this on the nature of the data

Re: Spindle per Cores

2012-10-12 Thread Michael Segel
[mailto:hank.co...@altior.com] Sent: Friday, October 12, 2012 1:46 PM To: user@hadoop.apache.org Subject: RE: Spindle per Cores What empirical evidence is there for this rule of thumb? In other words, what tests or metrics would indicate an optimal spindle/core ratio and how dependent

Re: Spindle per Cores

2012-10-12 Thread ranjith raghunath
- From: Hank Cohen [mailto:hank.co...@altior.com] Sent: Friday, October 12, 2012 1:46 PM To: user@hadoop.apache.org Subject: RE: Spindle per Cores What empirical evidence is there for this rule of thumb? In other words, what tests or metrics would indicate an optimal spindle/core

Re: Spindle per Cores

2012-10-12 Thread Patai Sangbutsarakum
...@gmail.com Reply-To: user@hadoop.apache.orgmailto:user@hadoop.apache.org Date: Fri, 12 Oct 2012 22:27:50 -0500 To: user@hadoop.apache.orgmailto:user@hadoop.apache.org Subject: Re: Spindle per Cores Thanks Michael. On Oct 12, 2012 9:59 PM, Michael Segel michael_se...@hotmail.commailto:michael_se