Re: What should I do with a 48-node cluster

2012-12-22 Thread Michael Segel
Uhm... not exactly. Power consumption is only part of it. ;-) Power consumption by itself is not enough to establish probable cause. If that were the case, there would be a lot of raids around the Xmas holidays ... ;-) Now don't ask me how I know this ;-P Having run a rack out of my

Re: What should I do with a 48-node cluster

2012-12-22 Thread Mark Kerzner
/463386_10151293008003232_1882563907_o.jpg -- *From:* Michael Segel michael_se...@hotmail.com *To:* user@hadoop.apache.org *Sent:* Saturday, December 22, 2012 8:01 AM *Subject:* Re: What should I do with a 48-node cluster Uhm... not exactly. Power consumption is only

Re: What should I do with a 48-node cluster

2012-12-22 Thread Edward Capriolo
You do not absolutely need more ram. You do not know your workload yet. A standard hadoop machine has 8 disks 16 GB RAM, 8 cores. In the old days, you would dedicate map slots and reduce slots map 3 map 1 reduce in your case. Give each of them 256 RAM for child jvm ops. So you needed more ram in

Re: What should I do with a 48-node cluster

2012-12-21 Thread Lance Norskog
You will also be raided by the DEA- too much power for a residence. On 12/20/2012 07:56 AM, Ted Dunning wrote: On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel michael_se...@hotmail.com mailto:michael_se...@hotmail.com wrote: While Ted ignores that the world is going to end before

Re: What should I do with a 48-node cluster

2012-12-21 Thread Mark Kerzner
True! I am thinking of either my (small) office, or actually hosting for under $500/month. On Fri, Dec 21, 2012 at 1:37 PM, Lance Norskog goks...@gmail.com wrote: You will also be raided by the DEA- too much power for a residence. On 12/20/2012 07:56 AM, Ted Dunning wrote: On Thu, Dec

Re: What should I do with a 48-node cluster

2012-12-21 Thread Edward Capriolo
Three year old blade center is ok. A three year old blade is probably a 64 bit machine. 2 to 4 gb RAM 2 SCSI disks. Maybe two socket two core. Two blade centers is about 8u or a quarter cabinet and you can find a hosting provider in your price range. Especially if you can get the hardware at a

Re: What should I do with a 48-node cluster

2012-12-20 Thread Michael Segel
While Ted ignores that the world is going to end before X-Mas, he does hit the crux of the matter head on. If you don't have a place to put it, the cost of setting it up would kill you, not to mention that you can get newer hardware which is better suited for less. Having said that... if you

Re: What should I do with a 48-node cluster

2012-12-20 Thread Ted Dunning
On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel michael_se...@hotmail.comwrote: While Ted ignores that the world is going to end before X-Mas, he does hit the crux of the matter head on. If you don't have a place to put it, the cost of setting it up would kill you, not to mention that you can

Re: What should I do with a 48-node cluster

2012-12-20 Thread Mark Kerzner
I had two servers at home, that's like a small airplane. However, I have seen silent servers in a lab I am working in. My price on that rack might be close to $0. Then I could host a rack for $500/month. And if a machine breaks, I will throw it away. So that makes for $ maintenance cost. You

Re: What should I do with a 48-node cluster

2012-12-19 Thread Mohammad Tariq
Hello sir, If you think the deal fits in your budget, better go for it. It's just a 1 time investment and provides you more control on your cluster than AWS. You can get your hands dirty with some config admin stuff as well, in case you haven't touched that part yet. But, go for it iff you

Re: What should I do with a 48-node cluster

2012-12-19 Thread Mapred Learn
What about investing this cluster in a startup if u hv some awesomeideas :) Who knows how much you might gain over next few years :) Sent from my iPhone On Dec 19, 2012, at 7:29 PM, Mark Kerzner mark.kerz...@shmsoft.com wrote: Sure, I love hardware, but aren't the hosting costs prohibitively

Re: What should I do with a 48-node cluster

2012-12-19 Thread Mark Kerzner
I am toying with exactly that idea. My startup does Hadoop eDiscovery, only we usually do it on EC2. Getting down to earth is exciting but worrying. Mark On Wed, Dec 19, 2012 at 9:32 PM, Mapred Learn mapred.le...@gmail.comwrote: What about investing this cluster in a startup if u hv some

RE: What should I do with a 48-node cluster

2012-12-19 Thread Chris Folsom
Who cares! 48 nodes = 1 node per hour the world has left. Take delivery now and write a personal check. : ) Original Message Subject: Re: What should I do with a 48-node cluster From: Mark Kerzner mark.kerz...@shmsoft.com Date: Wed, December 19, 2012 10:35 pm To: user

Re: What should I do with a 48-node cluster

2012-12-19 Thread Mohammad Tariq
: What should I do with a 48-node cluster From: Mark Kerzner mark.kerz...@shmsoft.com Date: Wed, December 19, 2012 10:35 pm To: user@hadoop.apache.org I am toying with exactly that idea. My startup does Hadoop eDiscovery, only we usually do it on EC2. Getting down to earth is exciting