Hi guys, My recent blog post goes through in detail the steps I took to use Whirr to start-up a CDH based Hadoop cluster on AWS. I'd really appreciate any feedback you have on it. I'm planning to write a similar on HBase.
http://www.philwhln.com/map-reduce-with-ruby-using-hadoop Thanks, Phil On Tue, Jan 4, 2011 at 12:23 AM, Lars George <lars.geo...@gmail.com> wrote: > Hi Otis, > > It also supports CDH although it does only start Hadoop > (HDFS/MapReduce). I am going to open a JIRA to facilitate the start up > of other services on top of that. > > Lars > > On Tue, Jan 4, 2011 at 4:31 AM, Otis Gospodnetic > <otis_gospodne...@yahoo.com> wrote: >> Ah, Whirr and Hadoop/HBase on AWS. Is this only applicable to using "raw" >> HBase/Hadoop from ASF or can one use Whirr support for HBase/Hadoop >> deployment >> to AWS with CDH? >> >> Thanks, >> Otis >> ---- >> Sematext :: http://sematext.com/ :: Solr - Lucene - Hadoop - HBase >> Hadoop ecosystem search :: http://search-hadoop.com/ >> >> >> >> ----- Original Message ---- >>> From: Lars George <lars.geo...@gmail.com> >>> To: user@hbase.apache.org >>> Sent: Mon, January 3, 2011 12:32:11 PM >>> Subject: Re: Hbase/Hadoop cluster setup on AWS >>> >>> Hi H, >>> >>> While you can do that by hand I strongly recommend using Apache Whirr >>> (http://incubator.apache.org/projects/whirr.html) which has Hadoop and >>> (in trunk now) also HBase support, straight from the Apache tarballs. >>> >>> If you want to set them up manually then you simply spin up N machines >>> and follow the normal guides for either project to set them up >>> appropriately, so extra magic needed. >>> >>> Lars >>> >>> On Mon, Jan 3, 2011 at 3:26 PM, h <hel...@gmail.com> wrote: >>> > Are there any good tutorials on cluster setup on AWS >>> > I'd prefer not to use third-party scripts/frameworks, just a simple >> sequence >>> > of steps/one-liner commands, using the original hadoop/hbase tarballs >>> > >>> >> > -- Cell : +1 (778) 233-4935 Twitter : http://www.twitter.com/philwhln LinkedIn : http://ca.linkedin.com/in/philwhln Blog : http://www.philwhln.com Skype : philwhelan76
