Hey guys, If you're okay with Clojure, I've put together a Hadoop deploy using Pallet. Here's a demo project with instructions:
https://github.com/pallet/pallet-hadoop-example I routinely boot and configure (from scratch) 50 node clusters on EC2 with no issues. Cheers, Sam On Thu, Dec 22, 2011 at 7:57 AM, Tom Wilcox <tom.wil...@cse.org.uk> wrote: > I'm interested in this too. > > You might find this article helpful: > http://hstack.org/hstack-automated-deployment-using-puppet/ > > Apparently the Adobe SaaS guys are responsible for creating a project for > puppet-Hadoop stack deployments... > > -----Original Message----- > From: warren [mailto:hadoop.com...@gmail.com] > Sent: 22 December 2011 13:28 > To: common-user@hadoop.apache.org > Subject: Re: Automate Hadoop installation > > if you use ubuntu,you can try ubuntu-orchestra-modules-hadoop > > On 2011年12月06日 03:20, Konstantin Boudnik wrote: > > These that great project called BigTop (in the apache incubator) which > > provides for building of Hadoop stack. > > > > The part of what it provides is a set of Puppet recipes which will allow > you > > to do exactly what you're looking for with perhaps some minor > corrections. > > > > Serious, look at Puppet - otherwise it will be a living through > nightmare of > > configuration mismanagements. > > > > Cos > > > > On Mon, Dec 05, 2011 at 04:02PM, praveenesh kumar wrote: > >> Hi all, > >> > >> Can anyone guide me how to automate the hadoop > installation/configuration > >> process? > >> I want to install hadoop on 10-20 nodes which may even exceed to 50-100 > >> nodes ? > >> I know we can use some configuration tools like puppet/or shell-scripts > ? > >> Has anyone done it ? > >> > >> How can we do hadoop installations on so many machines parallely ? What > are > >> the best practices for this ? > >> > >> Thanks, > >> Praveenesh > > -- Sam Ritchie, Twitter Inc 703.662.1337 @sritchie09 (Too brief? Here's why! http://emailcharter.org)