Re: HBase, CDH3U2, EC2

2012-04-26 Thread Bryan Beaudreault
Our initial implementation was based a lot on http://hstack.org/hstack-automated-deployment-using-puppet/. However, since then we have made many customizations and moved the whole configuration stack to fabric. We've been planning a blog post on this, but we haven't gotten around to writing one y

Re: HBase, CDH3U2, EC2

2012-04-26 Thread Marcos Ortiz
Regards, Bryan. Can you share with us a blog post or simple a message how do you use this combination of Puppet and Fabric to manage your clusters on EC2? Best wishes On 04/26/2012 01:27 AM, Bryan Beaudreault wrote: We use ec2 and cdh as well and have around 80 Hadoop/hbase nodes deployed acr

Re: HBase, CDH3U2, EC2

2012-04-25 Thread Bryan Beaudreault
We use ec2 and cdh as well and have around 80 Hadoop/hbase nodes deployed across a few different clusters. We use a combination of puppet for package management and fabric scripts for pushing configs and managing services. Our base AMI is a pretty bare centos6 install and puppet handles most of