Re: which hadoop-ec2 is preferred ( cloudera/hadoop ? )

2010-01-17 Thread Tom White
Hi Prasen, 2) is now in the Hadoop Common repository, in src/contrib/cloud. This is where the development effort is focused, and the older bash scripts (1) will be deprecated over time (HADOOP-6403). The new cloud scripts are designed to support multiple cloud providers, as well as advanced featur

Re: which hadoop-ec2 is preferred ( cloudera/hadoop ? )

2010-01-17 Thread prasenjit mukherjee
"echo $AWS_SECRET_ACCESS_KEY" returns a valid string ( as already mentioned in my mail ) Any other settings I need to do for boto to pick it up ? -Prasen On Mon, Jan 18, 2010 at 11:53 AM, Chandraprakash Bhagtani < cpbhagt...@gmail.com> wrote: > you need to set following environment variables >

Re: which hadoop-ec2 is preferred ( cloudera/hadoop ? )

2010-01-17 Thread Chandraprakash Bhagtani
you need to set following environment variables - AWS_ACCESS_KEY_ID - Your AWS Access Key ID - AWS_SECRET_ACCESS_KEY - Your AWS Secret Access Key On Mon, Jan 18, 2010 at 11:12 AM, prasenjit mukherjee wrote: > Thanks for the suggestion. Now I am getting the following error with > clouder

Re: which hadoop-ec2 is preferred ( cloudera/hadoop ? )

2010-01-17 Thread prasenjit mukherjee
Thanks for the suggestion. Now I am getting the following error with cloudera's distro. I have set AWS_SECRET_KEY appropriately though. Any pointers : pmukher...@ubuntu:~/apps/cloudera-for-hadoop-on-ec2-py-0.2.0-beta$ echo $AWS_SECRET_ACCESS_KEY <.snipped..

Re: which hadoop-ec2 is preferred ( cloudera/hadoop ? )

2010-01-17 Thread Zak Stone
In my experience, the Cloudera distributions are excellent, actively developed, and well-supported. Zak On Mon, Jan 18, 2010 at 12:01 AM, Mark Kerzner wrote: > My personal experience led me to prefer cloudera. Can't talk for every > situation, but for me the hadoop distro had many bugs and was

Re: which hadoop-ec2 is preferred ( cloudera/hadoop ? )

2010-01-17 Thread Mark Kerzner
My personal experience led me to prefer cloudera. Can't talk for every situation, but for me the hadoop distro had many bugs and was unreliable. Mark On Sun, Jan 17, 2010 at 10:58 PM, prasenjit wrote: > > It seems there are 2 hadoop-ec2 scripts: > > 1) One which comes along with the hadoop dist

which hadoop-ec2 is preferred ( cloudera/hadoop ? )

2010-01-17 Thread prasenjit
It seems there are 2 hadoop-ec2 scripts: 1) One which comes along with the hadoop distro : /src/contrib/ec2/bin/hadoop-ec2 2) Another which is downloadable from http://cloudera-packages.s3.amazonaws.com/cloudera-for-hadoop-on-ec2-py-0.3.0-beta.tar.gz and is from cloudera folks. I prefer using