Ah great, works for me!
cheers,
sebastian
On 10.03.2011 06:01, Tom White wrote:
Sorry I missed this thread. On 0.4.0 and later
whirr.hadoop-install-runurl=cloudera/cdh/install
whirr.hadoop-configure-runurl=cloudera/cdh/post-configure
changes to
whirr.hadoop-install-function=install_cdh_hadoop
whirr.hadoop-configure-function=configure_cdh_hadoop
Cheers,
Tom
On Wed, Mar 9, 2011 at 8:23 AM, Sebastian Schoenherr
<sebastian.schoenh...@uibk.ac.at> wrote:
Hi Saptarshi,
I tried to execute my working whirr 0.3.0 configuration (identical to your
property file, using cloudera scripts) on branch-0.4 and the same issues
arised for me. Unfortunately I'm not sure yet why it's not working with
branch-0.4. Is using branch-0.3 an option for you?
Any other guesses?
cheers,
sebastian
On 08.03.2011 05:41, Saptarshi Guha wrote:
once again, i've changed the secret identity ..
On Mon, Mar 7, 2011 at 8:41 PM, Saptarshi Guha
<saptar...@revolutionanalytics.com> wrote:
Hello
No such luck on my end This is my script file, you can test that the
scripts download. But when I log in
hadoop version is. (I pulled the latest git). Also my scripts (you can
confirm if you download) echo a small line to files in /tmp.
They are not being created.
Hadoop 0.20.2
Subversion
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20
-r 911707
Compiled by chrisdo on Fri Feb 19 08:07:34 UTC 2010
whirr.cluster-name=revotesting2
whirr.service-name=hadoop
whirr.instance-templates=1 hadoop-namenode+hadoop-jobtracker,2
hadoop-datanode+hadoop-tasktracker
whirr.provider=aws-ec2
whirr.identity= AKIAJH5JBSI5KJ7YZQ6A
whirr.credential= b/kqLJAHOdRA4L30n7Zt8Edz383B1ARtPI3wiyD6
whirr.location-id=us-east-1
whirr.hardware-id=c1.xlarge
whirr.run-url-base=http://ml.stat.purdue.edu/whirr-scripts/
whirr.hadoop-install-runurl=cloudera/cdh/install
whirr.hadoop-configure-runurl=cloudera/cdh/post-configure
## Rightscales CentOS AMI
##http://support.rightscale.com/18-Release_Notes/02-AMI/RightImages_Release_Notes
jclouds.ec2.ami-owners=411009282317
whirr.image-id=us-east-1/ami-ccb35ea5
On Mon, Mar 7, 2011 at 9:59 AM, Benjamin Clark<b...@daltonclark.com>
wrote:
In my experience you need
whirr.run-url-base=http://name-of-my-bucket-with-customized-scripts/
whirr.hadoop-install-runurl=cloudera/cdh/install
and then you *also* need to have a copy of sun/java/install in that same
bucket.
And both of those scripts need to be public-readable.
So in the end you should be able to do
curl
http://name-of-my-bucket-with-customized-scripts.s3.amazonaws.com/cloudera/cdh/install
and
curl
http://name-of-my-bucket-with-customized-scripts.s3.amazonaws.com/sun/java/install
Even if you haven't customizied sun/java/install, it needs to be there.
If you do all that, the scripts will run and you will have the versions
you asked for.
`hadoop version` on the name node then says, in my case:
Hadoop 0.20.2-CDH3B4
On Mar 7, 2011, at 12:41 PM, Saptarshi Guha wrote:
Hi,
Fixed the security slip up. Did the hadoop version thing and got this
[root@domU-12-31-39-0B-CC-41 ~]# hadoop version
Hadoop 0.20.2
Subversion
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20
-r 911707
Compiled by chrisdo on Fri Feb 19 08:07:34 UTC 2010
So i guess its not CDH.
Thanks
Saptarshi
On Mon, Mar 7, 2011 at 9:22 AM, Saptarshi Guha
<saptar...@revolutionanalytics.com> wrote:
dear me! thanks, will do right away.
On Mon, Mar 7, 2011 at 1:46 AM, Sebastian Schoenherr
<sebastian.schoenh...@uibk.ac.at> wrote:
Hi Saptarshi,
Try to execute "hadoop version" on your namenode, if the output is
Hadoop
0.20.2-CDH3B4, the current cloudera distribution has been installed.
Btw, I would recommend to set your current Access Key ID and Secret
Key
inactive, since you posted it in your prop file.
cheers
sebastian
On 06.03.2011 06:54, Saptarshi Guha wrote:
Hello,
I did git clone of the latest whirr and copied cloudera scripts into
the script directory (copied over
from whirr-0.3-incubating).
My properties file is at the end of this email.
However, I don't think the scripts are being run because the
jobtracker
is the default Apache hadoop jobtracker and not the cloudera
jobtracker.
Have i missed something?
Thanks in advance
Saptarshi
## Properties
whirr.cluster-name=revotesting
whirr.service-name=hadoop
whirr.instance-templates=1 hadoop-namenode+hadoop-jobtracker,2
hadoop-datanode+hadoop-tasktracker
whirr.provider=aws-ec2
whirr.identity= AKIAI3FUFFXAPYLE7CJA
whirr.credential= 2Yq3Ar2HSxK/hbwZHs6aN6yrh0yfGNSPTpVw3t2n
whirr.location-id=us-east-1
whirr.hardware-id=c1.xlarge
## Rightscales CentOS AMI
http://support.rightscale.com/18-Release_Notes/02-AMI/RightImages_Release_Notes
jclouds.ec2.ami-owners=411009282317
whirr.image-id=us-east-1/ami-ccb35ea5
whirr.hadoop-install-runurl=cloudera/cdh/install
whirr.hadoop-configure-runurl=cloudera/cdh/post-configure
