Here it is
whirr.cluster-name=XXX-hadoop-XXX
# Change the number of machines in the cluster here
whirr.instance-templates=1 hadoop-namenode+hadoop-jobtracker,4
hadoop-datanode+hadoop-tasktracker
# Uncomment out these lines to run CDH
whirr.hadoop.install-function=install_cdh_hadoop
whirr.hadoop.configure-function=configure_cdh_hadoop
# For EC2 set AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY environment variables.
whirr.provider=aws-ec2
#whirr.identity=${env:AWS_ACCESS_KEY_ID}
#whirr.credential=${env:AWS_SECRET_ACCESS_KEY}
whirr.identity=XXXXX
whirr.credential=XXXXX
# The size of the instance to use. See http://aws.amazon.com/ec2/instance-types/
whirr.hardware-id=m1.xlarge
# Ubuntu 10.04 LTS Lucid. See http://alestic.com/
whirr.image-id=us-east-1/ami-1035d279
# If you choose a different location, make sure whirr.image-id is updated too
whirr.location-id=us-east-1a
# You can also specify the spot instance price
#http://aws.amazon.com/ec2/spot-instances/
#whirr.aws-ec2-spot-price=0.50
# By default use the user system SSH keys. Override them here.
whirr.private-key-file=${sys:user.home}/.ssh/xxxxx
whirr.public-key-file=${sys:user.home}/.ssh/xxxx
hadoop-mapreduce.mapred.child.java.opts=-Xms4G -Xmx4G
-XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
-XX:ErrorFile=/mnt/tmp/data/java_error%p.log
hadoop-hdfs.dfs.replication=2
hadoop-mapreduce.mapred.tasktracker.reduce.tasks.maximum=2
hadoop-mapreduce.mapred.tasktracker.map.tasks.maximum=2
I used 0.7.0 and the same file is working fine. Its a copy of
hadoop-ec2.properties.
nothing started in my cluster, so terminated it. I might be missing something :(
thanks
ashish
On Fri, Feb 24, 2012 at 11:28 PM, Tom White <[email protected]> wrote:
> Ashish,
>
> What was the recipe you used? I tried using
> recipes/hadoop-ec2.properties from 0.7.1 with the lines for CDH
> uncommented, and the tasktracker started OK.
>
> Cheers,
> Tom
>
> On Fri, Feb 24, 2012 at 9:43 AM, Ashish <[email protected]> wrote:
>> 0.7.1 didn't work for me. Downloaded and extracted the tar
>> copied my recipe from 0.7.0. Using CDH. Clustered fired but Hadoop
>> didn't worked.
>>
>> Got this error in logs
>> Starting Hadoop tasktracker daemon (hadoop-tasktracker): starting
>> tasktracker, logging to
>> /var/log/hadoop/logs/hadoop-hadoop-tasktracker-ip-10-108-26-104.out
>> su: /usr/lib/jvm/java-1.6.0-openjdk/bin/java: No such file or directory
>>
>> Am I missing something? or my recipe is has some issue?
>>
>> thanks
>> ashish
>>
>> On Fri, Feb 24, 2012 at 4:02 PM, Adrian Cole <[email protected]> wrote:
>>> +1
>>>
>>> extracted from tar and ran the following on cloudservers-us and aws-ec2
>>>
>>> bin/whirr (launch|destroy)-cluster --cluster-name zoocassandra
>>> --instance-templates '1 zookeeper+cassandra'
>>>
>>> -A
>>>
>>> On Fri, Feb 24, 2012 at 8:36 AM, Jean-Baptiste Onofré <[email protected]>
>>> wrote:
>>>> +1 (non binding)
>>>>
>>>> Regards
>>>> JB
>>>>
>>>>
>>>> On 02/24/2012 01:13 AM, Andrei Savu wrote:
>>>>>
>>>>> This is the first release candidate for Apache Whirr, version 0.7.1.
>>>>>
>>>>> It fixes the following
>>>>>
>>>>> issues:https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12311110&version=12319942
>>>>>
>>>>>
>>>>> *** Please download, test and vote by 28 February.
>>>>>
>>>>> Note that we are voting upon the source (tag), binaries are provided
>>>>> for convenience.
>>>>>
>>>>> Source and binary
>>>>> files:http://people.apache.org/~asavu/whirr-0.7.1-candidate-0/
>>>>>
>>>>> Maven staging
>>>>> repo:https://repository.apache.org/content/repositories/orgapachewhirr-061
>>>>>
>>>>> The tag to be voted
>>>>> upon:http://svn.apache.org/repos/asf/whirr/tags/release-0.7.1
>>>>>
>>>>> Whirr's KEYS file containing PGP keys we use to sign the
>>>>> release:http://svn.apache.org/repos/asf/whirr/dist/KEYS
>>>>>
>>>>
>>>> --
>>>> Jean-Baptiste Onofré
>>>> [email protected]
>>>> http://blog.nanthrax.net
>>>> Talend - http://www.talend.com
>>
>>
>>
>> --
>> thanks
>> ashish
>>
>> Blog: http://www.ashishpaliwal.com/blog
>> My Photo Galleries: http://www.pbase.com/ashishpaliwal
--
thanks
ashish
Blog: http://www.ashishpaliwal.com/blog
My Photo Galleries: http://www.pbase.com/ashishpaliwal