Ashish, I see that the AMI you are using is cloudera-hadoop-0.3.0-x86_64.manifest.xml, which is a very old Cloudera AMI. I suspect that the problem you are having is installing OpenJDK on this image. I would recommend moving off this AMI onto a more recent one, such as the one in the recipes file (ami-da0cf8b3).
Cheers, Tom On Fri, Feb 24, 2012 at 10:51 AM, Ashish <[email protected]> wrote: > Tom, > > I copied the recipes/hadoop-ec2.properties recpie and tried it. It worked. > > The only difference I see is the AMI that I am using to fire the cluster. > The same works fine with 0.7.0. Could it be a intermittent error? > > thanks > ashish > > On Fri, Feb 24, 2012 at 11:32 PM, Ashish <[email protected]> wrote: >> Here it is >> >> whirr.cluster-name=XXX-hadoop-XXX >> >> # Change the number of machines in the cluster here >> whirr.instance-templates=1 hadoop-namenode+hadoop-jobtracker,4 >> hadoop-datanode+hadoop-tasktracker >> >> # Uncomment out these lines to run CDH >> whirr.hadoop.install-function=install_cdh_hadoop >> whirr.hadoop.configure-function=configure_cdh_hadoop >> >> # For EC2 set AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY environment >> variables. >> whirr.provider=aws-ec2 >> #whirr.identity=${env:AWS_ACCESS_KEY_ID} >> #whirr.credential=${env:AWS_SECRET_ACCESS_KEY} >> whirr.identity=XXXXX >> whirr.credential=XXXXX >> >> # The size of the instance to use. See >> http://aws.amazon.com/ec2/instance-types/ >> whirr.hardware-id=m1.xlarge >> # Ubuntu 10.04 LTS Lucid. See http://alestic.com/ >> whirr.image-id=us-east-1/ami-1035d279 >> # If you choose a different location, make sure whirr.image-id is updated too >> whirr.location-id=us-east-1a >> >> # You can also specify the spot instance price >> #http://aws.amazon.com/ec2/spot-instances/ >> #whirr.aws-ec2-spot-price=0.50 >> >> # By default use the user system SSH keys. Override them here. >> whirr.private-key-file=${sys:user.home}/.ssh/xxxxx >> whirr.public-key-file=${sys:user.home}/.ssh/xxxx >> >> hadoop-mapreduce.mapred.child.java.opts=-Xms4G -Xmx4G >> -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC >> -XX:ErrorFile=/mnt/tmp/data/java_error%p.log >> hadoop-hdfs.dfs.replication=2 >> hadoop-mapreduce.mapred.tasktracker.reduce.tasks.maximum=2 >> hadoop-mapreduce.mapred.tasktracker.map.tasks.maximum=2 >> >> I used 0.7.0 and the same file is working fine. Its a copy of >> hadoop-ec2.properties. >> >> nothing started in my cluster, so terminated it. I might be missing >> something :( >> >> thanks >> ashish >> >> On Fri, Feb 24, 2012 at 11:28 PM, Tom White <[email protected]> wrote: >>> Ashish, >>> >>> What was the recipe you used? I tried using >>> recipes/hadoop-ec2.properties from 0.7.1 with the lines for CDH >>> uncommented, and the tasktracker started OK. >>> >>> Cheers, >>> Tom >>> >>> On Fri, Feb 24, 2012 at 9:43 AM, Ashish <[email protected]> wrote: >>>> 0.7.1 didn't work for me. Downloaded and extracted the tar >>>> copied my recipe from 0.7.0. Using CDH. Clustered fired but Hadoop >>>> didn't worked. >>>> >>>> Got this error in logs >>>> Starting Hadoop tasktracker daemon (hadoop-tasktracker): starting >>>> tasktracker, logging to >>>> /var/log/hadoop/logs/hadoop-hadoop-tasktracker-ip-10-108-26-104.out >>>> su: /usr/lib/jvm/java-1.6.0-openjdk/bin/java: No such file or directory >>>> >>>> Am I missing something? or my recipe is has some issue? >>>> >>>> thanks >>>> ashish >>>> >>>> On Fri, Feb 24, 2012 at 4:02 PM, Adrian Cole <[email protected]> wrote: >>>>> +1 >>>>> >>>>> extracted from tar and ran the following on cloudservers-us and aws-ec2 >>>>> >>>>> bin/whirr (launch|destroy)-cluster --cluster-name zoocassandra >>>>> --instance-templates '1 zookeeper+cassandra' >>>>> >>>>> -A >>>>> >>>>> On Fri, Feb 24, 2012 at 8:36 AM, Jean-Baptiste Onofré <[email protected]> >>>>> wrote: >>>>>> +1 (non binding) >>>>>> >>>>>> Regards >>>>>> JB >>>>>> >>>>>> >>>>>> On 02/24/2012 01:13 AM, Andrei Savu wrote: >>>>>>> >>>>>>> This is the first release candidate for Apache Whirr, version 0.7.1. >>>>>>> >>>>>>> It fixes the following >>>>>>> >>>>>>> issues:https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12311110&version=12319942 >>>>>>> >>>>>>> >>>>>>> *** Please download, test and vote by 28 February. >>>>>>> >>>>>>> Note that we are voting upon the source (tag), binaries are provided >>>>>>> for convenience. >>>>>>> >>>>>>> Source and binary >>>>>>> files:http://people.apache.org/~asavu/whirr-0.7.1-candidate-0/ >>>>>>> >>>>>>> Maven staging >>>>>>> repo:https://repository.apache.org/content/repositories/orgapachewhirr-061 >>>>>>> >>>>>>> The tag to be voted >>>>>>> upon:http://svn.apache.org/repos/asf/whirr/tags/release-0.7.1 >>>>>>> >>>>>>> Whirr's KEYS file containing PGP keys we use to sign the >>>>>>> release:http://svn.apache.org/repos/asf/whirr/dist/KEYS >>>>>>> >>>>>> >>>>>> -- >>>>>> Jean-Baptiste Onofré >>>>>> [email protected] >>>>>> http://blog.nanthrax.net >>>>>> Talend - http://www.talend.com >>>> >>>> >>>> >>>> -- >>>> thanks >>>> ashish >>>> >>>> Blog: http://www.ashishpaliwal.com/blog >>>> My Photo Galleries: http://www.pbase.com/ashishpaliwal >> >> >> >> -- >> thanks >> ashish >> >> Blog: http://www.ashishpaliwal.com/blog >> My Photo Galleries: http://www.pbase.com/ashishpaliwal > > > > -- > thanks > ashish > > Blog: http://www.ashishpaliwal.com/blog > My Photo Galleries: http://www.pbase.com/ashishpaliwal
