Hi, I am in the middle of setting up a hadoop 2 cluster. I am using the hadoop 2.1-beta tarball.
My cluster has 1 master node running the hdfs namenode, the resourcemanger and the job history server. Next to that I have 3 nodes acting as datanodes and nodemanagers. In order to test, if everything is working, I submitted the teragen job from the hadoop-examples jar like this: $ hadoop jar $HADOOP_PREFIX/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.1.0-beta.jar teragen 1000 /user/vagrant/teragen The job starts up and I get the following output: 13/08/29 14:42:46 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 13/08/29 14:42:47 INFO client.RMProxy: Connecting to ResourceManager at master.local/192.168.7.10:8032 13/08/29 14:42:48 INFO terasort.TeraSort: Generating 1000 using 2 13/08/29 14:42:48 INFO mapreduce.JobSubmitter: number of splits:2 13/08/29 14:42:48 WARN conf.Configuration: user.name is deprecated. Instead, use mapreduce.job.user.name 13/08/29 14:42:48 WARN conf.Configuration: mapred.jar is deprecated. Instead, use mapreduce.job.jar 13/08/29 14:42:48 WARN conf.Configuration: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces 13/08/29 14:42:48 WARN conf.Configuration: mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class 13/08/29 14:42:48 WARN conf.Configuration: mapreduce.map.class is deprecated. Instead, use mapreduce.job.map.class 13/08/29 14:42:48 WARN conf.Configuration: mapred.job.name is deprecated. Instead, use mapreduce.job.name 13/08/29 14:42:48 WARN conf.Configuration: mapreduce.inputformat.class is deprecated. Instead, use mapreduce.job.inputformat.class 13/08/29 14:42:48 WARN conf.Configuration: mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir 13/08/29 14:42:48 WARN conf.Configuration: mapreduce.outputformat.class is deprecated. Instead, use mapreduce.job.outputformat.class 13/08/29 14:42:48 WARN conf.Configuration: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps 13/08/29 14:42:48 WARN conf.Configuration: mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class 13/08/29 14:42:48 WARN conf.Configuration: mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir 13/08/29 14:42:49 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1377787324271_0001 13/08/29 14:42:50 INFO impl.YarnClientImpl: Submitted application application_1377787324271_0001 to ResourceManager at master.local/ 192.168.7.10:8032 13/08/29 14:42:50 INFO mapreduce.Job: The url to track the job: http://master.local:8088/proxy/application_1377787324271_0001/ 13/08/29 14:42:50 INFO mapreduce.Job: Running job: job_1377787324271_0001 and then it stops. If I check the UI, I see this: application_1377787324271_0001<http://master.local:8088/cluster/app/application_1377787324271_0001> vagrantTeraGenMAPREDUCEdefaultThu, 29 Aug 2013 14:42:49 GMTN/AACCEPTED UNDEFINED UNASSIGNED <http://master.local:8088/cluster/apps#> I have no idea, why it is not starting, nor what to look for. Any pointers are more than welcome! Thanks! - André -- André Kelpe an...@concurrentinc.com http://concurrentinc.com
