Thanks for the update. Let me ask a question before continuing the installation. It has been stated
>>To get a Hadoop distribution, download a recent stable release from one of >>the Apache Download Mirrors. Do you mean the source package or the other? hadoop-2.3.0-src.tar.gz (14MB) hadoop-2.3.0.tar.gz (127MB) Regards, Mahmood On Friday, March 7, 2014 6:04 AM, Akira AJISAKA <ajisa...@oss.nttdata.co.jp> wrote: Hi Mahmood, > I have downloaded hadoop-2.3.0-src and followed the guide from > http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-common/SingleCluster.html The documentation is still old, and you don't need to compile the source code to build a cluster. I built the latest document and uploaded to github.io. Please follow the following page. http://aajisaka.github.io/hadoop-project/hadoop-project-dist/hadoop-common/SingleCluster.html Thanks, Akira (2014/03/06 11:08), Mahmood Naderan wrote: > Stuck at this step..... > Hope to receive any idea... > > Regards, > Mahmood > > > On Thursday, March 6, 2014 6:48 PM, Mahmood Naderan > <nt_mahm...@yahoo.com> wrote: > Hi > I have downloaded hadoop-2.3.0-src and followed the guide from > http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-common/SingleCluster.html > > The first command "mvn clean install -DskipTests" was successful. > However wen I run > > cd hadoop-mapreduce-project > mvn clean install assembly:assembly -Pnative > > At some point I get an error. Searching the error message on the web > shows some Q&A on the mailing list archive but seems that they are > related to developers. Please see the full messages below (sorry for > long post). > > Running org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup > Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.59 > sec - in org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup > Running org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler > Tests run: 3, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 4.003 > sec <<< FAILURE! - in > org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler > testFailure(org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler) > Time elapsed: 2.978 sec <<< FAILURE! > java.lang.AssertionError: null > at org.junit.Assert.fail(Assert.java:92) > at org.junit.Assert.assertTrue(Assert.java:43) > at org.junit.Assert.assertNotNull(Assert.java:526) > at org.junit.Assert.assertNotNull(Assert.java:537) > at > org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler.testFailure(TestCommitterEventHandler.java:314) > > testBasic(org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler) > Time elapsed: 0.255 sec <<< FAILURE! > java.lang.AssertionError: null > at org.junit.Assert.fail(Assert.java:92) > at org.junit.Assert.assertTrue(Assert.java:43) > at org.junit.Assert.assertNotNull(Assert.java:526) > at org.junit.Assert.assertNotNull(Assert.java:537) > at > org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler.testBasic(TestCommitterEventHandler.java:263) > > Running org.apache.hadoop.mapreduce.v2.app.TestRecovery > Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.458 > sec - in org.apache.hadoop.mapreduce.v2.app.TestRecovery > Running org.apache.hadoop.mapreduce.v2.app.TestMRAppMaster > Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.306 > sec - in org.apache.hadoop.mapreduce.v2.app.TestMRAppMaster > Running org.apache.hadoop.mapreduce.v2.app.TestMRAppComponentDependencies > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13 sec - > in org.apache.hadoop.mapreduce.v2.app.TestMRAppComponentDependencies > Running org.apache.hadoop.mapreduce.v2.app.metrics.TestMRAppMetrics > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.273 > sec - in org.apache.hadoop.mapreduce.v2.app.metrics.TestMRAppMetrics > Running org.apache.hadoop.mapreduce.v2.app.TestFetchFailure > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.859 > sec - in org.apache.hadoop.mapreduce.v2.app.TestFetchFailure > Running org.apache.hadoop.mapreduce.v2.app.TestFail > Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.483 > sec - in org.apache.hadoop.mapreduce.v2.app.TestFail > Running org.apache.hadoop.mapreduce.v2.app.TestMRApp > Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.554 > sec - in org.apache.hadoop.mapreduce.v2.app.TestMRApp > Running org.apache.hadoop.mapreduce.v2.app.TestKill > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.046 > sec - in org.apache.hadoop.mapreduce.v2.app.TestKill > Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt > Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.314 > sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt > Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl > Tests run: 15, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 13.272 > sec <<< FAILURE! - in > org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl > testKilledDuringKillAbort(org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl) > Time elapsed: 5.28 sec <<< FAILURE! > java.lang.AssertionError: expected:<SETUP> but was:<RUNNING> > at org.junit.Assert.fail(Assert.java:93) > at org.junit.Assert.failNotEquals(Assert.java:647) > at org.junit.Assert.assertEquals(Assert.java:128) > at org.junit.Assert.assertEquals(Assert.java:147) > at > org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.assertJobState(TestJobImpl.java:816) > at > org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.testKilledDuringKillAbort(TestJobImpl.java:499) > > Running > org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.051 > sec - in > org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest > Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.112 > sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider > Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskImpl > Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.34 > sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskImpl > Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.506 > sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM > Running org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncher > Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.647 > sec - in org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncher > Running > org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncherImpl > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.959 > sec - in > org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncherImpl > Running org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 115.797 > sec - in org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators > Running org.apache.hadoop.mapreduce.v2.app.TestRMContainerAllocator > Running org.apache.hadoop.mapreduce.v2.app.TestTaskHeartbeatHandler > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.881 > sec - in org.apache.hadoop.mapreduce.v2.app.TestTaskHeartbeatHandler > Running org.apache.hadoop.mapreduce.v2.app.local.TestLocalContainerAllocator > Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.103 > sec - in > org.apache.hadoop.mapreduce.v2.app.local.TestLocalContainerAllocator > Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServices > Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.577 > sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServices > Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAppController > Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.688 > sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAppController > Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebApp > Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.369 > sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebApp > Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs > Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.913 > sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs > Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobConf > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.654 > sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobConf > Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesTasks > Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.91 > sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesTasks > Running org.apache.hadoop.mapreduce.v2.app.webapp.TestBlocks > Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.656 > sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestBlocks > Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts > Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.363 > sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts > Running org.apache.hadoop.mapreduce.jobhistory.TestEvents > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.794 > sec - in org.apache.hadoop.mapreduce.jobhistory.TestEvents > Running org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler > Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.723 > sec - in org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler > Running org.apache.hadoop.mapred.TestTaskAttemptListenerImpl > Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.877 > sec - in org.apache.hadoop.mapred.TestTaskAttemptListenerImpl > > Results : > > Failed tests: > TestCommitterEventHandler.testFailure:314 null > TestCommitterEventHandler.testBasic:263 null > TestJobImpl.testKilledDuringKillAbort:499->assertJobState:816 > expected:<SETUP> but was:<RUNNING> > > Tests run: 243, Failures: 3, Errors: 0, Skipped: 0 > > [INFO] > [INFO] > ------------------------------------------------------------------------ > [INFO] Skipping hadoop-mapreduce > [INFO] This project has been banned from the build due to previous failures. > [INFO] > ------------------------------------------------------------------------ > [INFO] > ------------------------------------------------------------------------ > [INFO] Reactor Summary: > [INFO] > [INFO] hadoop-mapreduce-client ........................... SUCCESS [ > 4.600 s] > [INFO] hadoop-mapreduce-client-core ...................... SUCCESS > [02:34 min] > [INFO] hadoop-mapreduce-client-common .................... SUCCESS > [01:08 min] > [INFO] hadoop-mapreduce-client-shuffle ................... SUCCESS [ > 6.173 s] > [INFO] hadoop-mapreduce-client-app ....................... FAILURE > [11:20 min] > [INFO] hadoop-mapreduce-client-hs ........................ SKIPPED > [INFO] hadoop-mapreduce-client-jobclient ................. SKIPPED > [INFO] hadoop-mapreduce-client-hs-plugins ................ SKIPPED > [INFO] Apache Hadoop MapReduce Examples .................. SKIPPED > [INFO] hadoop-mapreduce .................................. SKIPPED > [INFO] > ------------------------------------------------------------------------ > [INFO] BUILD FAILURE > [INFO] > ------------------------------------------------------------------------ > [INFO] Total time: 15:25 min > [INFO] Finished at: 2014-03-06T18:35:49+03:30 > [INFO] Final Memory: 29M/126M > [INFO] > ------------------------------------------------------------------------ > [WARNING] The requested profile "native" could not be activated because > it does not exist. > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-surefire-plugin:2.16:test (default-test) > on project hadoop-mapreduce-client-app: ExecutionException; nested > exception is java.util.concurrent.ExecutionException: > java.lang.RuntimeException: The forked VM terminated without saying > properly goodbye. VM crash or System.exit called ? > [ERROR] Command was/bin/sh -c cd > /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app > && /usr/jdk/instances/jdk1.7.0/jre/bin/java -Xmx1024m > -XX:+HeapDumpOnOutOfMemoryError -jar > /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefirebooter8838625082162282181.jar > /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire918966405637238499tmp > /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire_753198788472362817522tmp > [ERROR] -> [Help 1] > [ERROR] > [ERROR] To see the full stack trace of the errors, re-run Maven with the > -e switch. > [ERROR] Re-run Maven using the -X switch to enable full debug logging. > [ERROR] > [ERROR] For more information about the errors and possible solutions, > please read the following articles: > [ERROR] [Help 1] > http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException > [ERROR] > [ERROR] After correcting the problems, you can resume the build with the > command > [ERROR] mvn <goals> -rf :hadoop-mapreduce-client-app > > > Regards, > Mahmood > >
