Hi I have downloaded hadoop-2.3.0-src and followed the guide from http://hadoop.apache.org/docs/r2.3.0/hadoop-project-dist/hadoop-common/SingleCluster.html
The first command "mvn clean install -DskipTests" was successful. However wen I run cd hadoop-mapreduce-project mvn clean install assembly:assembly -Pnative At some point I get an error. Searching the error message on the web shows some Q&A on the mailing list archive but seems that they are related to developers. Please see the full messages below (sorry for long post). Running org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.59 sec - in org.apache.hadoop.mapreduce.v2.app.TestStagingCleanup Running org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler Tests run: 3, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 4.003 sec <<< FAILURE! - in org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler testFailure(org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler) Time elapsed: 2.978 sec <<< FAILURE! java.lang.AssertionError: null at org.junit.Assert.fail(Assert.java:92) at org.junit.Assert.assertTrue(Assert.java:43) at org.junit.Assert.assertNotNull(Assert.java:526) at org.junit.Assert.assertNotNull(Assert.java:537) at org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler.testFailure(TestCommitterEventHandler.java:314) testBasic(org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler) Time elapsed: 0.255 sec <<< FAILURE! java.lang.AssertionError: null at org.junit.Assert.fail(Assert.java:92) at org.junit.Assert.assertTrue(Assert.java:43) at org.junit.Assert.assertNotNull(Assert.java:526) at org.junit.Assert.assertNotNull(Assert.java:537) at org.apache.hadoop.mapreduce.v2.app.commit.TestCommitterEventHandler.testBasic(TestCommitterEventHandler.java:263) Running org.apache.hadoop.mapreduce.v2.app.TestRecovery Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 62.458 sec - in org.apache.hadoop.mapreduce.v2.app.TestRecovery Running org.apache.hadoop.mapreduce.v2.app.TestMRAppMaster Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.306 sec - in org.apache.hadoop.mapreduce.v2.app.TestMRAppMaster Running org.apache.hadoop.mapreduce.v2.app.TestMRAppComponentDependencies Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13 sec - in org.apache.hadoop.mapreduce.v2.app.TestMRAppComponentDependencies Running org.apache.hadoop.mapreduce.v2.app.metrics.TestMRAppMetrics Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.273 sec - in org.apache.hadoop.mapreduce.v2.app.metrics.TestMRAppMetrics Running org.apache.hadoop.mapreduce.v2.app.TestFetchFailure Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.859 sec - in org.apache.hadoop.mapreduce.v2.app.TestFetchFailure Running org.apache.hadoop.mapreduce.v2.app.TestFail Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.483 sec - in org.apache.hadoop.mapreduce.v2.app.TestFail Running org.apache.hadoop.mapreduce.v2.app.TestMRApp Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 38.554 sec - in org.apache.hadoop.mapreduce.v2.app.TestMRApp Running org.apache.hadoop.mapreduce.v2.app.TestKill Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.046 sec - in org.apache.hadoop.mapreduce.v2.app.TestKill Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.314 sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttempt Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl Tests run: 15, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 13.272 sec <<< FAILURE! - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl testKilledDuringKillAbort(org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl) Time elapsed: 5.28 sec <<< FAILURE! java.lang.AssertionError: expected:<SETUP> but was:<RUNNING> at org.junit.Assert.fail(Assert.java:93) at org.junit.Assert.failNotEquals(Assert.java:647) at org.junit.Assert.assertEquals(Assert.java:128) at org.junit.Assert.assertEquals(Assert.java:147) at org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.assertJobState(TestJobImpl.java:816) at org.apache.hadoop.mapreduce.v2.app.job.impl.TestJobImpl.testKilledDuringKillAbort(TestJobImpl.java:499) Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.051 sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskAttemptContainerRequest Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.112 sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestShuffleProvider Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskImpl Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.34 sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestTaskImpl Running org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.506 sec - in org.apache.hadoop.mapreduce.v2.app.job.impl.TestMapReduceChildJVM Running org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncher Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.647 sec - in org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncher Running org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncherImpl Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.959 sec - in org.apache.hadoop.mapreduce.v2.app.launcher.TestContainerLauncherImpl Running org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 115.797 sec - in org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators Running org.apache.hadoop.mapreduce.v2.app.TestRMContainerAllocator Running org.apache.hadoop.mapreduce.v2.app.TestTaskHeartbeatHandler Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.881 sec - in org.apache.hadoop.mapreduce.v2.app.TestTaskHeartbeatHandler Running org.apache.hadoop.mapreduce.v2.app.local.TestLocalContainerAllocator Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.103 sec - in org.apache.hadoop.mapreduce.v2.app.local.TestLocalContainerAllocator Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServices Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.577 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServices Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAppController Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.688 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAppController Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebApp Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.369 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebApp Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.913 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobs Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobConf Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.654 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesJobConf Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesTasks Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.91 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesTasks Running org.apache.hadoop.mapreduce.v2.app.webapp.TestBlocks Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.656 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestBlocks Running org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.363 sec - in org.apache.hadoop.mapreduce.v2.app.webapp.TestAMWebServicesAttempts Running org.apache.hadoop.mapreduce.jobhistory.TestEvents Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.794 sec - in org.apache.hadoop.mapreduce.jobhistory.TestEvents Running org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.723 sec - in org.apache.hadoop.mapreduce.jobhistory.TestJobHistoryEventHandler Running org.apache.hadoop.mapred.TestTaskAttemptListenerImpl Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.877 sec - in org.apache.hadoop.mapred.TestTaskAttemptListenerImpl Results : Failed tests: TestCommitterEventHandler.testFailure:314 null TestCommitterEventHandler.testBasic:263 null TestJobImpl.testKilledDuringKillAbort:499->assertJobState:816 expected:<SETUP> but was:<RUNNING> Tests run: 243, Failures: 3, Errors: 0, Skipped: 0 [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping hadoop-mapreduce [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] hadoop-mapreduce-client ........................... SUCCESS [ 4.600 s] [INFO] hadoop-mapreduce-client-core ...................... SUCCESS [02:34 min] [INFO] hadoop-mapreduce-client-common .................... SUCCESS [01:08 min] [INFO] hadoop-mapreduce-client-shuffle ................... SUCCESS [ 6.173 s] [INFO] hadoop-mapreduce-client-app ....................... FAILURE [11:20 min] [INFO] hadoop-mapreduce-client-hs ........................ SKIPPED [INFO] hadoop-mapreduce-client-jobclient ................. SKIPPED [INFO] hadoop-mapreduce-client-hs-plugins ................ SKIPPED [INFO] Apache Hadoop MapReduce Examples .................. SKIPPED [INFO] hadoop-mapreduce .................................. SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 15:25 min [INFO] Finished at: 2014-03-06T18:35:49+03:30 [INFO] Final Memory: 29M/126M [INFO] ------------------------------------------------------------------------ [WARNING] The requested profile "native" could not be activated because it does not exist. [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.16:test (default-test) on project hadoop-mapreduce-client-app: ExecutionException; nested exception is java.util.concurrent.ExecutionException: java.lang.RuntimeException: The forked VM terminated without saying properly goodbye. VM crash or System.exit called ? [ERROR] Command was/bin/sh -c cd /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app && /usr/jdk/instances/jdk1.7.0/jre/bin/java -Xmx1024m -XX:+HeapDumpOnOutOfMemoryError -jar /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefirebooter8838625082162282181.jar /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire918966405637238499tmp /export/home/hadoop/hadoop-2.3.0-src/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-app/target/surefire/surefire_753198788472362817522tmp [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hadoop-mapreduce-client-app Regards, Mahmood
