See <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/526/changes>
Changes: [adhoot] YARN-3739. Add reservation system recovery to RM recovery process. ------------------------------------------ [...truncated 7016 lines...] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.639 sec - in org.apache.hadoop.hdfs.server.namenode.TestStartupProgressServlet Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestEditLogFileOutputStream Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.781 sec - in org.apache.hadoop.hdfs.server.namenode.TestEditLogFileOutputStream Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestFsckWithMultipleNameNodes Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.961 sec - in org.apache.hadoop.hdfs.server.namenode.TestFsckWithMultipleNameNodes Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestBackupNode Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 23.014 sec - in org.apache.hadoop.hdfs.server.namenode.TestBackupNode Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestFsLimits Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.158 sec - in org.apache.hadoop.hdfs.server.namenode.TestFsLimits Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestGenericJournalConf Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.911 sec - in org.apache.hadoop.hdfs.server.namenode.TestGenericJournalConf Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestProcessCorruptBlocks Killed Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestINodeAttributeProvider Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.387 sec - in org.apache.hadoop.hdfs.server.namenode.TestINodeAttributeProvider Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestValidateConfigurationSettings Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.662 sec - in org.apache.hadoop.hdfs.server.namenode.TestValidateConfigurationSettings Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestCheckPointForSecurityTokens Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.99 sec - in org.apache.hadoop.hdfs.server.namenode.TestCheckPointForSecurityTokens Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestMalformedURLs Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.727 sec - in org.apache.hadoop.hdfs.server.namenode.TestMalformedURLs Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestFSImageWithAcl Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 70.902 sec - in org.apache.hadoop.hdfs.server.namenode.TestFSImageWithAcl Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestEditLogRace Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 30.482 sec - in org.apache.hadoop.hdfs.server.namenode.TestEditLogRace Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestGetBlockLocations Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.992 sec - in org.apache.hadoop.hdfs.server.namenode.TestGetBlockLocations Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestBlockUnderConstruction Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.293 sec - in org.apache.hadoop.hdfs.server.namenode.TestBlockUnderConstruction Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestRecoverStripedBlocks Killed Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestCreateEditsLog Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 2.191 sec <<< FAILURE! - in org.apache.hadoop.hdfs.server.namenode.TestCreateEditsLog testCanLoadCreatedEditsLog(org.apache.hadoop.hdfs.server.namenode.TestCreateEditsLog) Time elapsed: 1.981 sec <<< ERROR! java.lang.NoClassDefFoundError: com/google/re2j/PatternSyntaxException at java.net.URLClassLoader$1.run(URLClassLoader.java:372) at java.net.URLClassLoader$1.run(URLClassLoader.java:361) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:360) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at org.apache.hadoop.fs.Globber.doGlob(Globber.java:209) at org.apache.hadoop.fs.Globber.glob(Globber.java:148) at org.apache.hadoop.fs.FileContext$Util.globStatus(FileContext.java:1995) at org.apache.hadoop.hdfs.server.namenode.TestCreateEditsLog.testCanLoadCreatedEditsLog(TestCreateEditsLog.java:84) Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestFileJournalManager Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.43 sec - in org.apache.hadoop.hdfs.server.namenode.TestFileJournalManager Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestAclTransformation Tests run: 55, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.342 sec - in org.apache.hadoop.hdfs.server.namenode.TestAclTransformation Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestXAttrFeature Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.235 sec - in org.apache.hadoop.hdfs.server.namenode.TestXAttrFeature Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestSecondaryWebUi Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.089 sec - in org.apache.hadoop.hdfs.server.namenode.TestSecondaryWebUi Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestFSImageWithXAttr Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 39.892 sec - in org.apache.hadoop.hdfs.server.namenode.TestFSImageWithXAttr Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestNNStorageRetentionManager Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.254 sec - in org.apache.hadoop.hdfs.server.namenode.TestNNStorageRetentionManager Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.namenode.TestSecondaryNameNodeUpgrade Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.559 sec - in org.apache.hadoop.hdfs.server.namenode.TestSecondaryNameNodeUpgrade Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.mover.TestStorageMover Killed Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.hdfs.server.mover.TestMover Results : Failed tests: TestQJMWithFaults.testRandomized:262->checkException:277 Expected to find 'Injected' but got unexpected exception:org.apache.hadoop.hdfs.qjournal.client.QuorumException: Got too many exceptions to achieve quorum size 2/3. 1 successful responses: 127.0.0.1:44858: null [success] 2 exceptions thrown: 127.0.0.1:58043: Journal disabled until next roll 127.0.0.1:51893: org/apache/hadoop/metrics2/util/SampleQuantiles$SampleItem at org.apache.hadoop.metrics2.util.SampleQuantiles.insertBatch(SampleQuantiles.java:139) at org.apache.hadoop.metrics2.util.SampleQuantiles.insert(SampleQuantiles.java:120) at org.apache.hadoop.metrics2.lib.MutableQuantiles.add(MutableQuantiles.java:130) at org.apache.hadoop.hdfs.qjournal.server.JournalMetrics.addSync(JournalMetrics.java:120) at org.apache.hadoop.hdfs.qjournal.server.Journal.journal(Journal.java:399) at org.apache.hadoop.hdfs.qjournal.server.JournalNodeRpcServer.journal(JournalNodeRpcServer.java:150) at org.apache.hadoop.hdfs.qjournal.protocolPB.QJournalProtocolServerSideTranslatorPB.journal(QJournalProtocolServerSideTranslatorPB.java:158) at org.apache.hadoop.hdfs.qjournal.protocol.QJournalProtocolProtos$QJournalProtocolService$2.callBlockingMethod(QJournalProtocolProtos.java:25421) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:637) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:976) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2291) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2287) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1669) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2287) at org.apache.hadoop.hdfs.qjournal.client.QuorumException.create(QuorumException.java:81) at org.apache.hadoop.hdfs.qjournal.client.QuorumCall.rethrowException(QuorumCall.java:223) at org.apache.hadoop.hdfs.qjournal.client.AsyncLoggerSet.waitForWriteQuorum(AsyncLoggerSet.java:142) at org.apache.hadoop.hdfs.qjournal.client.QuorumOutputStream.flushAndSync(QuorumOutputStream.java:107) at org.apache.hadoop.hdfs.server.namenode.EditLogOutputStream.flush(EditLogOutputStream.java:113) at org.apache.hadoop.hdfs.server.namenode.EditLogOutputStream.flush(EditLogOutputStream.java:107) at org.apache.hadoop.hdfs.qjournal.QJMTestUtil.writeTxns(QJMTestUtil.java:112) at org.apache.hadoop.hdfs.qjournal.client.TestQJMWithFaults.writeSegmentUntilCrash(TestQJMWithFaults.java:294) at org.apache.hadoop.hdfs.qjournal.client.TestQJMWithFaults.testRandomized(TestQJMWithFaults.java:259) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:483) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:271) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:70) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:50) at org.junit.runners.ParentRunner$3.run(ParentRunner.java:238) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:63) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:236) at org.junit.runners.ParentRunner.access$000(ParentRunner.java:53) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:229) at org.junit.runners.ParentRunner.run(ParentRunner.java:309) at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:264) at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:153) at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:124) at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:200) at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:153) at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:103) Tests in error: TestSecureNNWithQJM.testSecureMode:165->doNNWithQJMTest:180->startCluster:218 » IO TestSecureNNWithQJM.testSecondaryNameNodeHttpAddressNotNeeded:171->doNNWithQJMTest:180->startCluster:218 » IO TestSeveralNameNodes.testCircularLinkedListWrites:98 » Runtime Deferred TestNameNodeMetrics.testGetBlockLocationMetric:402->readFile:137 » NoClassDefFound TestNameNodeMetrics.testReadWriteOps:562->readFile:137 » NoClassDefFound org/a... TestSnapshotFileLength.testSnapshotFileLengthWithCatCommand:220 » NoClassDefFound TestXAttrWithSnapshot.testCopySnapshotShouldPreserveXAttrs:358 » NoClassDefFound TestFileTruncate.testTruncateShellCommand:1077->runTruncateShellCommand:1125 » NoClassDefFound TestFileTruncate.testTruncateShellCommandWithWaitOption:1108->runTruncateShellCommand:1125 » NoClassDefFound TestFileTruncate.testTruncateShellCommandOnBlockBoundary:1093->runTruncateShellCommand:1125 » NoClassDefFound TestSecureNameNode.testName:55 » IO Failed on local exception: java.io.IOExcep... TestCreateEditsLog.testCanLoadCreatedEditsLog:84 » NoClassDefFound com/google/... Tests run: 2331, Failures: 1, Errors: 12, Skipped: 11 [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS Native Client [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HttpFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS BookKeeper Journal [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS-NFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Apache Hadoop HDFS Project 3.0.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-hdfs-project --- [INFO] Deleting <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/target> [INFO] [INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-hdfs-project --- [INFO] Executing tasks main: [mkdir] Created dir: <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/target/test-dir> [INFO] Executed tasks [INFO] [INFO] --- maven-source-plugin:2.3:jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-source-plugin:2.3:test-jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (dist-enforce) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-site-plugin:3.4:attach-descriptor (attach-descriptor) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-hdfs-project --- [INFO] Not executing Javadoc as the project is not a Java classpath-capable package [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (depcheck) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-checkstyle-plugin:2.15:checkstyle (default-cli) @ hadoop-hdfs-project --- [INFO] [INFO] --- findbugs-maven-plugin:3.0.0:findbugs (default-cli) @ hadoop-hdfs-project --- [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop HDFS Client ......................... SUCCESS [04:30 min] [INFO] Apache Hadoop HDFS ................................ FAILURE [ 01:50 h] [INFO] Apache Hadoop HDFS Native Client .................. SKIPPED [INFO] Apache Hadoop HttpFS .............................. SKIPPED [INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED [INFO] Apache Hadoop HDFS-NFS ............................ SKIPPED [INFO] Apache Hadoop HDFS Project ........................ SUCCESS [ 0.112 s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 01:54 h [INFO] Finished at: 2015-10-22T17:00:53+00:00 [INFO] Final Memory: 72M/855M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project hadoop-hdfs: ExecutionException: java.lang.RuntimeException: The forked VM terminated without properly saying goodbye. VM crash or System.exit called? [ERROR] Command was /bin/sh -c cd <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs> && /home/jenkins/tools/java/jdk1.8.0/jre/bin/java -Xmx2048m -XX:MaxPermSize=768m -XX:+HeapDumpOnOutOfMemoryError -jar <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/surefire/surefirebooter2990990384739734059.jar> <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/surefire/surefire4512163235488141502tmp> <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/surefire/surefire_1763724380033205078086tmp> [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hadoop-hdfs Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results Updating YARN-3739