See <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/354/changes>
Changes: [jlowe] MAPREDUCE-6474. ShuffleHandler can possibly exhaust nodemanager file descriptors. Contributed by Kuhu Shukla [wangda] YARN-4106. NodeLabels for NM in distributed mode is not updated even after clusterNodelabel addition in RM. (Bibin A Chundatt via wangda) ------------------------------------------ [...truncated 8943 lines...] Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.cli.TestCacheAdminCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.701 sec - in org.apache.hadoop.cli.TestCacheAdminCLI Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.TestRefreshCallQueue Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.263 sec - in org.apache.hadoop.TestRefreshCallQueue Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.TestXAttr Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.071 sec - in org.apache.hadoop.fs.TestXAttr Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.TestWebHdfsFileContextMainOperations Tests run: 60, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.088 sec - in org.apache.hadoop.fs.TestWebHdfsFileContextMainOperations Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.TestFcHdfsSetUMask Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.668 sec - in org.apache.hadoop.fs.TestFcHdfsSetUMask Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractConcat Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.23 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractConcat Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractRootDirectory Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.435 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractRootDirectory Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractRename Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.443 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractRename Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractSetTimes Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.069 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractSetTimes Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractOpen Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.008 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractOpen Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractAppend Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.016 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractAppend Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractCreate Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.972 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractCreate Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractGetFileStatus Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.964 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractGetFileStatus Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractSeek Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.997 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractSeek Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractDelete Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.279 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractDelete Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractMkdir Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.904 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractMkdir Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.TestResolveHdfsSymlink Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.648 sec - in org.apache.hadoop.fs.TestResolveHdfsSymlink Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.TestSymlinkHdfsDisable Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.953 sec - in org.apache.hadoop.fs.TestSymlinkHdfsDisable Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.permission.TestStickyBit Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.339 sec - in org.apache.hadoop.fs.permission.TestStickyBit Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.TestUrlStreamHandler Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.861 sec - in org.apache.hadoop.fs.TestUrlStreamHandler Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.loadGenerator.TestLoadGenerator Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.218 sec - in org.apache.hadoop.fs.loadGenerator.TestLoadGenerator Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.viewfs.TestViewFsWithXAttrs Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.314 sec - in org.apache.hadoop.fs.viewfs.TestViewFsWithXAttrs Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.viewfs.TestViewFsDefaultValue Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.358 sec - in org.apache.hadoop.fs.viewfs.TestViewFsDefaultValue Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.viewfs.TestViewFsHdfs Tests run: 58, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.755 sec - in org.apache.hadoop.fs.viewfs.TestViewFsHdfs Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.viewfs.TestViewFsWithAcls Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.219 sec - in org.apache.hadoop.fs.viewfs.TestViewFsWithAcls Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.viewfs.TestViewFsFileStatusHdfs Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.283 sec - in org.apache.hadoop.fs.viewfs.TestViewFsFileStatusHdfs Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.viewfs.TestViewFileSystemHdfs Tests run: 60, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.637 sec - in org.apache.hadoop.fs.viewfs.TestViewFileSystemHdfs Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.viewfs.TestViewFileSystemWithXAttrs Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.327 sec - in org.apache.hadoop.fs.viewfs.TestViewFileSystemWithXAttrs Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.viewfs.TestViewFileSystemWithAcls Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.218 sec - in org.apache.hadoop.fs.viewfs.TestViewFileSystemWithAcls Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot Tests run: 60, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.448 sec - in org.apache.hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.viewfs.TestViewFsAtHdfsRoot Tests run: 58, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.366 sec - in org.apache.hadoop.fs.viewfs.TestViewFsAtHdfsRoot Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.TestHDFSFileContextMainOperations Tests run: 68, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.978 sec - in org.apache.hadoop.fs.TestHDFSFileContextMainOperations Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.TestUrlStreamHandlerFactory Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.222 sec - in org.apache.hadoop.fs.TestUrlStreamHandlerFactory Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.TestSymlinkHdfsFileContext Tests run: 71, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.178 sec - in org.apache.hadoop.fs.TestSymlinkHdfsFileContext Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.TestGlobPaths Tests run: 36, Failures: 0, Errors: 0, Skipped: 6, Time elapsed: 5.797 sec - in org.apache.hadoop.fs.TestGlobPaths Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.TestSymlinkHdfsFileSystem Tests run: 74, Failures: 0, Errors: 0, Skipped: 2, Time elapsed: 10.028 sec - in org.apache.hadoop.fs.TestSymlinkHdfsFileSystem Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.shell.TestHdfsTextCommand Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.615 sec - in org.apache.hadoop.fs.shell.TestHdfsTextCommand Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.TestSWebHdfsFileContextMainOperations Tests run: 60, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.62 sec - in org.apache.hadoop.fs.TestSWebHdfsFileContextMainOperations Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.TestHdfsNativeCodeLoader Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.183 sec - in org.apache.hadoop.fs.TestHdfsNativeCodeLoader Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.TestFcHdfsPermission Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.656 sec - in org.apache.hadoop.fs.TestFcHdfsPermission Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.TestEnhancedByteBufferAccess Tests run: 10, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 23.401 sec - in org.apache.hadoop.fs.TestEnhancedByteBufferAccess Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.TestFcHdfsCreateMkdir Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.924 sec - in org.apache.hadoop.fs.TestFcHdfsCreateMkdir Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.fs.TestUnbuffer Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.688 sec - in org.apache.hadoop.fs.TestUnbuffer Results : Failed tests: TestLeaseRecovery2.tearDown:104 Test resulted in an unexpected exit TestDataNodeRollingUpgrade.testWithLayoutChangeAndRollback:429 null TestSeveralNameNodes.testCircularLinkedListWrites:90 Some writers didn't complete in expected runtime! Current writer state:[Circular Writer: directory: /test-0 target length: 50 current item: 50 done: false , Circular Writer: directory: /test-1 target length: 50 current item: 24 done: false ] expected:<0> but was:<2> TestFileTruncate.testTruncateWithDataNodesShutdownImmediately:864->checkBlockRecovery:1166->checkBlockRecovery:1171->checkBlockRecovery:1187 inode should complete in ~30000 ms. Expected: is <true> but: was <false> Tests in error: TestLeaseRecovery2.testHardLeaseRecoveryAfterNameNodeRestart:421->hardLeaseRecoveryRestartHelper:493 » Exit TestLeaseRecovery2.testSoftLeaseRecovery:335 » IllegalState Lease monitor is n... TestLeaseRecovery2.testHardLeaseRecoveryAfterNameNodeRestart2:426->hardLeaseRecoveryRestartHelper:445 » EOF TestLeaseRecovery2.testHardLeaseRecoveryWithRenameAfterNameNodeRestart:432->hardLeaseRecoveryRestartHelper:445 » Connect TestLeaseRecovery2.testLeaseRecoverByAnotherUser:158 » IllegalState Lease moni... TestLeaseRecovery2.testHardLeaseRecovery:275 » Connect Call From asf909.gq1.yg... TestDataNodeRollingUpgrade.testDatanodePeersXceiver:290->startCluster:74 » Runtime TestDataNodeRollingUpgrade.testDatanodeRollingUpgradeWithFinalize:207->startCluster:74 » Runtime TestUnderReplicatedBlocks.testSetrepIncWithUnderReplicatedBlocks:69 » test ti... Tests run: 3672, Failures: 4, Errors: 9, Skipped: 16 [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HttpFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS BookKeeper Journal [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS-NFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Apache Hadoop HDFS Project 3.0.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-hdfs-project --- [INFO] Deleting <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/target> [INFO] [INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-hdfs-project --- [INFO] Executing tasks main: [mkdir] Created dir: <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/target/test-dir> [INFO] Executed tasks [INFO] [INFO] --- maven-source-plugin:2.3:jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-source-plugin:2.3:test-jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (dist-enforce) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-site-plugin:3.4:attach-descriptor (attach-descriptor) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-hdfs-project --- [INFO] Not executing Javadoc as the project is not a Java classpath-capable package [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (depcheck) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-checkstyle-plugin:2.15:checkstyle (default-cli) @ hadoop-hdfs-project --- [INFO] [INFO] --- findbugs-maven-plugin:3.0.0:findbugs (default-cli) @ hadoop-hdfs-project --- [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop HDFS Client ......................... SUCCESS [03:24 min] [INFO] Apache Hadoop HDFS ................................ FAILURE [ 03:18 h] [INFO] Apache Hadoop HttpFS .............................. SKIPPED [INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED [INFO] Apache Hadoop HDFS-NFS ............................ SKIPPED [INFO] Apache Hadoop HDFS Project ........................ SUCCESS [ 0.071 s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 03:22 h [INFO] Finished at: 2015-09-10T21:31:47+00:00 [INFO] Final Memory: 55M/536M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project hadoop-hdfs: There are test failures. [ERROR] [ERROR] Please refer to <https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/ws/hadoop-hdfs-project/hadoop-hdfs/target/surefire-reports> for the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hadoop-hdfs Build step 'Execute shell' marked build as failure Archiving artifacts Sending artifact delta relative to Hadoop-Hdfs-trunk-Java8 #222 Archived 1 artifacts Archive block size is 32768 Received 0 blocks and 5373531 bytes Compression is 0.0% Took 6.1 sec Recording test results Updating MAPREDUCE-6474 Updating YARN-4106