See <https://builds.apache.org/job/Hadoop-Hdfs-trunk/1163/changes>
Changes: [eli] HDFS-3919. MiniDFSCluster:waitClusterUp can hang forever. Contributed by Andy Isaacson [eli] HDFS-3664. BlockManager race when stopping active services. Contributed by Colin Patrick McCabe [vinodkv] MAPREDUCE-4646. Fixed MR framework to send diagnostic information correctly to clients in case of failed jobs also. Contributed by Jason Lowe. [vinodkv] YARN-78. Changed UnManagedAM application to use YarnClient. Contributed by Bikas Saha. [eli] HDFS-3910. DFSTestUtil#waitReplication should timeout. Contributed by Eli Collins [cutting] HADOOP-8597. Permit FsShell's text command to read Avro files. Contributed by Ivan Vladimirov. [suresh] HADOOP-8767. Secondary namenode is started on slave nodes instead of master nodes. Contributed by Giovanni Delussu. [eli] HADOOP-8789. Tests setLevel(Level.OFF) should be Level.ERROR. Contributed by Andy Isaacson [tomwhite] Update CHANGES.txt for MAPREDUCE-4607 commit. [tomwhite] MAPREDUCE-4607. Race condition in ReduceTask completion can result in Task being incorrectly failed. Contributed by Bikas Saha. ------------------------------------------ [...truncated 11058 lines...] Running org.apache.hadoop.hdfs.TestHftpDelegationToken Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.697 sec Running org.apache.hadoop.hdfs.TestDFSRollback Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.724 sec Running org.apache.hadoop.hdfs.TestByteRangeInputStream Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.309 sec Running org.apache.hadoop.hdfs.TestPersistBlocks Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.003 sec Running org.apache.hadoop.hdfs.TestRenameWhileOpen Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 47.546 sec Running org.apache.hadoop.hdfs.protocolPB.TestPBHelper Tests run: 21, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.43 sec Running org.apache.hadoop.hdfs.TestDatanodeDeath Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 136.26 sec Running org.apache.hadoop.hdfs.TestLeaseRecovery Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.653 sec Running org.apache.hadoop.hdfs.TestLargeBlock Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 53.344 sec Running org.apache.hadoop.hdfs.protocol.TestLayoutVersion Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.057 sec Running org.apache.hadoop.hdfs.protocol.TestExtendedBlock Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.056 sec Running org.apache.hadoop.hdfs.TestHDFSServerPorts Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.51 sec Running org.apache.hadoop.hdfs.TestFileCreationDelete Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.494 sec Running org.apache.hadoop.hdfs.TestDFSMkdirs Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.615 sec Running org.apache.hadoop.hdfs.TestDistributedFileSystem Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 39.381 sec Running org.apache.hadoop.hdfs.TestDecommission Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 120.836 sec Running org.apache.hadoop.hdfs.TestLeaseRecovery2 Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 63.176 sec Running org.apache.hadoop.hdfs.TestFileStatus Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.19 sec Running org.apache.hadoop.hdfs.TestBlockMissingException Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.889 sec Running org.apache.hadoop.hdfs.TestDataTransferKeepalive Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.842 sec Running org.apache.hadoop.hdfs.TestLeaseRenewer Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.96 sec Running org.apache.hadoop.hdfs.TestFileAppend Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.207 sec Running org.apache.hadoop.hdfs.TestDatanodeConfig Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.188 sec Running org.apache.hadoop.hdfs.web.TestWebHdfsFileSystemContract Tests run: 34, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.131 sec Running org.apache.hadoop.hdfs.web.TestFSMainOperationsWebHdfs Tests run: 49, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.78 sec Running org.apache.hadoop.hdfs.web.resources.TestParam Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.391 sec Running org.apache.hadoop.hdfs.web.TestWebHdfsWithMultipleNameNodes Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.065 sec Running org.apache.hadoop.hdfs.web.TestOffsetUrlInputStream Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.155 sec Running org.apache.hadoop.hdfs.web.TestWebHDFS Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 113.506 sec Running org.apache.hadoop.hdfs.web.TestWebHdfsUrl Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.045 sec Running org.apache.hadoop.hdfs.web.TestJsonUtil Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.168 sec Running org.apache.hadoop.hdfs.web.TestAuthFilter Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.306 sec Running org.apache.hadoop.hdfs.TestConnCache Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.07 sec Running org.apache.hadoop.hdfs.TestDFSClientRetries Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 160.84 sec Running org.apache.hadoop.hdfs.TestListPathServlet Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.031 sec Running org.apache.hadoop.hdfs.TestDFSStorageStateRecovery Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 118.667 sec Running org.apache.hadoop.hdfs.TestFileCreationEmpty Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.122 sec Running org.apache.hadoop.hdfs.TestSetrepIncreasing Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.433 sec Running org.apache.hadoop.hdfs.TestEncryptedTransfer Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 80.817 sec Running org.apache.hadoop.hdfs.TestDFSUpgrade Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.285 sec Running org.apache.hadoop.hdfs.TestCrcCorruption Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.674 sec Running org.apache.hadoop.hdfs.TestHFlush Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.682 sec Running org.apache.hadoop.hdfs.TestFileAppendRestart Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.614 sec Running org.apache.hadoop.hdfs.TestDatanodeReport Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 19.333 sec Running org.apache.hadoop.hdfs.TestShortCircuitLocalRead Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.328 sec Running org.apache.hadoop.hdfs.TestRestartDFS Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.047 sec Running org.apache.hadoop.hdfs.TestDFSUpgradeFromImage Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.229 sec Running org.apache.hadoop.hdfs.TestDFSRemove Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.652 sec Running org.apache.hadoop.hdfs.TestHDFSTrash Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.576 sec Running org.apache.hadoop.hdfs.TestClientReportBadBlock Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 54.561 sec Running org.apache.hadoop.hdfs.TestQuota Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.417 sec Running org.apache.hadoop.hdfs.TestFileLengthOnClusterRestart Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.023 sec Running org.apache.hadoop.hdfs.TestDatanodeRegistration Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.178 sec Running org.apache.hadoop.hdfs.TestAbandonBlock Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.094 sec Running org.apache.hadoop.hdfs.TestDFSShell Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 27.593 sec Running org.apache.hadoop.hdfs.TestListFilesInDFS Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.071 sec Running org.apache.hadoop.hdfs.TestParallelLocalRead Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 22.489 sec Running org.apache.hadoop.hdfs.TestAppendDifferentChecksum Tests run: 3, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 8.138 sec Running org.apache.hadoop.hdfs.TestDFSClientExcludedNodes Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.644 sec Running org.apache.hadoop.hdfs.TestDatanodeBlockScanner Tests run: 5, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 96.434 sec <<< FAILURE! Running org.apache.hadoop.hdfs.TestMultiThreadedHflush Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.004 sec Running org.apache.hadoop.hdfs.TestDFSAddressConfig Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.735 sec Running org.apache.hadoop.hdfs.TestMiniDFSCluster Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.136 sec Running org.apache.hadoop.hdfs.TestLease Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.312 sec Running org.apache.hadoop.hdfs.TestListFilesInFileContext Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.141 sec Running org.apache.hadoop.hdfs.TestDFSShellGenericOptions Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.012 sec Running org.apache.hadoop.hdfs.TestDFSClientFailover Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.224 sec Running org.apache.hadoop.hdfs.TestFileAppend2 Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.885 sec Running org.apache.hadoop.hdfs.TestLocalDFS Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.288 sec Running org.apache.hadoop.hdfs.TestReadWhileWriting Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.466 sec Running org.apache.hadoop.hdfs.TestSeekBug Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.358 sec Running org.apache.hadoop.hdfs.TestBlocksScheduledCounter Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.644 sec Running org.apache.hadoop.hdfs.util.TestAtomicFileOutputStream Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.184 sec Running org.apache.hadoop.hdfs.util.TestExactSizeInputStream Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.06 sec Running org.apache.hadoop.hdfs.util.TestMD5FileUtils Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.22 sec Running org.apache.hadoop.hdfs.util.TestDirectBufferPool Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.108 sec Running org.apache.hadoop.hdfs.util.TestLightWeightHashSet Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.163 sec Running org.apache.hadoop.hdfs.util.TestGSet Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.726 sec Running org.apache.hadoop.hdfs.util.TestCyclicIteration Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.06 sec Running org.apache.hadoop.hdfs.util.TestLightWeightLinkedSet Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.162 sec Running org.apache.hadoop.hdfs.TestSetTimes Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.491 sec Running org.apache.hadoop.hdfs.TestBlockReaderLocal Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.647 sec Running org.apache.hadoop.hdfs.TestHftpURLTimeouts Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.873 sec Running org.apache.hadoop.cli.TestHDFSCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 41.804 sec Running org.apache.hadoop.fs.TestGlobPaths Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.616 sec Running org.apache.hadoop.fs.TestResolveHdfsSymlink Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.906 sec Running org.apache.hadoop.fs.TestFcHdfsSetUMask Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.365 sec Running org.apache.hadoop.fs.TestFcHdfsPermission Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.313 sec Running org.apache.hadoop.fs.TestUrlStreamHandler Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.265 sec Running org.apache.hadoop.fs.viewfs.TestViewFsDefaultValue Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.68 sec Running org.apache.hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot Tests run: 38, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.808 sec Running org.apache.hadoop.fs.viewfs.TestViewFsHdfs Tests run: 42, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.135 sec Running org.apache.hadoop.fs.viewfs.TestViewFsAtHdfsRoot Tests run: 42, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.169 sec Running org.apache.hadoop.fs.viewfs.TestViewFileSystemHdfs Tests run: 38, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.371 sec Running org.apache.hadoop.fs.viewfs.TestViewFsFileStatusHdfs Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.939 sec Running org.apache.hadoop.fs.permission.TestStickyBit Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.011 sec Running org.apache.hadoop.fs.loadGenerator.TestLoadGenerator Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.074 sec Running org.apache.hadoop.fs.TestFcHdfsSymlink Tests run: 68, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.57 sec Running org.apache.hadoop.fs.TestFcHdfsCreateMkdir Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.124 sec Running org.apache.hadoop.fs.TestHDFSFileContextMainOperations Tests run: 59, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.447 sec Results : Failed tests: testFsckError(org.apache.hadoop.hdfs.server.namenode.TestFsck): Test resulted in an unexpected exit testFsckListCorruptFilesBlocks(org.apache.hadoop.hdfs.server.namenode.TestFsck): Test resulted in an unexpected exit testToCheckTheFsckCommandOnIllegalArguments(org.apache.hadoop.hdfs.server.namenode.TestFsck): Test resulted in an unexpected exit testFsckMissingReplicas(org.apache.hadoop.hdfs.server.namenode.TestFsck): Test resulted in an unexpected exit Tests in error: testBlockCorruptionPolicy(org.apache.hadoop.hdfs.TestDatanodeBlockScanner): Timed out waiting for /tmp/testBlockVerification/file1 to reach 3 replicas testBlockCorruptionRecoveryPolicy2(org.apache.hadoop.hdfs.TestDatanodeBlockScanner): Timed out waiting for /tmp/testBlockCorruptRecovery/file to reach 3 replicas Tests run: 1511, Failures: 4, Errors: 2, Skipped: 4 [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop HDFS ................................ FAILURE [1:17:49.455s] [INFO] Apache Hadoop HttpFS .............................. SKIPPED [INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED [INFO] Apache Hadoop HDFS Project ........................ SKIPPED [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 1:17:50.228s [INFO] Finished at: Wed Sep 12 12:51:30 UTC 2012 [INFO] Final Memory: 23M/374M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12:test (default-test) on project hadoop-hdfs: There are test failures. [ERROR] [ERROR] Please refer to <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/trunk/hadoop-hdfs-project/hadoop-hdfs/target/surefire-reports> for the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException Build step 'Execute shell' marked build as failure Archiving artifacts Updating HDFS-3664 Updating HDFS-3919 Updating HADOOP-8597 Updating YARN-78 Updating MAPREDUCE-4607 Updating HADOOP-8789 Updating MAPREDUCE-4646 Updating HADOOP-8767 Updating HDFS-3910
