See <https://builds.apache.org/job/Hadoop-Hdfs-trunk/2193/changes>
Changes: [wangda] YARN-3941. Proportional Preemption policy should try to avoid sending duplicate PREEMPT_CONTAINER event to scheduler. (Sunil G via wangda) [arp] HADOOP-12161. Add getStoragePolicy API to the FileSystem interface. (Contributed by Brahma Reddy Battula) [wheat9] HDFS-8730. Clean up the import statements in ClientProtocol. Contributed by Takanobu Asanuma. [wang] HADOOP-12189. Improve CallQueueManager#swapQueue to make queue elements drop nearly impossible. Contributed by Zhihai Xu. [rkanter] YARN-3900. Protobuf layout of yarn_security_token causes errors in other protos that include it (adhoot via rkanter) [jghoman] HADOOP-12009: Clarify FileSystem.listStatus() sorting order & fix FileSystemContractBaseTest:testListStatus. (J.Andreina via jghoman) [aajisaka] HDFS-6682. Add a metric to expose the timestamp of the oldest under-replicated block. (aajisaka) [rohithsharmaks] YARN-3845. Scheduler page does not render RGBA color combinations in IE11. (Contributed by Mohammad Shahid Khan) [aajisaka] HDFS-8806. Inconsistent metrics: number of missing blocks with replication factor 1 not properly cleared. Contributed by Zhe Zhang. ------------------------------------------ [...truncated 7177 lines...] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.52 sec - in org.apache.hadoop.hdfs.TestGetFileChecksum Running org.apache.hadoop.hdfs.TestFileConcurrentReader Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.835 sec - in org.apache.hadoop.hdfs.TestFileConcurrentReader Running org.apache.hadoop.hdfs.util.TestBestEffortLongFile Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.254 sec - in org.apache.hadoop.hdfs.util.TestBestEffortLongFile Running org.apache.hadoop.hdfs.util.TestByteArrayManager Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.291 sec - in org.apache.hadoop.hdfs.util.TestByteArrayManager Running org.apache.hadoop.hdfs.util.TestLightWeightLinkedSet Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.228 sec - in org.apache.hadoop.hdfs.util.TestLightWeightLinkedSet Running org.apache.hadoop.hdfs.util.TestMD5FileUtils Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.306 sec - in org.apache.hadoop.hdfs.util.TestMD5FileUtils Running org.apache.hadoop.hdfs.util.TestExactSizeInputStream Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.086 sec - in org.apache.hadoop.hdfs.util.TestExactSizeInputStream Running org.apache.hadoop.hdfs.util.TestAtomicFileOutputStream Tests run: 4, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.246 sec - in org.apache.hadoop.hdfs.util.TestAtomicFileOutputStream Running org.apache.hadoop.hdfs.util.TestXMLUtils Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.085 sec - in org.apache.hadoop.hdfs.util.TestXMLUtils Running org.apache.hadoop.hdfs.util.TestLightWeightHashSet Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.217 sec - in org.apache.hadoop.hdfs.util.TestLightWeightHashSet Running org.apache.hadoop.hdfs.util.TestCyclicIteration Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.085 sec - in org.apache.hadoop.hdfs.util.TestCyclicIteration Running org.apache.hadoop.hdfs.util.TestDiff Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.153 sec - in org.apache.hadoop.hdfs.util.TestDiff Running org.apache.hadoop.hdfs.TestRemoteBlockReader Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.766 sec - in org.apache.hadoop.hdfs.TestRemoteBlockReader Running org.apache.hadoop.hdfs.TestDFSStartupVersions Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 12.067 sec - in org.apache.hadoop.hdfs.TestDFSStartupVersions Running org.apache.hadoop.hdfs.TestWriteBlockGetsBlockLengthHint Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.349 sec - in org.apache.hadoop.hdfs.TestWriteBlockGetsBlockLengthHint Running org.apache.hadoop.hdfs.TestReservedRawPaths Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.879 sec - in org.apache.hadoop.hdfs.TestReservedRawPaths Running org.apache.hadoop.hdfs.TestRead Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.622 sec - in org.apache.hadoop.hdfs.TestRead Running org.apache.hadoop.hdfs.TestAppendDifferentChecksum Tests run: 3, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 9.395 sec - in org.apache.hadoop.hdfs.TestAppendDifferentChecksum Running org.apache.hadoop.hdfs.TestDFSRollback Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.81 sec - in org.apache.hadoop.hdfs.TestDFSRollback Running org.apache.hadoop.hdfs.TestMiniDFSCluster Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.325 sec - in org.apache.hadoop.hdfs.TestMiniDFSCluster Running org.apache.hadoop.hdfs.TestClientReportBadBlock Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.147 sec - in org.apache.hadoop.hdfs.TestClientReportBadBlock Running org.apache.hadoop.hdfs.TestLeaseRecovery2 Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 68.774 sec - in org.apache.hadoop.hdfs.TestLeaseRecovery2 Running org.apache.hadoop.hdfs.protocol.TestLayoutVersion Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.306 sec - in org.apache.hadoop.hdfs.protocol.TestLayoutVersion Running org.apache.hadoop.hdfs.protocol.datatransfer.TestPacketReceiver Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.432 sec - in org.apache.hadoop.hdfs.protocol.datatransfer.TestPacketReceiver Running org.apache.hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 29.509 sec - in org.apache.hadoop.hdfs.protocol.datatransfer.sasl.TestSaslDataTransfer Running org.apache.hadoop.hdfs.protocol.TestAnnotations Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.162 sec - in org.apache.hadoop.hdfs.protocol.TestAnnotations Running org.apache.hadoop.hdfs.protocol.TestBlockListAsLongs Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.082 sec - in org.apache.hadoop.hdfs.protocol.TestBlockListAsLongs Running org.apache.hadoop.hdfs.protocol.TestExtendedBlock Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.086 sec - in org.apache.hadoop.hdfs.protocol.TestExtendedBlock Running org.apache.hadoop.hdfs.TestAbandonBlock Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.668 sec - in org.apache.hadoop.hdfs.TestAbandonBlock Running org.apache.hadoop.hdfs.crypto.TestHdfsCryptoStreams Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.44 sec - in org.apache.hadoop.hdfs.crypto.TestHdfsCryptoStreams Running org.apache.hadoop.hdfs.TestFileAppendRestart Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.812 sec - in org.apache.hadoop.hdfs.TestFileAppendRestart Running org.apache.hadoop.hdfs.TestFetchImage Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.235 sec - in org.apache.hadoop.hdfs.TestFetchImage Running org.apache.hadoop.hdfs.TestFileCreationDelete Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.234 sec - in org.apache.hadoop.hdfs.TestFileCreationDelete Running org.apache.hadoop.hdfs.TestCrcCorruption Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.789 sec - in org.apache.hadoop.hdfs.TestCrcCorruption Running org.apache.hadoop.hdfs.TestHDFSFileSystemContract Tests run: 44, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 54.445 sec - in org.apache.hadoop.hdfs.TestHDFSFileSystemContract Running org.apache.hadoop.hdfs.TestBlockStoragePolicy Tests run: 19, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 39.343 sec - in org.apache.hadoop.hdfs.TestBlockStoragePolicy Running org.apache.hadoop.hdfs.TestDatanodeDeath Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 58.728 sec - in org.apache.hadoop.hdfs.TestDatanodeDeath Running org.apache.hadoop.hdfs.TestParallelReadUtil Tests run: 1, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.039 sec - in org.apache.hadoop.hdfs.TestParallelReadUtil Running org.apache.hadoop.hdfs.TestDFSUpgrade Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.877 sec - in org.apache.hadoop.hdfs.TestDFSUpgrade Running org.apache.hadoop.hdfs.TestDFSShell Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 30.685 sec - in org.apache.hadoop.hdfs.TestDFSShell Running org.apache.hadoop.hdfs.TestFileAppend2 Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.276 sec - in org.apache.hadoop.hdfs.TestFileAppend2 Running org.apache.hadoop.hdfs.TestKeyProviderCache Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.565 sec - in org.apache.hadoop.hdfs.TestKeyProviderCache Running org.apache.hadoop.hdfs.TestListFilesInDFS Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.785 sec - in org.apache.hadoop.hdfs.TestListFilesInDFS Running org.apache.hadoop.hdfs.TestAppendSnapshotTruncate Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 2.597 sec <<< FAILURE! - in org.apache.hadoop.hdfs.TestAppendSnapshotTruncate org.apache.hadoop.hdfs.TestAppendSnapshotTruncate Time elapsed: 2.597 sec <<< ERROR! java.net.BindException: Problem binding to [localhost:8020] java.net.BindException: Address already in use; For more details see: http://wiki.apache.org/hadoop/BindException at sun.nio.ch.Net.bind0(Native Method) at sun.nio.ch.Net.bind(Net.java:444) at sun.nio.ch.Net.bind(Net.java:436) at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:214) at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74) at org.apache.hadoop.ipc.Server.bind(Server.java:413) at org.apache.hadoop.ipc.Server$Listener.<init>(Server.java:590) at org.apache.hadoop.ipc.Server.<init>(Server.java:2340) at org.apache.hadoop.ipc.RPC$Server.<init>(RPC.java:945) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server.<init>(ProtobufRpcEngine.java:534) at org.apache.hadoop.ipc.ProtobufRpcEngine.getServer(ProtobufRpcEngine.java:509) at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:787) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.<init>(NameNodeRpcServer.java:348) at org.apache.hadoop.hdfs.server.namenode.NameNode.createRpcServer(NameNode.java:673) at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:646) at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:809) at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:793) at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1482) at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNode(MiniDFSCluster.java:1208) at org.apache.hadoop.hdfs.MiniDFSCluster.configureNameService(MiniDFSCluster.java:971) at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:882) at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:814) at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:473) at org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:432) at org.apache.hadoop.hdfs.TestAppendSnapshotTruncate.startUp(TestAppendSnapshotTruncate.java:88) Running org.apache.hadoop.hdfs.TestDFSOutputStream Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.198 sec - in org.apache.hadoop.hdfs.TestDFSOutputStream Running org.apache.hadoop.hdfs.TestHDFSServerPorts Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.674 sec - in org.apache.hadoop.hdfs.TestHDFSServerPorts Running org.apache.hadoop.hdfs.TestDFSPacket Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.119 sec - in org.apache.hadoop.hdfs.TestDFSPacket Running org.apache.hadoop.hdfs.TestDFSClientExcludedNodes Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.852 sec - in org.apache.hadoop.hdfs.TestDFSClientExcludedNodes Running org.apache.hadoop.hdfs.TestDFSPermission Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.388 sec - in org.apache.hadoop.hdfs.TestDFSPermission Running org.apache.hadoop.hdfs.TestRestartDFS Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.686 sec - in org.apache.hadoop.hdfs.TestRestartDFS Running org.apache.hadoop.cli.TestCryptoAdminCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.675 sec - in org.apache.hadoop.cli.TestCryptoAdminCLI Running org.apache.hadoop.cli.TestHDFSCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 57.759 sec - in org.apache.hadoop.cli.TestHDFSCLI Running org.apache.hadoop.cli.TestAclCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.068 sec - in org.apache.hadoop.cli.TestAclCLI Running org.apache.hadoop.cli.TestCacheAdminCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.976 sec - in org.apache.hadoop.cli.TestCacheAdminCLI Running org.apache.hadoop.cli.TestXAttrCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.167 sec - in org.apache.hadoop.cli.TestXAttrCLI Running org.apache.hadoop.TestRefreshCallQueue Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.651 sec - in org.apache.hadoop.TestRefreshCallQueue Running org.apache.hadoop.security.TestPermissionSymlinks Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.833 sec - in org.apache.hadoop.security.TestPermissionSymlinks Running org.apache.hadoop.security.TestPermission Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.465 sec - in org.apache.hadoop.security.TestPermission Running org.apache.hadoop.security.TestRefreshUserMappings Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.992 sec - in org.apache.hadoop.security.TestRefreshUserMappings Results : Failed tests: TestDistributedFileSystem.testDFSClientPeerWriteTimeout:1206 wrong exception:java.lang.AssertionError: write should timeout Tests in error: TestAppendSnapshotTruncate.startUp:88 ยป Bind Problem binding to [localhost:802... Tests run: 3494, Failures: 1, Errors: 1, Skipped: 17 [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HttpFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS BookKeeper Journal [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS-NFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Apache Hadoop HDFS Project 3.0.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-hdfs-project --- [INFO] Deleting <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/target> [INFO] [INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-hdfs-project --- [INFO] Executing tasks main: [mkdir] Created dir: <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/target/test-dir> [INFO] Executed tasks [INFO] [INFO] --- maven-source-plugin:2.3:jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-source-plugin:2.3:test-jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (dist-enforce) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-site-plugin:3.4:attach-descriptor (attach-descriptor) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-hdfs-project --- [INFO] Skipping javadoc generation [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (depcheck) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-checkstyle-plugin:2.15:checkstyle (default-cli) @ hadoop-hdfs-project --- [INFO] [INFO] --- findbugs-maven-plugin:3.0.0:findbugs (default-cli) @ hadoop-hdfs-project --- [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop HDFS Client ......................... SUCCESS [03:04 min] [INFO] Apache Hadoop HDFS ................................ FAILURE [ 02:40 h] [INFO] Apache Hadoop HttpFS .............................. SKIPPED [INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED [INFO] Apache Hadoop HDFS-NFS ............................ SKIPPED [INFO] Apache Hadoop HDFS Project ........................ SUCCESS [ 0.069 s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 02:43 h [INFO] Finished at: 2015-07-24T14:55:03+00:00 [INFO] Final Memory: 56M/690M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project hadoop-hdfs: There are test failures. [ERROR] [ERROR] Please refer to <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/surefire-reports> for the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hadoop-hdfs Build step 'Execute shell' marked build as failure Archiving artifacts Sending artifact delta relative to Hadoop-Hdfs-trunk #2181 Archived 1 artifacts Archive block size is 32768 Received 0 blocks and 3838428 bytes Compression is 0.0% Took 11 sec Recording test results Updating HADOOP-12161 Updating HADOOP-12009 Updating YARN-3941 Updating HDFS-8730 Updating YARN-3845 Updating HADOOP-12189 Updating HDFS-8806 Updating YARN-3900 Updating HDFS-6682
