See <https://builds.apache.org/job/Hadoop-Hdfs-trunk/2119/changes>
Changes: [junping_du] YARN-3523. Cleanup ResourceManagerAdministrationProtocol interface audience. Contributed by Naganarasimha G R [zjshen] YARN-3448. Added a rolling time-to-live LevelDB timeline store implementation. Contributed by Jonathan Eagles. [szetszwo] HDFS-7980. Incremental BlockReport will dramatically slow down namenode startup. Contributed by Walter Su [aw] HADOOP-11936. Dockerfile references a removed image (aw) [jianhe] YARN-3584. Fixed attempt diagnostics format shown on the UI. Contributed by nijel [jlowe] MAPREDUCE-6279. AM should explicity exit JVM after all services have stopped. Contributed by Eric Payne [wheat9] HDFS-8321. CacheDirectives and CachePool operations should throw RetriableException in safemode. Contributed by Haohui Mai. [wheat9] HDFS-8037. CheckAccess in WebHDFS silently accepts malformed FsActions parameters. Contributed by Walter Su. [jianhe] YARN-2918. RM should not fail on startup if queue's configured labels do not exist in cluster-node-labels. Contributed by Wangda Tan [aajisaka] YARN-1832. Fix wrong MockLocalizerStatus#equals implementation. Contributed by Hong Zhiguo. [aajisaka] YARN-3572. Correct typos in WritingYarnApplications.md. Contributed by Gabor Liptak. [vinayakumarb] HADOOP-11922. Misspelling of threshold in log4j.properties for tests in hadoop-tools (Contributed by Gabor Liptak) [vinayakumarb] HDFS-8257. Namenode rollingUpgrade option is incorrect in document (Contributed by J.Andreina) [vinayakumarb] HDFS-8067. haadmin prints out stale help messages (Contributed by Ajith S) [devaraj] YARN-3592. Fix typos in RMNodeLabelsManager. Contributed by Sunil G. [umamahesh] HDFS-8174. Update replication count to live rep count in fsck report. Contributed by J.Andreina [vinayakumarb] HDFS-6291. FSImage may be left unclosed in BootstrapStandby#doRun() ( Contributed by Sanghyun Yun) [devaraj] YARN-3358. Audit log not present while refreshing Service ACLs. [umamahesh] HDFS-8332. DFS client API calls should check filesystem closed. Contributed by Rakesh R. [aajisaka] HDFS-8349. Remove .xml and documentation references to dfs.webhdfs.enabled. Contributed by Ray Chiang. [ozawa] MAPREDUCE-6284. Add Task Attempt State API to MapReduce Application Master REST API. Contributed by Ryu Kobayashi. [vinayakumarb] HDFS-7998. HDFS Federation : Command mentioned to add a NN to existing federated cluster is wrong (Contributed by Ajith S) [aajisaka] HDFS-8222. Remove usage of "dfsadmin -upgradeProgress" from document which is no longer supported. Contributed by J.Andreina. [ozawa] YARN-3589. RM and AH web UI display DOCTYPE wrongly. Contbituted by Rohith. [umamahesh] HDFS-8108. Fsck should provide the info on mandatory option to be used along with -blocks ,-locations and -racks. Contributed by J.Andreina. [vinayakumarb] HDFS-8187. Remove usage of '-setStoragePolicy' and '-getStoragePolicy' using dfsadmin cmd (as it is not been supported) (Contributed by J.Andreina) [vinayakumarb] HDFS-8175. Provide information on snapshotDiff for supporting the comparison between snapshot and current status (Contributed by J.Andreina) [ozawa] HDFS-8207. Improper log message when blockreport interval compared with initial delay. Contributed by Brahma Reddy Battula and Ashish Singhi. [aajisaka] MAPREDUCE-6079. Rename JobImpl#username to reporterUserName. Contributed by Tsuyoshi Ozawa. [vinayakumarb] HDFS-8209. Support different number of datanode directories in MiniDFSCluster. (Contributed by surendra singh lilhore) [devaraj] MAPREDUCE-6342. Make POM project names consistent. Contributed by Rohith. [vinayakumarb] HDFS-8226. Non-HA rollback compatibility broken (Contributed by J.Andreina) [ozawa] YARN-3169. Drop YARN's overview document. Contributed by Brahma Reddy Battula. [vinayakumarb] HDFS-6576. Datanode log is generating at root directory in security mode (Contributed by surendra singh lilhore) [vinayakumarb] HADOOP-11877. SnappyDecompressor's Logger class name is wrong ( Contributed by surendra singh lilhore) [vinayakumarb] HDFS-3384. DataStreamer thread should be closed immediatly when failed to setup a PipelineForAppendOrRecovery (Contributed by Uma Maheswara Rao G) [umamahesh] HDFS-6285. tidy an error log inside BlockReceiver. Contributed by Liang Xie. ------------------------------------------ [...truncated 6730 lines...] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.542 sec - in org.apache.hadoop.fs.TestUnbuffer Running org.apache.hadoop.fs.TestFcHdfsCreateMkdir Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.565 sec - in org.apache.hadoop.fs.TestFcHdfsCreateMkdir Running org.apache.hadoop.fs.TestEnhancedByteBufferAccess Tests run: 10, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 14.393 sec - in org.apache.hadoop.fs.TestEnhancedByteBufferAccess Running org.apache.hadoop.fs.TestHdfsNativeCodeLoader Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.184 sec - in org.apache.hadoop.fs.TestHdfsNativeCodeLoader Running org.apache.hadoop.fs.TestUrlStreamHandlerFactory Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.669 sec - in org.apache.hadoop.fs.TestUrlStreamHandlerFactory Running org.apache.hadoop.fs.TestHDFSFileContextMainOperations Tests run: 68, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.075 sec - in org.apache.hadoop.fs.TestHDFSFileContextMainOperations Running org.apache.hadoop.fs.shell.TestHdfsTextCommand Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.592 sec - in org.apache.hadoop.fs.shell.TestHdfsTextCommand Running org.apache.hadoop.fs.TestResolveHdfsSymlink Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.898 sec - in org.apache.hadoop.fs.TestResolveHdfsSymlink Running org.apache.hadoop.fs.TestVolumeId Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.207 sec - in org.apache.hadoop.fs.TestVolumeId Running org.apache.hadoop.fs.viewfs.TestViewFsWithAcls Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.476 sec - in org.apache.hadoop.fs.viewfs.TestViewFsWithAcls Running org.apache.hadoop.fs.viewfs.TestViewFsFileStatusHdfs Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.643 sec - in org.apache.hadoop.fs.viewfs.TestViewFsFileStatusHdfs Running org.apache.hadoop.fs.viewfs.TestViewFileSystemHdfs Tests run: 56, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.141 sec - in org.apache.hadoop.fs.viewfs.TestViewFileSystemHdfs Running org.apache.hadoop.fs.viewfs.TestViewFsWithXAttrs Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.376 sec - in org.apache.hadoop.fs.viewfs.TestViewFsWithXAttrs Running org.apache.hadoop.fs.viewfs.TestViewFsAtHdfsRoot Tests run: 54, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.439 sec - in org.apache.hadoop.fs.viewfs.TestViewFsAtHdfsRoot Running org.apache.hadoop.fs.viewfs.TestViewFsHdfs Tests run: 54, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.073 sec - in org.apache.hadoop.fs.viewfs.TestViewFsHdfs Running org.apache.hadoop.fs.viewfs.TestViewFileSystemWithAcls Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.479 sec - in org.apache.hadoop.fs.viewfs.TestViewFileSystemWithAcls Running org.apache.hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot Tests run: 56, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.969 sec - in org.apache.hadoop.fs.viewfs.TestViewFileSystemAtHdfsRoot Running org.apache.hadoop.fs.viewfs.TestViewFileSystemWithXAttrs Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.568 sec - in org.apache.hadoop.fs.viewfs.TestViewFileSystemWithXAttrs Running org.apache.hadoop.fs.viewfs.TestViewFsDefaultValue Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.661 sec - in org.apache.hadoop.fs.viewfs.TestViewFsDefaultValue Running org.apache.hadoop.fs.TestSymlinkHdfsFileContext Tests run: 69, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.716 sec - in org.apache.hadoop.fs.TestSymlinkHdfsFileContext Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractDelete Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.799 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractDelete Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractMkdir Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.837 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractMkdir Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractOpen Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.865 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractOpen Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractRootDirectory Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.157 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractRootDirectory Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractAppend Tests run: 5, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 5.133 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractAppend Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractCreate Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.976 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractCreate Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractSeek Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.358 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractSeek Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractRename Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.972 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractRename Running org.apache.hadoop.fs.contract.hdfs.TestHDFSContractConcat Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.862 sec - in org.apache.hadoop.fs.contract.hdfs.TestHDFSContractConcat Running org.apache.hadoop.fs.permission.TestStickyBit Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.289 sec - in org.apache.hadoop.fs.permission.TestStickyBit Running org.apache.hadoop.TestRefreshCallQueue Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.968 sec - in org.apache.hadoop.TestRefreshCallQueue Running org.apache.hadoop.security.TestPermissionSymlinks Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.451 sec - in org.apache.hadoop.security.TestPermissionSymlinks Running org.apache.hadoop.security.TestRefreshUserMappings Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.792 sec - in org.apache.hadoop.security.TestRefreshUserMappings Running org.apache.hadoop.security.TestPermission Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.019 sec - in org.apache.hadoop.security.TestPermission Running org.apache.hadoop.tools.TestTools Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.447 sec - in org.apache.hadoop.tools.TestTools Running org.apache.hadoop.tools.TestJMXGet Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.686 sec - in org.apache.hadoop.tools.TestJMXGet Running org.apache.hadoop.tracing.TestTracing Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.293 sec - in org.apache.hadoop.tracing.TestTracing Running org.apache.hadoop.tracing.TestTraceAdmin Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 4.044 sec <<< FAILURE! - in org.apache.hadoop.tracing.TestTraceAdmin testCreateAndDestroySpanReceiver(org.apache.hadoop.tracing.TestTraceAdmin) Time elapsed: 3.961 sec <<< ERROR! org.apache.hadoop.ipc.RemoteException: Failed to load SpanReceiver org.apache.htrace.impl.LocalFileSpanReceiver at org.apache.hadoop.tracing.SpanReceiverHost.loadInstance(SpanReceiverHost.java:171) at org.apache.hadoop.tracing.SpanReceiverHost.addSpanReceiver(SpanReceiverHost.java:216) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.addSpanReceiver(NameNodeRpcServer.java:2029) at org.apache.hadoop.tracing.TraceAdminProtocolServerSideTranslatorPB.addSpanReceiver(TraceAdminProtocolServerSideTranslatorPB.java:81) at org.apache.hadoop.tracing.TraceAdminPB$TraceAdminService$2.callBlockingMethod(TraceAdminPB.java:4580) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:636) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:976) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2174) at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2170) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:415) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1669) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2168) at org.apache.hadoop.ipc.Client.call(Client.java:1492) at org.apache.hadoop.ipc.Client.call(Client.java:1423) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229) at com.sun.proxy.$Proxy21.addSpanReceiver(Unknown Source) at org.apache.hadoop.tracing.TraceAdminProtocolTranslatorPB.addSpanReceiver(TraceAdminProtocolTranslatorPB.java:81) at org.apache.hadoop.tracing.TraceAdmin.addSpanReceiver(TraceAdmin.java:120) at org.apache.hadoop.tracing.TraceAdmin.run(TraceAdmin.java:182) at org.apache.hadoop.tracing.TestTraceAdmin.runTraceCommand(TestTraceAdmin.java:44) at org.apache.hadoop.tracing.TestTraceAdmin.testCreateAndDestroySpanReceiver(TestTraceAdmin.java:74) Running org.apache.hadoop.tracing.TestTracingShortCircuitLocalRead Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.679 sec - in org.apache.hadoop.tracing.TestTracingShortCircuitLocalRead Running org.apache.hadoop.net.TestNetworkTopology Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 8.976 sec - in org.apache.hadoop.net.TestNetworkTopology Running org.apache.hadoop.TestGenericRefresh Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.064 sec - in org.apache.hadoop.TestGenericRefresh Running org.apache.hadoop.cli.TestHDFSCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 58.74 sec - in org.apache.hadoop.cli.TestHDFSCLI Running org.apache.hadoop.cli.TestCacheAdminCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.612 sec - in org.apache.hadoop.cli.TestCacheAdminCLI Running org.apache.hadoop.cli.TestAclCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.941 sec - in org.apache.hadoop.cli.TestAclCLI Running org.apache.hadoop.cli.TestCryptoAdminCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.219 sec - in org.apache.hadoop.cli.TestCryptoAdminCLI Running org.apache.hadoop.cli.TestXAttrCLI Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.968 sec - in org.apache.hadoop.cli.TestXAttrCLI Results : Tests in error: TestSnapshot.testSnapshot:237->runTestSnapshot:298->checkFSImage:201 » IO Time... TestSnapshot.setUp:120 » Runtime org.xml.sax.SAXParseException; systemId: jar:... TestSnapshot.setUp:120 » Runtime org.xml.sax.SAXParseException; systemId: jar:... TestTraceAdmin.testCreateAndDestroySpanReceiver:74->runTraceCommand:44 » Remote Tests run: 3390, Failures: 0, Errors: 4, Skipped: 17 [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HttpFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS BookKeeper Journal [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Skipping Apache Hadoop HDFS-NFS [INFO] This project has been banned from the build due to previous failures. [INFO] ------------------------------------------------------------------------ [INFO] [INFO] ------------------------------------------------------------------------ [INFO] Building Apache Hadoop HDFS Project 3.0.0-SNAPSHOT [INFO] ------------------------------------------------------------------------ [INFO] [INFO] --- maven-clean-plugin:2.5:clean (default-clean) @ hadoop-hdfs-project --- [INFO] Deleting <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/target> [INFO] [INFO] --- maven-antrun-plugin:1.7:run (create-testdirs) @ hadoop-hdfs-project --- [INFO] Executing tasks main: [mkdir] Created dir: <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/target/test-dir> [INFO] Executed tasks [INFO] [INFO] --- maven-source-plugin:2.3:jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-source-plugin:2.3:test-jar-no-fork (hadoop-java-sources) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (dist-enforce) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-site-plugin:3.4:attach-descriptor (attach-descriptor) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-hdfs-project --- [INFO] Skipping javadoc generation [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (depcheck) @ hadoop-hdfs-project --- [INFO] [INFO] --- maven-checkstyle-plugin:2.15:checkstyle (default-cli) @ hadoop-hdfs-project --- [INFO] [INFO] --- findbugs-maven-plugin:3.0.0:findbugs (default-cli) @ hadoop-hdfs-project --- [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: [INFO] [INFO] Apache Hadoop HDFS Client ......................... SUCCESS [ 47.169 s] [INFO] Apache Hadoop HDFS ................................ FAILURE [ 02:47 h] [INFO] Apache Hadoop HttpFS .............................. SKIPPED [INFO] Apache Hadoop HDFS BookKeeper Journal ............. SKIPPED [INFO] Apache Hadoop HDFS-NFS ............................ SKIPPED [INFO] Apache Hadoop HDFS Project ........................ SUCCESS [ 0.063 s] [INFO] ------------------------------------------------------------------------ [INFO] BUILD FAILURE [INFO] ------------------------------------------------------------------------ [INFO] Total time: 02:48 h [INFO] Finished at: 2015-05-08T15:16:54+00:00 [INFO] Final Memory: 56M/686M [INFO] ------------------------------------------------------------------------ [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.17:test (default-test) on project hadoop-hdfs: There are test failures. [ERROR] [ERROR] Please refer to <https://builds.apache.org/job/Hadoop-Hdfs-trunk/ws/hadoop-hdfs-project/hadoop-hdfs/target/surefire-reports> for the individual test results. [ERROR] -> [Help 1] [ERROR] [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch. [ERROR] Re-run Maven using the -X switch to enable full debug logging. [ERROR] [ERROR] For more information about the errors and possible solutions, please read the following articles: [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException [ERROR] [ERROR] After correcting the problems, you can resume the build with the command [ERROR] mvn <goals> -rf :hadoop-hdfs Build step 'Execute shell' marked build as failure Archiving artifacts Sending artifact delta relative to Hadoop-Hdfs-trunk #2116 Archived 1 artifacts Archive block size is 32768 Received 0 blocks and 362738 bytes Compression is 0.0% Took 10 sec Recording test results Updating HDFS-8222 Updating YARN-3592 Updating HDFS-8037 Updating HADOOP-11936 Updating MAPREDUCE-6279 Updating YARN-3572 Updating HDFS-6576 Updating HDFS-8174 Updating HADOOP-11877 Updating HDFS-8175 Updating HDFS-8257 Updating HDFS-8321 Updating MAPREDUCE-6342 Updating YARN-2918 Updating YARN-1832 Updating HDFS-6285 Updating HDFS-3384 Updating HDFS-7998 Updating YARN-3584 Updating HDFS-8108 Updating YARN-3448 Updating YARN-3523 Updating HADOOP-11922 Updating HDFS-8332 Updating YARN-3589 Updating HDFS-8067 Updating MAPREDUCE-6284 Updating HDFS-8187 Updating HDFS-8349 Updating HDFS-8207 Updating YARN-3358 Updating HDFS-8209 Updating HDFS-8226 Updating HDFS-7980 Updating MAPREDUCE-6079 Updating YARN-3169 Updating HDFS-6291