Build failed in Jenkins: Hadoop-common-trunk-Java8 #167
See https://builds.apache.org/job/Hadoop-common-trunk-Java8/167/changes Changes: [wangda] YARN-3318. Create Initial OrderingPolicy Framework and FifoOrderingPolicy. (Craig Welch via wangda) [arp] HDFS-8144. Split TestLazyPersistFiles into multiple tests. (Arpit Agarwal) [ozawa] YARN-3326. Support RESTful API for getLabelsToNodes. Contributed by Naganarasimha G R. [jing9] HDFS-8151. Always use snapshot path as source when invalid snapshot names are used for diff based distcp. Contributed by Jing Zhao. [jing9] HDFS-7934. Update RollingUpgrade rollback documentation: should use bootstrapstandby for standby NN. Contributed by J. Andreina. [aajisaka] HDFS-8149. The footer of the Web UI Hadoop, 2014 is old. Contributed by Brahma Reddy Battula. [jianhe] YARN-3404. Display queue name on application page. Contributed by Ryu Kobayashi [jianhe] YARN-3354. Add node label expression in ContainerTokenIdentifier to support RM recovery. Contributed by Wangda Tan -- [...truncated 3648 lines...] [INFO] Surefire report directory: https://builds.apache.org/job/Hadoop-common-trunk-Java8/ws/hadoop-common-project/hadoop-minikdc/target/surefire-reports --- T E S T S --- --- T E S T S --- Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.minikdc.TestChangeOrgNameAndDomain Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.543 sec - in org.apache.hadoop.minikdc.TestChangeOrgNameAndDomain Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; support was removed in 8.0 Running org.apache.hadoop.minikdc.TestMiniKdc Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.176 sec - in org.apache.hadoop.minikdc.TestMiniKdc Results : Tests run: 6, Failures: 0, Errors: 0, Skipped: 0 [INFO] [INFO] --- maven-jar-plugin:2.5:jar (default-jar) @ hadoop-minikdc --- [INFO] Building jar: https://builds.apache.org/job/Hadoop-common-trunk-Java8/ws/hadoop-common-project/hadoop-minikdc/target/hadoop-minikdc-3.0.0-SNAPSHOT.jar [INFO] [INFO] --- maven-source-plugin:2.3:jar-no-fork (hadoop-java-sources) @ hadoop-minikdc --- [INFO] Building jar: https://builds.apache.org/job/Hadoop-common-trunk-Java8/ws/hadoop-common-project/hadoop-minikdc/target/hadoop-minikdc-3.0.0-SNAPSHOT-sources.jar [INFO] [INFO] --- maven-source-plugin:2.3:test-jar-no-fork (hadoop-java-sources) @ hadoop-minikdc --- [INFO] Building jar: https://builds.apache.org/job/Hadoop-common-trunk-Java8/ws/hadoop-common-project/hadoop-minikdc/target/hadoop-minikdc-3.0.0-SNAPSHOT-test-sources.jar [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce (dist-enforce) @ hadoop-minikdc --- [INFO] [INFO] --- maven-site-plugin:3.4:attach-descriptor (attach-descriptor) @ hadoop-minikdc --- [INFO] [INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-minikdc --- [INFO] Loading source files for package org.apache.hadoop.minikdc... Constructing Javadoc information... Standard Doclet version 1.8.0 Building tree for all the packages and classes... Generating https://builds.apache.org/job/Hadoop-common-trunk-Java8/ws/hadoop-common-project/hadoop-minikdc/target/org/apache/hadoop/minikdc/KerberosSecurityTestcase.html... Generating https://builds.apache.org/job/Hadoop-common-trunk-Java8/ws/hadoop-common-project/hadoop-minikdc/target/org/apache/hadoop/minikdc/MiniKdc.html... Generating https://builds.apache.org/job/Hadoop-common-trunk-Java8/ws/hadoop-common-project/hadoop-minikdc/target/org/apache/hadoop/minikdc/package-frame.html... Generating https://builds.apache.org/job/Hadoop-common-trunk-Java8/ws/hadoop-common-project/hadoop-minikdc/target/org/apache/hadoop/minikdc/package-summary.html... Generating https://builds.apache.org/job/Hadoop-common-trunk-Java8/ws/hadoop-common-project/hadoop-minikdc/target/org/apache/hadoop/minikdc/package-tree.html... Generating https://builds.apache.org/job/Hadoop-common-trunk-Java8/ws/hadoop-common-project/hadoop-minikdc/target/constant-values.html... Generating https://builds.apache.org/job/Hadoop-common-trunk-Java8/ws/hadoop-common-project/hadoop-minikdc/target/org/apache/hadoop/minikdc/class-use/MiniKdc.html... Generating https://builds.apache.org/job/Hadoop-common-trunk-Java8/ws/hadoop-common-project/hadoop-minikdc/target/org/apache/hadoop/minikdc/class-use/KerberosSecurityTestcase.html... Generating https://builds.apache.org/job/Hadoop-common-trunk-Java8/ws/hadoop-common-project/hadoop-minikdc/target/org/apache/hadoop/minikdc/package-use.html... Building index for all the packages and classes... Generating https://builds.apache.org/job/Hadoop-common-trunk-Java8/ws/hadoop-common-project/hadoop-minikdc/target/overview-tree.html...
[jira] [Created] (HADOOP-11840) ECSchema are considered as not equal even if they are logically equal
Tsz Wo Nicholas Sze created HADOOP-11840: Summary: ECSchema are considered as not equal even if they are logically equal Key: HADOOP-11840 URL: https://issues.apache.org/jira/browse/HADOOP-11840 Project: Hadoop Common Issue Type: Sub-task Reporter: Tsz Wo Nicholas Sze For example, a schema could have an empty options and another schema has all the fields are the same except that options has NUM_DATA_UNITS_KEY = numDataUnits. Then, these two schemas are considered as not equal. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HADOOP-10116) fix inconsistent synchronization warnings in ZlibCompressor
[ https://issues.apache.org/jira/browse/HADOOP-10116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HADOOP-10116. --- Resolution: Duplicate Yeah, let's close it. fix inconsistent synchronization warnings in ZlibCompressor - Key: HADOOP-10116 URL: https://issues.apache.org/jira/browse/HADOOP-10116 Project: Hadoop Common Issue Type: Bug Reporter: Colin Patrick McCabe Fix findbugs warnings in ZlibCompressor. I believe these were introduced by HADOOP-10047. {code} Code Warning ISInconsistent synchronization of org.apache.hadoop.io.compress.zlib.ZlibCompressor.keepUncompressedBuf; locked 57% of time ISInconsistent synchronization of org.apache.hadoop.io.compress.zlib.ZlibCompressor.userBuf; locked 60% of time ISInconsistent synchronization of org.apache.hadoop.io.compress.zlib.ZlibCompressor.userBufLen; locked 85% of time ISInconsistent synchronization of org.apache.hadoop.io.compress.zlib.ZlibDecompressor.userBuf; locked 60% of time ISInconsistent synchronization of org.apache.hadoop.io.compress.zlib.ZlibDecompressor.userBufLen; locked 77% of time Dodgy Warnings Code Warning DLS Dead store to pos2 in org.apache.hadoop.io.compress.zlib.ZlibCompressor.put(ByteBuffer, ByteBuffer) DLS Dead store to pos2 in org.apache.hadoop.io.compress.zlib.ZlibDecompressor.put(ByteBuffer, ByteBuffer) {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HADOOP-11841) Is ecschema-def.xml needed?
Tsz Wo Nicholas Sze created HADOOP-11841: Summary: Is ecschema-def.xml needed? Key: HADOOP-11841 URL: https://issues.apache.org/jira/browse/HADOOP-11841 Project: Hadoop Common Issue Type: Sub-task Reporter: Tsz Wo Nicholas Sze Assignee: Tsz Wo Nicholas Sze Currently ecschema-def.xml is only used by a test. Is the file needed? How to use that file? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HADOOP-11841) Is ecschema-def.xml needed?
[ https://issues.apache.org/jira/browse/HADOOP-11841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng resolved HADOOP-11841. Resolution: Duplicate Let's address this question in HDFS-7337, thanks. Is ecschema-def.xml needed? --- Key: HADOOP-11841 URL: https://issues.apache.org/jira/browse/HADOOP-11841 Project: Hadoop Common Issue Type: Sub-task Components: io Reporter: Tsz Wo Nicholas Sze Assignee: Tsz Wo Nicholas Sze Currently ecschema-def.xml is only used by a test. Is the file needed? How to use that file? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Reopened] (HADOOP-11841) Is ecschema-def.xml needed?
[ https://issues.apache.org/jira/browse/HADOOP-11841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze reopened HADOOP-11841: -- HDFS-7337 takes care of a lot of issues. Let's discuss the xml file here. Is ecschema-def.xml needed? --- Key: HADOOP-11841 URL: https://issues.apache.org/jira/browse/HADOOP-11841 Project: Hadoop Common Issue Type: Sub-task Components: io Reporter: Tsz Wo Nicholas Sze Assignee: Tsz Wo Nicholas Sze Currently ecschema-def.xml is only used by a test. Is the file needed? How to use that file? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Re: [VOTE] Release Apache Hadoop 2.7.0 RC0
I would like to fix HDFS-8070, which just came to light. The impact is that if this isn't fixed, 2.6 clients will be unable to do short-circuit reads against 2.7 datanodes. best, Colin On Wed, Apr 15, 2015 at 8:19 PM, Brahma Reddy Battula brahmareddy.batt...@huawei.com wrote: Need Jcardar changes to support java 7 Byte code..I will work along with Todd to get jcardar.. Thanks Regards Brahma Reddy Battula From: Vinod Kumar Vavilapalli [vino...@hortonworks.com] Sent: Wednesday, April 15, 2015 6:29 PM To: common-dev@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 Tx Brahma. Apologies for missing your offline email. So, did you have luck with an updated JCarder? Or does that need JCarder changes that you are waiting on. +Vinod On Apr 15, 2015, at 7:21 AM, Brahma Reddy Battula brahmareddy.batt...@huawei.com wrote: HI Allen Thanks for updating here [ HDFS-8132 ].. Jcardar is tied to the Java 6 class format. Hadoop 2.7.0 is our first release that compiled Java 7 class files. Jcarder needs to updated to support Java 7 byte code.. I am +1 ( non binding),, after all the regression tests passed against 2.7.0-RC0 Thanks Regards Brahma Reddy Battula From: Allen Wittenauer [a...@altiscale.com] Sent: Wednesday, April 15, 2015 12:45 AM To: common-dev@hadoop.apache.org Cc: hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org Subject: Re: [VOTE] Release Apache Hadoop 2.7.0 RC0 Someone should look into HDFS-8132, which appears to have been filed against RC0. On Apr 11, 2015, at 1:44 AM, Vinod Kumar Vavilapalli vino...@apache.org wrote: Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC tag in git is: release-2.7.0-RC0 The maven artifacts are available via repository.apache.org at https://repository.apache.org/content/repositories/orgapachehadoop-1017/ As discussed before - This release will only work with JDK 1.7 and above - I’d like to use this as a starting release for 2.7.x [1], depending on how it goes, get it stabilized and potentially use a 2.7.1 in a few weeks as the stable release. Please try the release and vote; the vote will run for the usual 5 days. Thanks, Vinod [1]: A 2.7.1 release to follow up 2.7.0 http://markmail.org/thread/zwzze6cqqgwq4rmw
committing HADOOP-11746 test-patch improvements
I'd like to thank Allen Wittenauer for his work on HADOOP-11746 to rewrite test-patch.sh. There is a lot of nice new functionality in there. My favorite part is that some patches will execute much faster, so I expect this will make the project more efficient overall at moving patches through the pre-commit process. I have +1'd the patch, but since this is a tool that we all use frequently, I'd like to delay a day before committing. Please comment on the jira if you have any additional feedback. We're aiming to commit on Friday, 4/17. Chris Nauroth Hortonworks http://hortonworks.com/