Hadoop CI with alternate architectures.

I am writing this email to reduce mishaps similar to the issue reported by JIRA https://issues.apache.org/jira/browse/HADOOP-11505. In a nutshell, an x86 specific performance enhancement broke Hadoop build on Power and SPARC architecture. To avoid similar issues in future, could I offer my help her

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #1196

See Changes: [Arun Suresh] YARN-5049. Extend NMStateStore to save queued container information. -- [...truncated 10050 lines...] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time el

Hadoop-Hdfs-trunk-Java8 - Build # 1196 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/1196/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 10243 lines...] [INFO] --- maven-clean-plugin:2.5:c

Jenkins build is back to normal : Hadoop-Hdfs-trunk #3130

See - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

Re: [DISCUSS] Set minimum version of Hadoop 3 to JDK8 (HADOOP-11858)

+1 Regards, Uma On 5/10/16, 2:24 PM, "Andrew Wang" wrote: >+1 > >On Tue, May 10, 2016 at 12:36 PM, Ravi Prakash >wrote: > >> +1. Thanks for driving this Akira >> >> On Tue, May 10, 2016 at 10:25 AM, Tsuyoshi Ozawa >>wrote: >> >> > > Before cutting 3.0.0-alpha RC, I'd like to drop JDK7 support

[jira] [Resolved] (HDFS-7350) WebHDFS: Support EC commands through webhdfs

[ https://issues.apache.org/jira/browse/HDFS-7350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G resolved HDFS-7350. --- Resolution: Invalid > WebHDFS: Support EC commands through webhdfs > --

Hadoop-Hdfs-trunk-Java8 - Build # 1195 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/1195/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 9218 lines...] [INFO] --- maven-clean-plugin:2.5:cl

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #1195

See Changes: [cmccabe] HADOOP-13065. Add a new interface for retrieving FS and FC Statistics [kasha] YARN-4995. FairScheduler: Display per-queue demand on the scheduler [szetszwo] HDFS-10346. Implement asynchronous setPermissi

Build failed in Jenkins: Hadoop-Hdfs-trunk #3129

See Changes: [cmccabe] HADOOP-13065. Add a new interface for retrieving FS and FC Statistics [kasha] YARN-4995. FairScheduler: Display per-queue demand on the scheduler -- [...truncated 10701

Hadoop-Hdfs-trunk - Build # 3129 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/3129/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 10894 lines...] [INFO] --- maven-antrun-plugin:1.7:run (c

Re: [Release thread] 2.8.0 release activities

I see the following list of JIRAs from HADOOP and HDFS as blockers for 2.8.0. Other JIRAs are either old issues with little movement or new issues that don't appear to be as critical/ready. - HADOOP-12893 - HADOOP-12892 - HADOOP-10940 (patch ready?) - HADOOP-12971 (can be done relatively quickly?)

Re: [Release thread] 2.8.0 release activities

Sounds good to me :). Jian and I have looked at all existing 2.8.0 blockers and criticals today. To me more than half of MR/YARN blockers/criticals of 2.8 should be moved out. Left comments on these JIRAs asked original owners, plan to update target version of these JIRAs early next week. Will ke

Re: [Release thread] 2.8.0 release activities

How about this? I'll review the HADOOP/HDFS bugs in that list to come up with true blockers for 2.8.0 or JIRAs that are close to being ready. I'll report the list here. Then folks can chime in if you agree Perhaps Wangda, you can go over the YARN/MR bugs. Sound like a plan? Thanks, Sangjin On We

[jira] [Created] (HDFS-10392) Test failures on trunk: TestEditLog and TestReconstructStripedBlocks

Xiaobing Zhou created HDFS-10392: Summary: Test failures on trunk: TestEditLog and TestReconstructStripedBlocks Key: HDFS-10392 URL: https://issues.apache.org/jira/browse/HDFS-10392 Project: Hadoop HD

[jira] [Created] (HDFS-10391) Always enable NameNode service RPC port

Arpit Agarwal created HDFS-10391: Summary: Always enable NameNode service RPC port Key: HDFS-10391 URL: https://issues.apache.org/jira/browse/HDFS-10391 Project: Hadoop HDFS Issue Type: Bug

Re: [Release thread] 2.8.0 release activities

+1, we should close such staled JIRAs to avoid doing unnecessary checks for every releases. I'm working on reviewing YARN/MR critical/blocker patches currently, it gonna very helpful if someone else can help with reviewing Common/HDFS JIRAs. Thanks, Wangda On Wed, May 11, 2016 at 4:20 PM, Sangj

Re: [Release thread] 2.8.0 release activities

Where do we stand in terms of closing out blocker/critical issues for 2.8.0? I still see 50 open JIRAs in Vinod's list: https://issues.apache.org/jira/issues/?filter=12334985 But I see a lot of JIRAs with no patches or very stale patches. It would be a good exercise to come up with the list of JIR

[jira] [Created] (HDFS-10390) Implement asynchronous setAcl/getAclStatus for DistributedFileSystem

Xiaobing Zhou created HDFS-10390: Summary: Implement asynchronous setAcl/getAclStatus for DistributedFileSystem Key: HDFS-10390 URL: https://issues.apache.org/jira/browse/HDFS-10390 Project: Hadoop HD

Hadoop-Hdfs-trunk-Java8 - Build # 1194 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/1194/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 8147 lines...] [INFO] --- maven-clean-plugin:2.5:cl

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #1194

See Changes: [cnauroth] HADOOP-13008. Add XFS Filter for UIs to Hadoop Common. Contributed by [lmccay] HADOOP-12942. hadoop credential commands non-obviously use password of -- [...trunc

Hadoop-Hdfs-trunk - Build # 3128 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/3128/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 5386 lines...] [INFO] --- maven-antrun-plugin:1.7:run (cr

Build failed in Jenkins: Hadoop-Hdfs-trunk #3128

See Changes: [junping_du] YARN-5029. RM needs to send update event with YarnApplicationState as [cnauroth] HADOOP-13008. Add XFS Filter for UIs to Hadoop Common. Contributed by [lmccay] HADOOP-12942. hadoop credential commands non-

Hadoop-Hdfs-trunk-Java8 - Build # 1193 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/1193/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 10985 lines...] [INFO] --- maven-antrun-plugin:1.7:

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #1193

See Changes: [junping_du] YARN-5029. RM needs to send update event with YarnApplicationState as -- [...truncated 10792 lines...] "Socket Reader #1 for port 42789" prio=5 tid=45 runnable

Hadoop-Hdfs-trunk - Build # 3127 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/3127/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 9607 lines...] [INFO] --- maven-antrun-plugin:1.7:run (cr

Build failed in Jenkins: Hadoop-Hdfs-trunk #3127

See Changes: [stevel] HADOOP-13125 FS Contract tests don't report FS initialization errors -- [...truncated 9414 lines...] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.124

Re: [DISCUSS] Set minimum version of Hadoop 3 to JDK8 (HADOOP-11858)

bq. We'll need to be strict after the switch: all patches to go into branch 2 will have to go through yetus as branch-2 patches, then cherry picked to trunk, or a separate patch on the same JIRA done for the branch-2. Assuming yetus still tests the branch-2 stuff on JDK7, that will check version

Re: [DISCUSS] Set minimum version of Hadoop 3 to JDK8 (HADOOP-11858)

> > On 10 May 2016, at 16:32, Akira AJISAKA wrote: > > Hi developers, > > Before cutting 3.0.0-alpha RC, I'd like to drop JDK7 support in trunk. +1 Given Robert Kanter first filed the patch to do this —why not give him the honour. In fact, why not have a webex screen share of the occasion so

Hadoop-Hdfs-trunk-Java8 - Build # 1192 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/1192/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6056 lines...] [INFO] --- maven-antrun-plugin:1.7:r

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #1192

See Changes: [stevel] HADOOP-13125 FS Contract tests don't report FS initialization errors -- [...truncated 5863 lines...] Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPe

[jira] [Created] (HDFS-10389) LoadBalancingKMSClientProvider ClassCastException on AuthenticationException

Miklos Szurap created HDFS-10389: Summary: LoadBalancingKMSClientProvider ClassCastException on AuthenticationException Key: HDFS-10389 URL: https://issues.apache.org/jira/browse/HDFS-10389 Project: H

Re: [VOTE] Merge feature branch HADOOP-12930

+1 (non-binding) reviewed everything, filed an additional subtask for a very trivial typo in the docs. should be fine to make a full issue after close and then fix. tried merging locally, tried running through new shell tests (both with and without bats installed), tried making an example custom

Hadoop-Hdfs-trunk - Build # 3126 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/3126/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 8204 lines...] [INFO] --- maven-clean-plugin:2.5:clean (d

Build failed in Jenkins: Hadoop-Hdfs-trunk #3126

See Changes: [Arun Suresh] YARN-5073. Refactor startContainerInternal() in ContainerManager to -- [...truncated 8011 lines...] at java.util.concurrent.SynchronousQueue$TransferStack.a

Hadoop-Hdfs-trunk-Java8 - Build # 1191 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/1191/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 9062 lines...] [INFO] --- maven-clean-plugin:2.5:cl

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #1191

See Changes: [Arun Suresh] YARN-5073. Refactor startContainerInternal() in ContainerManager to -- [...truncated 8869 lines...] at org.apache.hadoop.ipc.Server$Responder.run(Serve