[jira] [Created] (HDFS-9570) Minor typos, grammar, and case sensitivity cleanup in HdfsPermissionsGuide.md's

Travis Campbell created HDFS-9570: - Summary: Minor typos, grammar, and case sensitivity cleanup in HdfsPermissionsGuide.md's Key: HDFS-9570 URL: https://issues.apache.org/jira/browse/HDFS-9570 Project

Hadoop-Hdfs-trunk - Build # 2635 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2635/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6367 lines...] [INFO] --- maven-antrun-plugin:1.7:run (cr

Build failed in Jenkins: Hadoop-Hdfs-trunk #2635

See Changes: [wangda] YARN-4293. ResourceUtilization should be a part of yarn node CLI. (Sunil [wangda] YARN-4225. Add preemption status to yarn queue -status for capacity [wangda] YARN-4416. Deadlock due to synchronised get Method

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #701

See Changes: [wangda] YARN-4293. ResourceUtilization should be a part of yarn node CLI. (Sunil [wangda] YARN-4225. Add preemption status to yarn queue -status for capacity [wangda] YARN-4416. Deadlock due to synchronised get M

Hadoop-Hdfs-trunk-Java8 - Build # 701 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/701/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7029 lines...] [INFO] --- maven-antrun-plugin:1.7:ru

Re: [Important] Lots of 2.8.0 commits are in branch-2 only

Not entirely sure we have enough info to warrant a hard-reset. Yet. Do we know how many of these are new features / improvement that we shouldn’t put any more into 2.8.0 and how many are bugs that we need to? If you don’t have time, I’ll look at it right after getting out 2.7.2 RC1. Thanks +Vin

[VOTE] Release Apache Hadoop 2.7.2 RC1

Hi all, I've created a release candidate RC1 for Apache Hadoop 2.7.2. As discussed before, this is the next maintenance release to follow up 2.7.1. The RC is available for validation at: http://people.apache.org/~vinodkv/hadoop-2.7.2-RC1/

[jira] [Created] (HDFS-9569) Change msg issused before loading fsimage to Info from debug for better supportability

Yongjun Zhang created HDFS-9569: --- Summary: Change msg issused before loading fsimage to Info from debug for better supportability Key: HDFS-9569 URL: https://issues.apache.org/jira/browse/HDFS-9569 Proj

Re: [Important] Lots of 2.8.0 commits are in branch-2 only

Thanks Wangda for reporting issue. I'm also +1 for recreating a new branch-2.8 based on current branch-2.8 too. After that, we can revert 2.9.0-only patches on the branch. I will help you if necessary, so please let me know. Thanks, - Tsuyoshi On Thu, Dec 17, 2015 at 10:51 AM, Jing Zhao wrote: >

Re: [Important] Lots of 2.8.0 commits are in branch-2 only

Thanks for reporting the issue, Wangda. Recreating a new branch-2.8 based on the current branch-2 makes sense to me. Thanks, -Jing On Wed, Dec 16, 2015 at 5:38 PM, Wangda Tan wrote: > Hi folks, > > I found there're lots of commits are in branch-2 only. > Ran "git log branch-2.8..branch-2". > >

[Important] Lots of 2.8.0 commits are in branch-2 only

Hi folks, I found there're lots of commits are in branch-2 only. Ran "git log branch-2.8..branch-2". There're 35 commits for YARN, 41 commits for HDFS and 12 commits for COMMON. Only several of them are placed in 2.9.0 section in CHANGES.txt. I think we can either hard reset branch-2.8 to branch

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

Hey Vinod, Yes. We are voting for RC0 tag and all related build bits are related to RC0 only. Shall we do something special to RC0.1 or RC1 tag (they are just duplicated with RC0, pointing to the same commit as I mentioned below)? I guess no as we will have final tag for this re

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

+1 (binding), Build and deploy the cluster from source code. Ran a few example jobs and passed successfully. Xuan Gong > On Dec 16, 2015, at 4:07 PM, Arpit Agarwal wrote: > > +1 (binding) > > - Verified signatures for source and binary distributions > - Built jars from source with java 1.7.0

Re: TestDirectoryScanner.testThrottle() Failures

Done On Wed, Dec 16, 2015 at 4:17 PM, Daniel Templeton wrote: > Would someone please review and commit HDFS-9300 so that the > testThrottle() test will stop failing. It's a 2-line patch. > > Thanks, > Daniel >

TestDirectoryScanner.testThrottle() Failures

Would someone please review and commit HDFS-9300 so that the testThrottle() test will stop failing. It's a 2-line patch. Thanks, Daniel

Hadoop-Hdfs-trunk - Build # 2634 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2634/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6357 lines...] [INFO] --- maven-antrun-plugin:1.7:run (cr

Build failed in Jenkins: Hadoop-Hdfs-trunk #2634

See Changes: [junping_du] YARN-4452. NPE when submit Unmanaged application. Contributed by [cnauroth] HDFS-9557. Reduce object allocation in PB conversion. Contributed by [sseth] YARN-4207. Add a non-judgemental YARN app completion

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

+1 (binding) - Verified signatures for source and binary distributions - Built jars from source with java 1.7.0_79 - Deployed single-node pseudo-cluster - Ran example map reduce jobs - Ran hdfs admin commands, verified NN web UI shows expected usages On 12/11/15, 4:16 PM, "Junping Du" wrote:

[jira] [Resolved] (HDFS-9568) Support NFSv4 interface to HDFS

[ https://issues.apache.org/jira/browse/HDFS-9568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-9568. -- Resolution: Duplicate > Support NFSv4 interface to HDFS > --- > >

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #700

See Changes: [junping_du] YARN-4452. NPE when submit Unmanaged application. Contributed by [cnauroth] HDFS-9557. Reduce object allocation in PB conversion. Contributed by [sseth] YARN-4207. Add a non-judgemental YARN app comple

Hadoop-Hdfs-trunk-Java8 - Build # 700 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/700/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 10481 lines...] [INFO] --- maven-clean-plugin:2.5:cl

[jira] [Resolved] (HDFS-9551) Random VolumeChoosingPolicy

[ https://issues.apache.org/jira/browse/HDFS-9551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-9551. --- Resolution: Won't Fix Based on discussion here, I don't want to add the maintenance burden of a new vo

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

+1 (binding) - Verified signatures and digests- Successfully built from source with native code support- Deployed to a single-node cluster and ran some test jobs Jason From: Junping Du To: Hadoop Common ; "hdfs-dev@hadoop.apache.org" ; "mapreduce-...@hadoop.apache.org" ; "yarn-...@hadoo

Re: [VOTE] Release Apache Hadoop 2.7.2 RC0

The last of the blockers went in late last week. Re-spinning the RC now. Thanks +Vinod > On Nov 13, 2015, at 10:26 AM, Vinod Kumar Vavilapalli > wrote: > > Thanks for reporting this Jason! > > Everyone, I am canceling this RC given the feedback, we will go again after > addressing the open

Re: [VOTE] Release Apache Hadoop 2.7.2 RC0

Seeing as this came up very late, I am leaning towards dropping this off from 2.7.2. That said, I don’t see any reason why this shouldn’t be in 2.8.0 and 2.7.3. Set the target-versions accordingly on JIRA. If you agree, appreciate backport help to those branches. Thanks +Vinod > On Dec 15, 20

Re: [VOTE] Release Apache Hadoop 2.7.2 RC0

Per our discussion on JIRA and here, I was okay with this backport. I want to get back to the RC quickly now, so went ahead and pulled the patch into 2.7.2 myself. Thanks +Vinod > On Dec 10, 2015, at 4:06 PM, Konstantin Boudnik wrote: > > Vinod, are you Ok with me putting it into 2.7.2? > >

[jira] [Created] (HDFS-9568) Support NFSv4 interface to HDFS

John Zhuge created HDFS-9568: Summary: Support NFSv4 interface to HDFS Key: HDFS-9568 URL: https://issues.apache.org/jira/browse/HDFS-9568 Project: Hadoop HDFS Issue Type: New Feature C

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

+1 (binding) for the RC except for my question below about the tag. I checked 2.6.3-RC0, based on my check-list: - Signatures and message digests all are good in general. - The top level full LICENSE, NOTICE and README for the source artifacts are good - CHANGES.txt for common, hdfs and mapped a

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

+1 (non-binding) 1. Download the pre-built tar and check the validity 2. Configure and start a pseudo-distributed cluster 3. Run example grep MapReduce job locally 4. Operate the HDFS copying files from/to local directory 5. Check execution logs All good. Thanks. L > On Dec 11, 2015, at 4:16 PM

[jira] [Resolved] (HDFS-9567) LlapServiceDriver can fail if only the packaged logger config is present

[ https://issues.apache.org/jira/browse/HDFS-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin resolved HDFS-9567. Resolution: Invalid Wrong project > LlapServiceDriver can fail if only the packaged logger c

[jira] [Created] (HDFS-9567) LlapServiceDriver can fail if only the packaged logger config is present

Sergey Shelukhin created HDFS-9567: -- Summary: LlapServiceDriver can fail if only the packaged logger config is present Key: HDFS-9567 URL: https://issues.apache.org/jira/browse/HDFS-9567 Project: Had

[jira] [Created] (HDFS-9566) Remove expensive getStorages method

Daryn Sharp created HDFS-9566: - Summary: Remove expensive getStorages method Key: HDFS-9566 URL: https://issues.apache.org/jira/browse/HDFS-9566 Project: Hadoop HDFS Issue Type: Improvement

Hadoop-Hdfs-trunk - Build # 2633 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2633/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7622 lines...] [INFO] --- maven-antrun-plugin:1.7:run (cr

Build failed in Jenkins: Hadoop-Hdfs-trunk #2633

See Changes: [aw] HADOOP-12192. update releasedocmaker command line (aw) -- [...truncated 7429 lines...] Running org.apache.hadoop.hdfs.web.TestWebHdfsWithMultipleNameNodes Tests run: 1, Failu

[jira] [Created] (HDFS-9565) TestDistributedFileSystem.testLocatedFileStatusStorageIdsTypes is flaky

Wei-Chiu Chuang created HDFS-9565: - Summary: TestDistributedFileSystem.testLocatedFileStatusStorageIdsTypes is flaky Key: HDFS-9565 URL: https://issues.apache.org/jira/browse/HDFS-9565 Project: Hadoop

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

So, the original voting mail mentions we are voting on release-2.6.3-RC0 tag. Are we still doing that? What are the RC0.1 and RC1 tags doing then? +Vinod > On Dec 16, 2015, at 2:13 AM, Junping Du wrote: > > Thanks Akira for notice this. I don't think we can remove these tags as they > should

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #699

See Changes: [aw] HADOOP-12192. update releasedocmaker command line (aw) -- [...truncated 6808 lines...] Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=768m; suppo

Hadoop-Hdfs-trunk-Java8 - Build # 699 - Failure

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/699/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7001 lines...] [INFO] Executing tasks main: [mk

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

+1 (non-binding) - Downloaded the source and built locally. - Set up a 2 node cluster. - Ran a few mapreduce jobs successfully. Regards, Varun Saxena. On Thu, Dec 17, 2015 at 12:06 AM, Tsuyoshi Ozawa wrote: > +1 (binding) > > - verified checksums > - built Spark and Tez with -Dhadoop.version=2

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

+1 (binding) - verified checksums - built Spark and Tez with -Dhadoop.version=2.6.3. About Tez, ran tests and all of them passed. Thanks, - Tsuyoshi On Thu, Dec 17, 2015 at 1:30 AM, Sangjin Lee wrote: > +1 (non-binding) > > - downloaded source and binary and verified the signatures (although I

[jira] [Created] (HDFS-9563) DiskBalancer: Refactor Plan Command

Xiaobing Zhou created HDFS-9563: --- Summary: DiskBalancer: Refactor Plan Command Key: HDFS-9563 URL: https://issues.apache.org/jira/browse/HDFS-9563 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-9564) DiskBalancer: Refactor Execute Command

Xiaobing Zhou created HDFS-9564: --- Summary: DiskBalancer: Refactor Execute Command Key: HDFS-9564 URL: https://issues.apache.org/jira/browse/HDFS-9564 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Reopened] (HDFS-402) Display the server version in dfsadmin -report

[ https://issues.apache.org/jira/browse/HDFS-402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer reopened HDFS-402: --- With rolling upgrade, this is very important now. The fact that this wasn't completed as part of t

[jira] [Resolved] (HDFS-402) Display the server version in dfsadmin -report

[ https://issues.apache.org/jira/browse/HDFS-402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-402. - Resolution: Won't Fix Please reopen if anyone thinks it is important and wants to work on it. > Display the

[jira] [Created] (HDFS-9562) libhdfs++ RpcConnectionImpl::Connect should acquire connection state lock

James Clampffer created HDFS-9562: - Summary: libhdfs++ RpcConnectionImpl::Connect should acquire connection state lock Key: HDFS-9562 URL: https://issues.apache.org/jira/browse/HDFS-9562 Project: Hado

[jira] [Resolved] (HDFS-3356) When dfs.block.size is configured to 0 the block which is created in rbw is never deleted

[ https://issues.apache.org/jira/browse/HDFS-3356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-3356. -- Resolution: Won't Fix This is not an issue since we now have minimum block size enforcement. > When dfs.

[jira] [Resolved] (HDFS-8011) standby nn can't started

[ https://issues.apache.org/jira/browse/HDFS-8011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-8011. -- Resolution: Cannot Reproduce It is very likely fixed in the later releases when we fixed similar issues.

[jira] [Resolved] (HDFS-1595) DFSClient may incorrectly detect datanode failure

[ https://issues.apache.org/jira/browse/HDFS-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-1595. -- Resolution: Duplicate Fix Version/s: HDFS-9178 > DFSClient may incorrectly detect datanode failure

[jira] [Created] (HDFS-9561) PIpieline recovery near the end of a block may fail

Kihwal Lee created HDFS-9561: Summary: PIpieline recovery near the end of a block may fail Key: HDFS-9561 URL: https://issues.apache.org/jira/browse/HDFS-9561 Project: Hadoop HDFS Issue Type: Bug

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

+1 (non-binding) - downloaded source and binary and verified the signatures (although I didn't connect with Junping via web of trust) - started a pseudo-distributed cluster and ran test jobs - browsed the RM and NN UI - looked through the daemon logs Thanks Junping. Sangjin On Wed, Dec 16, 2015

[jira] [Created] (HDFS-9560) Fair AvailableSpaceVolumeChoosingPolicy

BELUGA BEHR created HDFS-9560: - Summary: Fair AvailableSpaceVolumeChoosingPolicy Key: HDFS-9560 URL: https://issues.apache.org/jira/browse/HDFS-9560 Project: Hadoop HDFS Issue Type: Improvement

RE: [VOTE] Release Apache Hadoop 2.6.3 RC0

+1 (non-binding) -- Downloaded both source and binary tarballs successfully. --Set up a pseudo-distributed cluster and Distributed HA Cluster --Ran Several jobs Slive,Terasort and pi. --All are working fine. Thanks & Regards Brahma Reddy Battula From: St

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

+1, binding Did a build and test with slider with the build set to -Dhadoop.version=2.6.3 this does a D/L and test from the staging repo. All artifacts were located, and the tests completed > On 12 Dec 2015, at 00:16, Junping Du wrote: > > > Hi all developers in hadoop community, > I've

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

> On 16 Dec 2015, at 06:41, Akira AJISAKA wrote: > > Thanks Junping for starting release process. > I noticed there are duplicated tags: > > * release-2.6.3-RC0 > * release-2.6.3-RC0.1 > * release-2.6.3-RC1 > > Could you remove RC0.1 and RC1? > > Regards, > Akira the ASF has locked down tag

[jira] [Created] (HDFS-9559) Add haadmin command to get HA state of all the namenodes

Surendra Singh Lilhore created HDFS-9559: Summary: Add haadmin command to get HA state of all the namenodes Key: HDFS-9559 URL: https://issues.apache.org/jira/browse/HDFS-9559 Project: Hadoop H

Hadoop-Hdfs-trunk - Build # 2632 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2632/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6372 lines...] [INFO] --- maven-antrun-plugin:1.7:run (cr

Build failed in Jenkins: Hadoop-Hdfs-trunk #2632

See Changes: [zxu] Update CHANGES.txt to move MAPREDUCE-6436 from YARN to MAPREDUCE -- [...truncated 6179 lines...] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 26.739 sec -

Re: [VOTE] Release Apache Hadoop 2.6.3 RC0

Thanks Akira for notice this. I don't think we can remove these tags as they should be immutable as branches. I created these duplicated tags as after I cut off RC0 out, some commit lands on 2.6.3 unexpected but I didn't realize I could still push to original tag by forcefully. The best thing I