[jira] [Resolved] (HDFS-10859) TestBalancer#testUnknownDatanodeSimple and testBalancerWithKeytabs are flaky in branch-2.7

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-10859. -- Resolution: Duplicate Thanks for the pointer Xiao. HDFS-10716 indeed solves the problem. > TestBalancer

[jira] [Commented] (HDFS-10716) In Balancer, the target task should be removed when its size < 0.

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15486436#comment-15486436 ] Zhe Zhang commented on HDFS-10716: -- I backported this to branch-2.7. > In Balancer, the

[jira] [Updated] (HDFS-10716) In Balancer, the target task should be removed when its size < 0.

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10716: - Fix Version/s: 2.7.4 > In Balancer, the target task should be removed when its size < 0. > ---

[jira] [Commented] (HDFS-10856) Update the comment of BPServiceActor$Scheduler#scheduleNextBlockReport

2016-09-12 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15486429#comment-15486429 ] Yiqun Lin commented on HDFS-10856: -- Thanks [~ajisakaa] for the commit, I will attach a pa

[jira] [Commented] (HDFS-10856) Update the comment of BPServiceActor$Scheduler#scheduleNextBlockReport

2016-09-12 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15486404#comment-15486404 ] Akira Ajisaka commented on HDFS-10856: -- {quote} bq. This should be done in a separate

[jira] [Commented] (HDFS-10856) Update the comment of BPServiceActor$Scheduler#scheduleNextBlockReport

2016-09-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15486400#comment-15486400 ] Hudson commented on HDFS-10856: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-10860) Switch HttpFS to use Jetty

2016-09-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10860: - Description: The Tomcat 6 we are using will reach EOL at the end of 2017. While there are other good opti

[jira] [Commented] (HDFS-10744) Internally optimize path component resolution

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15486380#comment-15486380 ] Zhe Zhang commented on HDFS-10744: -- I verified that all reported failures pass locally. I

[jira] [Updated] (HDFS-10856) Update the comment of BPServiceActor$Scheduler#scheduleNextBlockReport

2016-09-12 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-10856: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (HDFS-10378) FSDirAttrOp#setOwner throws ACE with misleading message

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15486345#comment-15486345 ] Hadoop QA commented on HDFS-10378: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10856) Update the comment of BPServiceActor$Scheduler#scheduleNextBlockReport

2016-09-12 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-10856: - Component/s: documentation LGTM, +1. The test failure is unrelated. > Update the comment of BPSer

[jira] [Commented] (HDFS-10657) testAclCLI.xml setfacl test should expect mask r-x

2016-09-12 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15486309#comment-15486309 ] Yongjun Zhang commented on HDFS-10657: -- Committed to trunk, branch-2 and branch-2.8.

[jira] [Updated] (HDFS-10657) testAclCLI.xml setfacl test should expect mask r-x

2016-09-12 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-10657: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolv

[jira] [Created] (HDFS-10860) Switch HttpFS to use Jetty

2016-09-12 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10860: - Summary: Switch HttpFS to use Jetty Key: HDFS-10860 URL: https://issues.apache.org/jira/browse/HDFS-10860 Project: Hadoop HDFS Issue Type: Improvement Co

[jira] [Commented] (HDFS-10657) testAclCLI.xml setfacl test should expect mask r-x

2016-09-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15486274#comment-15486274 ] Hudson commented on HDFS-10657: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-10837) Standardize serializiation of WebHDFS DirectoryListing

2016-09-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15486236#comment-15486236 ] Xiao Chen commented on HDFS-10837: -- Thanks Andrew for revving! The feature is covered on

[jira] [Updated] (HDFS-10378) FSDirAttrOp#setOwner throws ACE with misleading message

2016-09-12 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10378: -- Attachment: HDFS-10378.003.patch Patch 003: * Fix the unit test bugs > FSDirAttrOp#setOwner throws ACE

[jira] [Updated] (HDFS-10378) FSDirAttrOp#setOwner throws ACE with misleading message

2016-09-12 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10378: -- Status: Patch Available (was: In Progress) > FSDirAttrOp#setOwner throws ACE with misleading message >

[jira] [Commented] (HDFS-10856) Update the comment of BPServiceActor$Scheduler#scheduleNextBlockReport

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15486128#comment-15486128 ] Hadoop QA commented on HDFS-10856: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10378) FSDirAttrOp#setOwner throws ACE with misleading message

2016-09-12 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-10378: -- Summary: FSDirAttrOp#setOwner throws ACE with misleading message (was: FSDirAttrOp#setOwner throws ACE

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15486056#comment-15486056 ] Hadoop QA commented on HDFS-10301: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10599) DiskBalancer: Execute CLI via Shell

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15486054#comment-15486054 ] Hadoop QA commented on HDFS-10599: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10562) DiskBalancer: update documentation on how to report issues and debug

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15486029#comment-15486029 ] Hadoop QA commented on HDFS-10562: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10636) Modify ReplicaInfo to remove the assumption that replica metadata and data are stored in java.io.File.

2016-09-12 Thread Virajith Jalaparti (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15486024#comment-15486024 ] Virajith Jalaparti commented on HDFS-10636: --- Hi [~eddyxu], That is a very valid

[jira] [Updated] (HDFS-10562) DiskBalancer: update documentation on how to report issues and debug

2016-09-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10562: Attachment: HDFS-10562.003.patch Fixed the issue pointed out by [~arpitagarwal] > DiskBalancer: upd

[jira] [Commented] (HDFS-10837) Standardize serializiation of WebHDFS DirectoryListing

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15486006#comment-15486006 ] Hadoop QA commented on HDFS-10837: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485971#comment-15485971 ] Hadoop QA commented on HDFS-10824: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-09-12 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485956#comment-15485956 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- [~arpiagariu] In the latest p

[jira] [Updated] (HDFS-10856) Update the comment of BPServiceActor$Scheduler#scheduleNextBlockReport

2016-09-12 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10856: - Attachment: (was: HDFS-10856.001.patch) > Update the comment of BPServiceActor$Scheduler#scheduleNextB

[jira] [Updated] (HDFS-10856) Update the comment of BPServiceActor$Scheduler#scheduleNextBlockReport

2016-09-12 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-10856: - Attachment: HDFS-10856.001.patch > Update the comment of BPServiceActor$Scheduler#scheduleNextBlockReport

[jira] [Commented] (HDFS-10856) Update the comment of BPServiceActor$Scheduler#scheduleNextBlockReport

2016-09-12 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485954#comment-15485954 ] Yiqun Lin commented on HDFS-10856: -- Thanks [~ajisakaa] for the suggestions. {quote} I'm

[jira] [Commented] (HDFS-10562) DiskBalancer: update documentation on how to report issues and debug

2016-09-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485945#comment-15485945 ] Anu Engineer commented on HDFS-10562: - Thanks for catching that, will do. > DiskBala

[jira] [Commented] (HDFS-10562) DiskBalancer: update documentation on how to report issues and debug

2016-09-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485936#comment-15485936 ] Arpit Agarwal commented on HDFS-10562: -- +1. A minor comment: {code} 212 *max dis

[jira] [Commented] (HDFS-10744) Internally optimize path component resolution

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485926#comment-15485926 ] Hadoop QA commented on HDFS-10744: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10843) Quota Feature Cached Size != Computed Size When Block Committed But Not Completed

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485915#comment-15485915 ] Hadoop QA commented on HDFS-10843: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Updated] (HDFS-10599) DiskBalancer: Execute CLI via Shell

2016-09-12 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-10599: -- Attachment: HDFS-10599.002.patch > DiskBalancer: Execute CLI via Shell > --

[jira] [Commented] (HDFS-10744) Internally optimize path component resolution

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485898#comment-15485898 ] Hadoop QA commented on HDFS-10744: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10599) DiskBalancer: Execute CLI via Shell

2016-09-12 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485897#comment-15485897 ] Manoj Govindassamy commented on HDFS-10599: --- Thanks for the review [~xiaobingo].

[jira] [Updated] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-09-12 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinitha Reddy Gankidi updated HDFS-10301: - Attachment: HDFS-10301.014.patch > BlockReport retransmissions may lead to storage

[jira] [Commented] (HDFS-10301) BlockReport retransmissions may lead to storages falsely being declared zombie if storage report processing happens out of order

2016-09-12 Thread Vinitha Reddy Gankidi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485884#comment-15485884 ] Vinitha Reddy Gankidi commented on HDFS-10301: -- Upon thorough investigation o

[jira] [Commented] (HDFS-10636) Modify ReplicaInfo to remove the assumption that replica metadata and data are stored in java.io.File.

2016-09-12 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485831#comment-15485831 ] Lei (Eddy) Xu commented on HDFS-10636: -- Sorry for late reply, [~chris] and [~virajith

[jira] [Commented] (HDFS-10562) DiskBalancer: update documentation on how to report issues and debug

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485790#comment-15485790 ] Hadoop QA commented on HDFS-10562: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-10837) Standardize serializiation of WebHDFS DirectoryListing

2016-09-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10837: --- Attachment: hdfs-10837.003.patch Thanks for reviewing Xiao, new patch attached. Added requested precon

[jira] [Updated] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-12 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10824: - Attachment: HDFS-10824.001.patch v002 is posted. It fixed test failures and check style issues. >

[jira] [Comment Edited] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-12 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485776#comment-15485776 ] Xiaobing Zhou edited comment on HDFS-10824 at 9/13/16 12:35 AM:

[jira] [Commented] (HDFS-10636) Modify ReplicaInfo to remove the assumption that replica metadata and data are stored in java.io.File.

2016-09-12 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485773#comment-15485773 ] Chris Douglas commented on HDFS-10636: -- The latest version of the patch lgtm, +1. Tha

[jira] [Updated] (HDFS-10562) DiskBalancer: update documentation on how to report issues and debug

2016-09-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10562: Attachment: HDFS-10562.002.patch > DiskBalancer: update documentation on how to report issues and de

[jira] [Updated] (HDFS-10562) DiskBalancer: update documentation on how to report issues and debug

2016-09-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10562: Target Version/s: 3.0.0-alpha2 (was: HDFS-1312) > DiskBalancer: update documentation on how to repo

[jira] [Updated] (HDFS-10562) DiskBalancer: update documentation on how to report issues and debug

2016-09-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10562: Attachment: (was: HDFS-10562.001.patch) > DiskBalancer: update documentation on how to report is

[jira] [Updated] (HDFS-10562) DiskBalancer: update documentation on how to report issues and debug

2016-09-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10562: Fix Version/s: (was: HDFS-1312) > DiskBalancer: update documentation on how to report issues and

[jira] [Updated] (HDFS-10562) DiskBalancer: update documentation on how to report issues and debug

2016-09-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10562: Attachment: HDFS-10562.001.patch [~arpitagarwal] Thanks for the code review comments. I have updated

[jira] [Commented] (HDFS-10850) getEZForPath should NOT throw FNF

2016-09-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485744#comment-15485744 ] Andrew Wang commented on HDFS-10850: Okay, from a quick look at the Hive code, one pos

[jira] [Updated] (HDFS-10843) Quota Feature Cached Size != Computed Size When Block Committed But Not Completed

2016-09-12 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-10843: --- Attachment: HDFS-10843.003.patch Seems that I accidentally uploaded a slightly out of date patch file

[jira] [Commented] (HDFS-10858) FBR processing may generate incorrect reportedBlock-blockGroup mapping

2016-09-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485699#comment-15485699 ] Hudson commented on HDFS-10858: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Commented] (HDFS-10843) Quota Feature Cached Size != Computed Size When Block Committed But Not Completed

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485687#comment-15485687 ] Hadoop QA commented on HDFS-10843: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Comment Edited] (HDFS-10475) Adding metrics for long FSNamesystem read and write locks

2016-09-12 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485649#comment-15485649 ] Erik Krogen edited comment on HDFS-10475 at 9/12/16 11:47 PM: --

[jira] [Updated] (HDFS-10858) FBR processing may generate incorrect reportedBlock-blockGroup mapping

2016-09-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-10858: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 Status: Resolve

[jira] [Commented] (HDFS-10475) Adding metrics for long FSNamesystem read and write locks

2016-09-12 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485649#comment-15485649 ] Erik Krogen commented on HDFS-10475: To get a mapping of operation -> lock time metric

[jira] [Commented] (HDFS-10533) Make DistCpOptions class immutable

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485624#comment-15485624 ] Hadoop QA commented on HDFS-10533: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Updated] (HDFS-10744) Internally optimize path component resolution

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10744: - Attachment: HDFS-10744-branch-2.7.patch > Internally optimize path component resolution >

[jira] [Updated] (HDFS-10744) Internally optimize path component resolution

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10744: - Status: Patch Available (was: Reopened) > Internally optimize path component resolution > ---

[jira] [Reopened] (HDFS-10744) Internally optimize path component resolution

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang reopened HDFS-10744: -- Sorry for re-opening this. Triggering Jenkins for branch-2.7 patch. > Internally optimize path component re

[jira] [Commented] (HDFS-10673) Optimize FSPermissionChecker's internal path usage

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485593#comment-15485593 ] Zhe Zhang commented on HDFS-10673: -- Verified all reported failures pass locally. Pushed t

[jira] [Updated] (HDFS-10673) Optimize FSPermissionChecker's internal path usage

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10673: - Resolution: Fixed Fix Version/s: 2.7.4 Status: Resolved (was: Patch Available) > Optimi

[jira] [Commented] (HDFS-10859) TestBalancer#testUnknownDatanodeSimple and testBalancerWithKeytabs are flaky in branch-2.7

2016-09-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485585#comment-15485585 ] Xiao Chen commented on HDFS-10859: -- Thanks Zhe! Now I recall, the common method {{testUnk

[jira] [Commented] (HDFS-10673) Optimize FSPermissionChecker's internal path usage

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485584#comment-15485584 ] Hadoop QA commented on HDFS-10673: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485572#comment-15485572 ] Hadoop QA commented on HDFS-10824: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10821) DiskBalancer: Report command support with multiple nodes

2016-09-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485566#comment-15485566 ] Hudson commented on HDFS-10821: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-10533) Make DistCpOptions class immutable

2016-09-12 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-10533: - Attachment: HDFS-10533.004.patch Rebase from {{trunk}} branch and resolved conflicts with [HADOOP-

[jira] [Commented] (HDFS-10858) FBR processing may generate incorrect reportedBlock-blockGroup mapping

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485556#comment-15485556 ] Hadoop QA commented on HDFS-10858: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10673) Optimize FSPermissionChecker's internal path usage

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485547#comment-15485547 ] Hadoop QA commented on HDFS-10673: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10599) DiskBalancer: Execute CLI via Shell

2016-09-12 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485544#comment-15485544 ] Xiaobing Zhou commented on HDFS-10599: -- Thanks [~manojg] for the work, and [~anu] for

[jira] [Updated] (HDFS-10821) DiskBalancer: Report command support with multiple nodes

2016-09-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-10821: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: (was: 2.9.0)

[jira] [Updated] (HDFS-10859) TestBalancer#testUnknownDatanodeSimple and testBalancerWithKeytabs are flaky in branch-2.7

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10859: - Summary: TestBalancer#testUnknownDatanodeSimple and testBalancerWithKeytabs are flaky in branch-2.7 (was:

[jira] [Commented] (HDFS-10821) DiskBalancer: Report command support with multiple nodes

2016-09-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485513#comment-15485513 ] Anu Engineer commented on HDFS-10821: - +1, LGTM. [~linyiqun] Thanks for updating the p

[jira] [Comment Edited] (HDFS-10843) Quota Feature Cached Size != Computed Size When Block Committed But Not Completed

2016-09-12 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485496#comment-15485496 ] Erik Krogen edited comment on HDFS-10843 at 9/12/16 10:35 PM: --

[jira] [Comment Edited] (HDFS-10843) Quota Feature Cached Size != Computed Size When Block Committed But Not Completed

2016-09-12 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485496#comment-15485496 ] Erik Krogen edited comment on HDFS-10843 at 9/12/16 10:34 PM: --

[jira] [Updated] (HDFS-10843) Quota Feature Cached Size != Computed Size When Block Committed But Not Completed

2016-09-12 Thread Erik Krogen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-10843: --- Attachment: HDFS-10843.002.patch v3 patch incorporates your suggestions, [~shv]. Tests now only start

[jira] [Commented] (HDFS-10599) DiskBalancer: Execute CLI via Shell

2016-09-12 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485492#comment-15485492 ] Manoj Govindassamy commented on HDFS-10599: --- Thanks for the review [~anu]. > Di

[jira] [Updated] (HDFS-8818) Allow Balancer to run faster

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8818: Resolution: Fixed Status: Resolved (was: Patch Available) Committed to branch-2.7. Pre-existing flak

[jira] [Updated] (HDFS-8818) Allow Balancer to run faster

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8818: Fix Version/s: 2.7.4 > Allow Balancer to run faster > > > Key: H

[jira] [Commented] (HDFS-10859) TestBalancer#testUnknownDatanodeSimple fails in branch-2.7

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485459#comment-15485459 ] Zhe Zhang commented on HDFS-10859: -- Actually {{testBalancerWithKeytabs}} seems flaky too.

[jira] [Commented] (HDFS-10599) DiskBalancer: Execute CLI via Shell

2016-09-12 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485430#comment-15485430 ] Anu Engineer commented on HDFS-10599: - +1, LGTM. I will commit this tomorrow to make s

[jira] [Commented] (HDFS-10859) TestBalancer#testUnknownDatanodeSimple fails in branch-2.7

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485425#comment-15485425 ] Zhe Zhang commented on HDFS-10859: -- I think that one is flaky. See the last 2 Jenkins rep

[jira] [Updated] (HDFS-10859) TestBalancer#testUnknownDatanodeSimple fails in branch-2.7

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-10859: - Affects Version/s: (was: 2.7) 2.7.4 > TestBalancer#testUnknownDatanodeSimple fa

[jira] [Commented] (HDFS-10858) FBR processing may generate incorrect reportedBlock-blockGroup mapping

2016-09-12 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485405#comment-15485405 ] Andrew Wang commented on HDFS-10858: +1 LGTM, nice find Jing! > FBR processing may ge

[jira] [Commented] (HDFS-8818) Allow Balancer to run faster

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485387#comment-15485387 ] Hadoop QA commented on HDFS-8818: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-8818) Allow Balancer to run faster

2016-09-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485402#comment-15485402 ] Hadoop QA commented on HDFS-8818: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Comment Edited] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-12 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485348#comment-15485348 ] Xiaobing Zhou edited comment on HDFS-10824 at 9/12/16 9:35 PM: -

[jira] [Updated] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-12 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10824: - Status: Patch Available (was: Open) > MiniDFSCluster#storageCapacities has no effects on real cap

[jira] [Updated] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-09-12 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-10824: - Attachment: HDFS-10824.000.patch v000 is posted for review. > MiniDFSCluster#storageCapacities ha

[jira] [Commented] (HDFS-8898) Create API and command-line argument to get quota and quota usage without detailed content summary

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485346#comment-15485346 ] Zhe Zhang commented on HDFS-8898: - Quick note that I'm working on backporting HDFS-10744 to

[jira] [Updated] (HDFS-10858) FBR processing may generate incorrect reportedBlock-blockGroup mapping

2016-09-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-10858: - Status: Patch Available (was: Open) > FBR processing may generate incorrect reportedBlock-blockGroup mapp

[jira] [Updated] (HDFS-10858) FBR processing may generate incorrect reportedBlock-blockGroup mapping

2016-09-12 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-10858: - Attachment: HDFS-10858.000.patch > FBR processing may generate incorrect reportedBlock-blockGroup mapping

[jira] [Commented] (HDFS-8335) FSNamesystem should construct FSPermissionChecker only if permission is enabled

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485331#comment-15485331 ] Zhe Zhang commented on HDFS-8335: - Quick note that I'm working on backporting HDFS-10744 to

[jira] [Commented] (HDFS-10859) TestBalancer#testUnknownDatanodeSimple fails in branch-2.7

2016-09-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485307#comment-15485307 ] Xiao Chen commented on HDFS-10859: -- Ah I see, testUnknownDatanodeSimple passed locally fo

[jira] [Commented] (HDFS-10859) TestBalancer#testUnknownDatanodeSimple fails in branch-2.7

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485306#comment-15485306 ] Zhe Zhang commented on HDFS-10859: -- {{testBalancerWithKeytabs}} fails with {{java.lang.No

[jira] [Commented] (HDFS-8815) DFS getStoragePolicy implementation using single RPC call

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485302#comment-15485302 ] Zhe Zhang commented on HDFS-8815: - Quick note that I'm working on backporting HDFS-10744 to

[jira] [Commented] (HDFS-10859) TestBalancer#testUnknownDatanodeSimple fails in branch-2.7

2016-09-12 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485303#comment-15485303 ] Xiao Chen commented on HDFS-10859: -- Sorry... what other failure? > TestBalancer#testUnkn

[jira] [Commented] (HDFS-8983) NameNode support for protected directories

2016-09-12 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15485300#comment-15485300 ] Zhe Zhang commented on HDFS-8983: - Quick note that I'm working on backporting HDFS-10744 to

  1   2   >