[jira] [Commented] (HDFS-11487) Ozone: Exclude container protobuf files from findbugs check

2017-03-02 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15892858#comment-15892858 ] Anu Engineer commented on HDFS-11487: - Very similar to the fix in https://issues.apach

[jira] [Commented] (HDFS-11476) Fix NPE in FsDatasetImpl#checkAndUpdate

2017-03-02 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15892853#comment-15892853 ] Xiaobing Zhou commented on HDFS-11476: -- Posted v1 to fix it. Thanks for reviews. [~ar

[jira] [Updated] (HDFS-11476) Fix NPE in FsDatasetImpl#checkAndUpdate

2017-03-02 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-11476: - Attachment: HDFS-11476.001.patch > Fix NPE in FsDatasetImpl#checkAndUpdate > -

[jira] [Commented] (HDFS-11451) Ozone: Add protobuf definitions for container reports

2017-03-02 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15892851#comment-15892851 ] Anu Engineer commented on HDFS-11451: - This patch is invalid now, I will post a new pa

[jira] [Updated] (HDFS-11451) Ozone: Add protobuf definitions for container reports

2017-03-02 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11451: Status: Open (was: Patch Available) > Ozone: Add protobuf definitions for container reports > -

[jira] [Commented] (HDFS-11484) Ozone: Fix flaky TestNodeManager#testScmNodeReportUpdate

2017-03-02 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15892848#comment-15892848 ] Anu Engineer commented on HDFS-11484: - Seems like a docker error, I have requested a j

[jira] [Updated] (HDFS-11480) Ozone: TestEndpoint task failure

2017-03-02 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11480: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) [~

[jira] [Commented] (HDFS-11412) Maintenance minimum replication config value allowable range should be [0, DefaultReplication]

2017-03-02 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15892809#comment-15892809 ] Manoj Govindassamy commented on HDFS-11412: --- Thanks for the quick review and com

[jira] [Commented] (HDFS-11480) Ozone: TestEndpoint task failure

2017-03-02 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15892807#comment-15892807 ] Anu Engineer commented on HDFS-11480: - +1, Thanks for fixing this issue [~xyao]. I wi

[jira] [Updated] (HDFS-11412) Maintenance minimum replication config value allowable range should be [0, DefaultReplication]

2017-03-02 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-11412: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3 2.9.0

[jira] [Updated] (HDFS-11425) Ozone : add client-facing container APIs and container references

2017-03-02 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-11425: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Target Ver

[jira] [Updated] (HDFS-8112) Relax permission checking for EC related operations

2017-03-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-8112: -- Summary: Relax permission checking for EC related operations (was: Enforce authorization policy

[jira] [Updated] (HDFS-11417) Add datanode admin command to get the storage info.

2017-03-02 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-11417: -- Attachment: HDFS-11417.004.patch Fixed checkstyle issue.. Attached v4 patch. >

[jira] [Commented] (HDFS-8112) Enforce authorization policy to protect administration operations for EC zone and schemas

2017-03-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15892764#comment-15892764 ] Wei-Chiu Chuang commented on HDFS-8112: --- Hello [~rakeshr] are you still working on th

[jira] [Updated] (HDFS-11486) Client close() should not fail fast if the last block is being decommissioned

2017-03-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11486: --- Description: If a DFS client closes a file while the last block is being decommissioned, the

[jira] [Commented] (HDFS-11464) Improve the selection in choosing storage for blocks

2017-03-02 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15892742#comment-15892742 ] Arpit Agarwal commented on HDFS-11464: -- Hi [~linyiqun], the storage chosen by the Nam

[jira] [Commented] (HDFS-11425) Ozone : add client-facing container APIs and container references

2017-03-02 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15892729#comment-15892729 ] Anu Engineer commented on HDFS-11425: - I am going to commit this, the findbugs issue i

[jira] [Created] (HDFS-11487) Ozone: Exclude container protobuf files from findbugs check

2017-03-02 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-11487: --- Summary: Ozone: Exclude container protobuf files from findbugs check Key: HDFS-11487 URL: https://issues.apache.org/jira/browse/HDFS-11487 Project: Hadoop HDFS

[jira] [Comment Edited] (HDFS-11486) Client close() should not fail fast if the last block is being decommissioned

2017-03-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15892722#comment-15892722 ] Wei-Chiu Chuang edited comment on HDFS-11486 at 3/2/17 6:27 PM:

[jira] [Commented] (HDFS-11486) Client close() should not fail fast if the last block is being decommissioned

2017-03-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15892722#comment-15892722 ] Wei-Chiu Chuang commented on HDFS-11486: There are several fixes to this problem.

[jira] [Updated] (HDFS-11486) Client close() should not fail fast if the last block is being decommissioned

2017-03-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-11486: --- Attachment: HDF-11486.test.patch Attach a test that demonstrates this issue. This test starts

[jira] [Assigned] (HDFS-10928) Ozone:SCM: Support MXBean for SCM and NodeManager

2017-03-02 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDFS-10928: --- Assignee: Weiwei Yang (was: Anu Engineer) > Ozone:SCM: Support MXBean for SCM and NodeManage

[jira] [Commented] (HDFS-10928) Ozone:SCM: Support MXBean for SCM and NodeManager

2017-03-02 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15892716#comment-15892716 ] Anu Engineer commented on HDFS-10928: - No I am not, Please feel free to work on it. Th

[jira] [Created] (HDFS-11486) Client close() should not fail fast if the last block is being decommissioned

2017-03-02 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-11486: -- Summary: Client close() should not fail fast if the last block is being decommissioned Key: HDFS-11486 URL: https://issues.apache.org/jira/browse/HDFS-11486 Proje

[jira] [Assigned] (HDFS-11137) Ozone: SCM: Add negative tests cases for datanodeStatemachine

2017-03-02 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer reassigned HDFS-11137: --- Assignee: Weiwei Yang (was: Anu Engineer) > Ozone: SCM: Add negative tests cases for datanod

[jira] [Commented] (HDFS-11137) Ozone: SCM: Add negative tests cases for datanodeStatemachine

2017-03-02 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15892703#comment-15892703 ] Anu Engineer commented on HDFS-11137: - [~cheersyang] No I am not, Thanks for volunteer

[jira] [Commented] (HDFS-11419) BlockPlacementPolicyDefault is choosing datanode in an inefficient way

2017-03-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15892687#comment-15892687 ] Hudson commented on HDFS-11419: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-8498) Blocks can be committed with wrong size

2017-03-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-8498: -- Attachment: HDFS-8498.branch-2.7.001.patch > Blocks can be committed with wrong size > --

[jira] [Updated] (HDFS-8498) Blocks can be committed with wrong size

2017-03-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-8498: -- Status: Patch Available (was: Reopened) > Blocks can be committed with wrong size >

[jira] [Updated] (HDFS-8498) Blocks can be committed with wrong size

2017-03-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-8498: -- Target Version/s: 2.9.0, 2.7.4, 3.0.0-alpha3 (was: 2.9.0, 3.0.0-alpha3) > Blocks can be committe

[jira] [Reopened] (HDFS-8498) Blocks can be committed with wrong size

2017-03-02 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reopened HDFS-8498: --- Sorry to reopen. Attach a branch-2.7 patch for precommit. > Blocks can be committed with wrong siz

[jira] [Updated] (HDFS-11450) HDFS specific network topology classes with storage type info included

2017-03-02 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11450: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3 Status:

[jira] [Updated] (HDFS-11419) BlockPlacementPolicyDefault is choosing datanode in an inefficient way

2017-03-02 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11419: - Target Version/s: 2.9.0 (was: 3.0.0-alpha3) > BlockPlacementPolicyDefault is choosing datanode in

[jira] [Commented] (HDFS-10928) Ozone:SCM: Support MXBean for SCM and NodeManager

2017-03-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15892349#comment-15892349 ] Weiwei Yang commented on HDFS-10928: Hello [~anu] Are you working on this one? This h

[jira] [Commented] (HDFS-11137) Ozone: SCM: Add negative tests cases for datanodeStatemachine

2017-03-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15892347#comment-15892347 ] Weiwei Yang commented on HDFS-11137: Hi [~anu] Are you working on this one? It looks

[jira] [Commented] (HDFS-11416) Refactor out system default erasure coding policy

2017-03-02 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15892284#comment-15892284 ] Rakesh R commented on HDFS-11416: - Thanks [~andrew.wang] for the patch. I've few minor com

[jira] [Commented] (HDFS-11464) Improve the selection in choosing storage for blocks

2017-03-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15892127#comment-15892127 ] Hadoop QA commented on HDFS-11464: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-11285) Dead DataNodes keep a long time in (Dead, DECOMMISSION_INPROGRESS), and never transition to (Dead, DECOMMISSIONED)

2017-03-02 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin updated HDFS-11285: -- Description: We have seen the use case of decommissioning DataNodes that are already dead or unresponsi

[jira] [Comment Edited] (HDFS-8409) HDFS client RPC call throws "java.lang.IllegalStateException"

2017-03-02 Thread Yongtao Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15892062#comment-15892062 ] Yongtao Yang edited comment on HDFS-8409 at 3/2/17 11:07 AM: - I

[jira] [Comment Edited] (HDFS-8409) HDFS client RPC call throws "java.lang.IllegalStateException"

2017-03-02 Thread Yongtao Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15892062#comment-15892062 ] Yongtao Yang edited comment on HDFS-8409 at 3/2/17 11:05 AM: - I

[jira] [Comment Edited] (HDFS-8409) HDFS client RPC call throws "java.lang.IllegalStateException"

2017-03-02 Thread Yongtao Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15892062#comment-15892062 ] Yongtao Yang edited comment on HDFS-8409 at 3/2/17 10:59 AM: - I

[jira] [Commented] (HDFS-8409) HDFS client RPC call throws "java.lang.IllegalStateException"

2017-03-02 Thread Yongtao Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15892062#comment-15892062 ] Yongtao Yang commented on HDFS-8409: I found a clue that may be useful to this problem.

[jira] [Comment Edited] (HDFS-7285) Erasure Coding Support inside HDFS

2017-03-02 Thread Marcell Feher (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15892054#comment-15892054 ] Marcell Feher edited comment on HDFS-7285 at 3/2/17 10:54 AM: --

[jira] [Commented] (HDFS-7285) Erasure Coding Support inside HDFS

2017-03-02 Thread Marcell Feher (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15892054#comment-15892054 ] Marcell Feher commented on HDFS-7285: - Thanks for the help guys, we'll proceed with cre

[jira] [Updated] (HDFS-11464) Improve the selection in choosing storage for blocks

2017-03-02 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11464: - Attachment: HDFS-11464.001.patch Initial patch attached. The patch is a minor change but should be a impro

[jira] [Updated] (HDFS-11464) Improve the selection in choosing storage for blocks

2017-03-02 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-11464: - Status: Patch Available (was: Open) > Improve the selection in choosing storage for blocks >

[jira] [Commented] (HDFS-11416) Refactor out system default erasure coding policy

2017-03-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15891919#comment-15891919 ] Hadoop QA commented on HDFS-11416: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11412) Maintenance minimum replication config value allowable range should be [0, DefaultReplication]

2017-03-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15891815#comment-15891815 ] Hadoop QA commented on HDFS-11412: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11421) Make WebHDFS' ACLs RegEx configurable

2017-03-02 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15891804#comment-15891804 ] Harsh J commented on HDFS-11421: [~xiaochen] - Thanks! I'm uncertain how to trigger just a

<    1   2