[jira] [Commented] (HDFS-12387) Ozone: Support Ratis as a first class replication mechanism

2017-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154842#comment-16154842 ] Hadoop QA commented on HDFS-12387: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12389) Ozone: oz commandline list calls should return valid JSON format output

2017-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154841#comment-16154841 ] Hadoop QA commented on HDFS-12389: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12392) Writing striped file failed due to different cell size

2017-09-05 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-12392: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-beta1 Status:

[jira] [Commented] (HDFS-12395) Support add, remove, disable and enable erasure coding policy operations in edit log

2017-09-05 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154830#comment-16154830 ] Rakesh R commented on HDFS-12395: - Thanks [~Sammi] for the patch. Adding few comments on the patch: #

[jira] [Updated] (HDFS-12392) Writing striped file failed due to different cell size

2017-09-05 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-12392: - Summary: Writing striped file failed due to different cell size (was: Write striped file failure) >

[jira] [Commented] (HDFS-12392) Write striped file failure

2017-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154814#comment-16154814 ] Hadoop QA commented on HDFS-12392: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12235) Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions

2017-09-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12235: --- Attachment: HDFS-12235-HDFS-7240.008.patch > Ozone: DeleteKey-3: KSM SCM block deletion message and

[jira] [Commented] (HDFS-12235) Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions

2017-09-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154787#comment-16154787 ] Weiwei Yang commented on HDFS-12235: Hi [~nandakumar131] Thanks for helping to review this patch.

[jira] [Commented] (HDFS-12389) Ozone: oz commandline list calls should return valid JSON format output

2017-09-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154771#comment-16154771 ] Weiwei Yang commented on HDFS-12389: Attach the same patch again to trigger the jenkins report... >

[jira] [Updated] (HDFS-12389) Ozone: oz commandline list calls should return valid JSON format output

2017-09-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12389: --- Attachment: HDFS-12389-HDFS-7240.002.patch > Ozone: oz commandline list calls should return valid

[jira] [Updated] (HDFS-12387) Ozone: Support Ratis as a first class replication mechanism

2017-09-05 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12387: Attachment: HDFS-12387-HDFS-7240.001.patch > Ozone: Support Ratis as a first class replication

[jira] [Updated] (HDFS-12387) Ozone: Support Ratis as a first class replication mechanism

2017-09-05 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12387: Status: Patch Available (was: Open) > Ozone: Support Ratis as a first class replication mechanism

[jira] [Commented] (HDFS-12357) Let NameNode to bypass external attribute provider for special user

2017-09-05 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154736#comment-16154736 ] Yongjun Zhang commented on HDFS-12357: -- Thanks for the review [~manojg], good catches. I uploaded

[jira] [Updated] (HDFS-12357) Let NameNode to bypass external attribute provider for special user

2017-09-05 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12357: - Attachment: HDFS-12357.006.patch > Let NameNode to bypass external attribute provider for special

[jira] [Commented] (HDFS-12218) Rename split EC / replicated block metrics in BlockManager

2017-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154734#comment-16154734 ] Hadoop QA commented on HDFS-12218: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12392) Write striped file failure

2017-09-05 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12392: - Attachment: HDFS-12392.003.patch 1. Fix style issues 2. Check failed unit tests, not relevant > Write

[jira] [Comment Edited] (HDFS-11467) Support ErasureCodingPolicyManager section in OIV XML/ReverseXML and OEV tools

2017-09-05 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154705#comment-16154705 ] SammiChen edited comment on HDFS-11467 at 9/6/17 2:26 AM: -- Assign to Wei per

[jira] [Commented] (HDFS-12392) Write striped file failure

2017-09-05 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154721#comment-16154721 ] Kai Zheng commented on HDFS-12392: -- The latest fix looks good. +1 on the check styles. > Write striped

[jira] [Commented] (HDFS-12384) Fixing compilation issue with BanDuplicateClasses

2017-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154710#comment-16154710 ] Hadoop QA commented on HDFS-12384: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (HDFS-11467) Support ErasureCodingPolicyManager section in OIV XML/ReverseXML and OEV tools

2017-09-05 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen reassigned HDFS-11467: Assignee: Wei Zhou (was: SammiChen) > Support ErasureCodingPolicyManager section in OIV

[jira] [Commented] (HDFS-11467) Support ErasureCodingPolicyManager section in OIV XML/ReverseXML and OEV tools

2017-09-05 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154705#comment-16154705 ] SammiChen commented on HDFS-11467: -- Assign to Wei per Kai's suggestion. > Support

[jira] [Commented] (HDFS-12353) Modify Dfsuse percent of dfsadmin report inconsistent with Dfsuse percent of datanode reports.

2017-09-05 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154703#comment-16154703 ] steven-wugang commented on HDFS-12353: -- [~drankye] Hello,Excuse me,can you help me review this

[jira] [Commented] (HDFS-12369) Edit log corruption due to hard lease recovery of not-closed file

2017-09-05 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154668#comment-16154668 ] Yongjun Zhang commented on HDFS-12369: -- Hi [~xiaochen], Thanks for working on this issue. The change

[jira] [Updated] (HDFS-12221) Replace xerces in XmlEditsVisitor

2017-09-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12221: --- Summary: Replace xerces in XmlEditsVisitor (was: Replace xcerces in XmlEditsVisitor ) > Replace

[jira] [Updated] (HDFS-12218) Rename split EC / replicated block metrics in BlockManager

2017-09-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12218: --- Attachment: HDFS-12218.consolidated.003.patch Thanks for the review Eddy, new consolidated patch

[jira] [Commented] (HDFS-12222) Add EC information to BlockLocation

2017-09-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154624#comment-16154624 ] Andrew Wang commented on HDFS-1: Hi Huafeng, thanks for working on this! A few review comments: *

[jira] [Commented] (HDFS-12357) Let NameNode to bypass external attribute provider for special user

2017-09-05 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154605#comment-16154605 ] Manoj Govindassamy commented on HDFS-12357: --- Thanks for working on this [~yzhangal]. Thanks

[jira] [Commented] (HDFS-12218) Rename split EC / replicated block metrics in BlockManager

2017-09-05 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154574#comment-16154574 ] Lei (Eddy) Xu commented on HDFS-12218: -- Thanks [~andrew.wang] for the fix One small nit: {code}

[jira] [Updated] (HDFS-12384) Fixing compilation issue with BanDuplicateClasses

2017-09-05 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12384: --- Attachment: HDFS-12384-HDFS-10467-003.patch > Fixing compilation issue with BanDuplicateClasses >

[jira] [Updated] (HDFS-12377) Refactor TestReadStripedFileWithDecoding to avoid test timeouts

2017-09-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12377: --- Resolution: Fixed Fix Version/s: 3.0.0-beta1 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-12000) Ozone: Container : Add key versioning support-1

2017-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154564#comment-16154564 ] Hadoop QA commented on HDFS-12000: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12384) Fixing compilation issue with BanDuplicateClasses

2017-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154538#comment-16154538 ] Hadoop QA commented on HDFS-12384: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11821) BlockManager.getMissingReplOneBlocksCount() does not report correct value if corrupt file with replication factor of 1 gets deleted

2017-09-05 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154536#comment-16154536 ] Ravi Prakash commented on HDFS-11821: - My concern with your patch is that remove will now be a bit

[jira] [Commented] (HDFS-12377) Refactor TestReadStripedFileWithDecoding to avoid test timeouts

2017-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154521#comment-16154521 ] Hadoop QA commented on HDFS-12377: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12357) Let NameNode to bypass external attribute provider for special user

2017-09-05 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154520#comment-16154520 ] Yongjun Zhang commented on HDFS-12357: -- Many thanks [~chris.douglas] for the offline discussions!

[jira] [Comment Edited] (HDFS-11821) BlockManager.getMissingReplOneBlocksCount() does not report correct value if corrupt file with replication factor of 1 gets deleted

2017-09-05 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154282#comment-16154282 ] Ravi Prakash edited comment on HDFS-11821 at 9/5/17 10:38 PM: -- Thank you for

[jira] [Commented] (HDFS-10702) Add a Client API and Proxy Provider to enable stale read from Standby

2017-09-05 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154494#comment-16154494 ] Chao Sun commented on HDFS-10702: - Thanks [~clouderajiayi] and [~mackrorysd] for this great work! we are

[jira] [Commented] (HDFS-11882) Precisely calculate acked length of striped block groups in updatePipeline

2017-09-05 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154481#comment-16154481 ] Akira Ajisaka commented on HDFS-11882: -- Thank you, [~andrew.wang] and [~drankye]! > Precisely

[jira] [Commented] (HDFS-12359) Re-encryption should operate with minimum KMS ACL requirements.

2017-09-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154445#comment-16154445 ] Xiao Chen commented on HDFS-12359: -- Aha, good catch. Thanks [~andrew.wang]! > Re-encryption should

[jira] [Updated] (HDFS-12182) BlockManager.metaSave does not distinguish between "under replicated" and "missing" blocks

2017-09-05 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12182: --- Resolution: Fixed Fix Version/s: 2.9.0 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-12388) A bad error message in DFSStripedOutputStream

2017-09-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12388: --- Component/s: erasure-coding > A bad error message in DFSStripedOutputStream >

[jira] [Commented] (HDFS-12218) Rename split EC / replicated block metrics in BlockManager

2017-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154427#comment-16154427 ] Hadoop QA commented on HDFS-12218: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-12392) Write striped file failure

2017-09-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12392: --- Target Version/s: 3.0.0-beta1 > Write striped file failure > -- > >

[jira] [Updated] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7859: -- Target Version/s: 3.0.0-beta1 > Erasure Coding: Persist erasure coding policies in NameNode >

[jira] [Updated] (HDFS-12218) Rename split EC / replicated block metrics in BlockManager

2017-09-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12218: --- Status: Patch Available (was: Open) > Rename split EC / replicated block metrics in BlockManager >

[jira] [Commented] (HDFS-12357) Let NameNode to bypass external attribute provider for special user

2017-09-05 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154337#comment-16154337 ] Chris Douglas commented on HDFS-12357: -- Had offline discussions with [~yzhangal]. We tried a version

[jira] [Commented] (HDFS-12359) Re-encryption should operate with minimum KMS ACL requirements.

2017-09-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154329#comment-16154329 ] Andrew Wang commented on HDFS-12359: Cherry-picked this back to branch-3.0 for beta1 as well, thanks

[jira] [Commented] (HDFS-12383) Re-encryption updater should handle canceled tasks better

2017-09-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154328#comment-16154328 ] Andrew Wang commented on HDFS-12383: Cherry-picked this back to branch-3.0 for beta1 as well, thanks

[jira] [Commented] (HDFS-12388) A bad error message in DFSStripedOutputStream

2017-09-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154326#comment-16154326 ] Andrew Wang commented on HDFS-12388: Cherry-picked this one back to branch-3.0 as well for beta1. > A

[jira] [Updated] (HDFS-11882) Precisely calculate acked length of striped block groups in updatePipeline

2017-09-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11882: --- Resolution: Fixed Fix Version/s: 3.0.0-beta1 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-11882) Precisely calculate acked length of striped block groups in updatePipeline

2017-09-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11882: --- Summary: Precisely calculate acked length of striped block groups in updatePipeline (was: Client

[jira] [Commented] (HDFS-11882) Client fails if acknowledged size is greater than bytes sent

2017-09-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154320#comment-16154320 ] Andrew Wang commented on HDFS-11882: Thanks for reviewing Kai! I gave the failed tests a look too and

[jira] [Updated] (HDFS-12218) Rename split EC / replicated block metrics in BlockManager

2017-09-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12218: --- Priority: Blocker (was: Major) > Rename split EC / replicated block metrics in BlockManager >

[jira] [Updated] (HDFS-12377) Refactor TestReadStripedFileWithDecoding to avoid test timeouts

2017-09-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12377: --- Attachment: HDFS-12377.004.patch Thanks again for reviewing Xiao, new patch to cleanup the timeout

[jira] [Commented] (HDFS-12182) BlockManager.metaSave does not distinguish between "under replicated" and "missing" blocks

2017-09-05 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154289#comment-16154289 ] Wei-Chiu Chuang commented on HDFS-12182: Thanks for the work [~wchevreuil] +1. Will commit

[jira] [Updated] (HDFS-12000) Ozone: Container : Add key versioning support-1

2017-09-05 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12000: -- Attachment: HDFS-12000-HDFS-7240.004.patch Thanks [~xyao] for the comments! Addressed all your comments

[jira] [Commented] (HDFS-11821) BlockManager.getMissingReplOneBlocksCount() does not report correct value if corrupt file with replication factor of 1 gets deleted

2017-09-05 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154282#comment-16154282 ] Ravi Prakash commented on HDFS-11821: - Thank you for the report Wellington! I'm sorry you didn't get

[jira] [Updated] (HDFS-11467) Support ErasureCodingPolicyManager section in OIV XML/ReverseXML and OEV tools

2017-09-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11467: --- Target Version/s: 3.0.0 (was: 3.0.0-beta1) SGTM thanks Sammi, let's retarget for GA then. > Support

[jira] [Updated] (HDFS-12397) Ozone: KSM: multiple delete methods in KSMMetadataManager

2017-09-05 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12397: -- Labels: (was: newbie) > Ozone: KSM: multiple delete methods in KSMMetadataManager >

[jira] [Updated] (HDFS-12397) Ozone: KSM: multiple delete methods in KSMMetadataManager

2017-09-05 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12397: -- Labels: newbie (was: ) > Ozone: KSM: multiple delete methods in KSMMetadataManager >

[jira] [Updated] (HDFS-12397) Ozone: KSM: multiple delete methods in KSMMetadataManager

2017-09-05 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12397: -- Summary: Ozone: KSM: multiple delete methods in KSMMetadataManager (was: Ozone: KSM: multiple delete

[jira] [Created] (HDFS-12397) Ozone: KSM: multiple delete methods KSMMetadataManager

2017-09-05 Thread Nandakumar (JIRA)
Nandakumar created HDFS-12397: - Summary: Ozone: KSM: multiple delete methods KSMMetadataManager Key: HDFS-12397 URL: https://issues.apache.org/jira/browse/HDFS-12397 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-12235) Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions

2017-09-05 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154259#comment-16154259 ] Nandakumar commented on HDFS-12235: --- Thanks [~yuanbo] & [~cheersyang] for working on this.

[jira] [Updated] (HDFS-12384) Fixing compilation issue with BanDuplicateClasses

2017-09-05 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12384: --- Attachment: HDFS-12384-HDFS-10467-002.patch Rebasing HDFS-10467 seemed to fix the latest one. >

[jira] [Updated] (HDFS-12391) Ozone: TestKSMSQLCli is not working as expected

2017-09-05 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12391: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Ozone: TestKSMSQLCli is not

[jira] [Commented] (HDFS-12391) Ozone: TestKSMSQLCli is not working as expected

2017-09-05 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154088#comment-16154088 ] Chen Liang commented on HDFS-12391: --- Thanks [~cheersyang] for the catch! +1 on the v001 patch. The

[jira] [Commented] (HDFS-12386) Add fsserver defaults call to WebhdfsFileSystem.

2017-09-05 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16154025#comment-16154025 ] Kihwal Lee commented on HDFS-12386: --- What happens when a new WebHdfsFileSystem instance tries to talk to

[jira] [Updated] (HDFS-12386) Add fsserver defaults call to WebhdfsFileSystem.

2017-09-05 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-12386: -- Status: Open (was: Patch Available) > Add fsserver defaults call to WebhdfsFileSystem. >

[jira] [Updated] (HDFS-12359) Re-encryption should operate with minimum KMS ACL requirements.

2017-09-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12359: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-beta1 Status:

[jira] [Commented] (HDFS-12359) Re-encryption should operate with minimum KMS ACL requirements.

2017-09-05 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153896#comment-16153896 ] Wei-Chiu Chuang commented on HDFS-12359: +1 > Re-encryption should operate with minimum KMS ACL

[jira] [Created] (HDFS-12396) Webhdfs file system should get delegation token from kms provider.

2017-09-05 Thread Rushabh S Shah (JIRA)
Rushabh S Shah created HDFS-12396: - Summary: Webhdfs file system should get delegation token from kms provider. Key: HDFS-12396 URL: https://issues.apache.org/jira/browse/HDFS-12396 Project: Hadoop

[jira] [Commented] (HDFS-12393) Fix incorrect package length for doRead in PacketReceiver

2017-09-05 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153848#comment-16153848 ] Rushabh S Shah commented on HDFS-12393: --- [~legend] For making such low level change, I would suggest

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153756#comment-16153756 ] Hadoop QA commented on HDFS-7859: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12390) Support to refresh DNS to switch mapping

2017-09-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153735#comment-16153735 ] Allen Wittenauer commented on HDFS-12390: - The usual fix to this is to rewrite the script to Java

[jira] [Commented] (HDFS-12100) Ozone: KSM: Allocate key should honour volume quota if quota is set on the volume

2017-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153694#comment-16153694 ] Hadoop QA commented on HDFS-12100: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2017-09-05 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153666#comment-16153666 ] Surendra Singh Lilhore commented on HDFS-12291: --- Thanks [~xiaochen], [~umamaheswararao],

[jira] [Commented] (HDFS-12392) Write striped file failure

2017-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153567#comment-16153567 ] Hadoop QA commented on HDFS-12392: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-12393) Fix incorrect package length for doRead in PacketReceiver

2017-09-05 Thread legend (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153549#comment-16153549 ] legend edited comment on HDFS-12393 at 9/5/17 12:26 PM: Thanks [~drankye] for

[jira] [Commented] (HDFS-12395) Support add, remove, disable and enable erasure coding policy operations in edit log

2017-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153557#comment-16153557 ] Hadoop QA commented on HDFS-12395: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (HDFS-12393) Fix incorrect package length for doRead in PacketReceiver

2017-09-05 Thread legend (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153549#comment-16153549 ] legend edited comment on HDFS-12393 at 9/5/17 12:20 PM: Thanks [~drankye] for

[jira] [Commented] (HDFS-12393) Fix incorrect package length for doRead in PacketReceiver

2017-09-05 Thread legend (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153549#comment-16153549 ] legend commented on HDFS-12393: --- Thanks [~drankye] for review. That's right, the allocated packet buffer

[jira] [Updated] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-05 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-7859: Attachment: HDFS-7859.013.patch > Erasure Coding: Persist erasure coding policies in NameNode >

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-05 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153497#comment-16153497 ] Kai Zheng commented on HDFS-7859: - bq. I would prefer to keep the unit test. More test, better quality. I

[jira] [Commented] (HDFS-12393) Fix incorrect package length for doRead in PacketReceiver

2017-09-05 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153491#comment-16153491 ] Kai Zheng commented on HDFS-12393: -- Thanks [~legend] for the ping. Why {{Shorts.BYTES}} would make it

[jira] [Updated] (HDFS-12100) Ozone: KSM: Allocate key should honour volume quota if quota is set on the volume

2017-09-05 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-12100: --- Attachment: HDFS-12100-HDFS-7240.003.patch [~msingh] Thanks for the review. I have fixed the issues

[jira] [Commented] (HDFS-11821) BlockManager.getMissingReplOneBlocksCount() does not report correct value if corrupt file with replication factor of 1 gets deleted

2017-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153459#comment-16153459 ] Hadoop QA commented on HDFS-11821: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-05 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153453#comment-16153453 ] SammiChen commented on HDFS-7859: - Thanks [~drankye] for quick review! bq. 1. Did you notice some failure

[jira] [Updated] (HDFS-12392) Write striped file failure

2017-09-05 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12392: - Attachment: HDFS-12392.002.patch [~drankye] thanks for the quick review! A new patch uploaded. > Write

[jira] [Updated] (HDFS-12395) Support add, remove, disable and enable erasure coding policy operations in edit log

2017-09-05 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12395: - Status: Patch Available (was: Open) > Support add, remove, disable and enable erasure coding policy

[jira] [Updated] (HDFS-12395) Support add, remove, disable and enable erasure coding policy operations in edit log

2017-09-05 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12395: - Attachment: HDFS-12395.001.patch Initial patch > Support add, remove, disable and enable erasure coding

[jira] [Assigned] (HDFS-12393) Fix incorrect package length for doRead in PacketReceiver

2017-09-05 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng reassigned HDFS-12393: Assignee: legend > Fix incorrect package length for doRead in PacketReceiver >

[jira] [Updated] (HDFS-12388) A bad error message in DFSStripedOutputStream

2017-09-05 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-12388: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-beta1 Status:

[jira] [Commented] (HDFS-12392) Write striped file failure

2017-09-05 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153386#comment-16153386 ] Kai Zheng commented on HDFS-12392: -- Thanks [~Sammi] for catching this!! You figured out the root cause.

[jira] [Assigned] (HDFS-12394) Erasure coding policy cell size should not be greater than file block size

2017-09-05 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen reassigned HDFS-12394: Assignee: Wei Zhou > Erasure coding policy cell size should not be greater than file block size >

[jira] [Updated] (HDFS-12395) Support add, remove, disable and enable erasure coding policy operations in edit log

2017-09-05 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12395: - Summary: Support add, remove, disable and enable erasure coding policy operations in edit log (was:

[jira] [Created] (HDFS-12395) Support add, remove, disable, enable erasure coding policy operation in edit log

2017-09-05 Thread SammiChen (JIRA)
SammiChen created HDFS-12395: Summary: Support add, remove, disable, enable erasure coding policy operation in edit log Key: HDFS-12395 URL: https://issues.apache.org/jira/browse/HDFS-12395 Project:

[jira] [Commented] (HDFS-12392) Write striped file failure

2017-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153297#comment-16153297 ] Hadoop QA commented on HDFS-12392: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-11821) BlockManager.getMissingReplOneBlocksCount() does not report correct value if corrupt file with replication factor of 1 gets deleted

2017-09-05 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153288#comment-16153288 ] Wellington Chevreuil commented on HDFS-11821: - Any feedbacks? >

[jira] [Commented] (HDFS-12390) Support to refresh DNS to switch mapping

2017-09-05 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153273#comment-16153273 ] Jiandan Yang commented on HDFS-12390: -- [~djp] please review it and give me some comment. > Support

[jira] [Commented] (HDFS-12348) disable removing blocks to trash while rolling upgrade

2017-09-05 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153267#comment-16153267 ] Jiandan Yang commented on HDFS-12348: -- [~kihwal] How about adding dfs.datanode.trash.enable to

  1   2   >