[jira] [Commented] (HDFS-12393) Fix incorrect package length for doRead in PacketReceiver

2017-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154902#comment-16154902 ] Hadoop QA commented on HDFS-12393: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12393) Fix incorrect package length for doRead in PacketReceiver

2017-09-05 Thread legend (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154889#comment-16154889 ] legend commented on HDFS-12393: --- Thanks [~shahrs87] for the review. I couldn't agree with yo

[jira] [Commented] (HDFS-1068) Reduce NameNode GC by reusing HdfsFileStatus objects in RPC handlers

2017-09-05 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154887#comment-16154887 ] Kai Zheng commented on HDFS-1068: - IIRC, there're some optimization work already for some c

[jira] [Commented] (HDFS-1068) Reduce NameNode GC by reusing HdfsFileStatus objects in RPC handlers

2017-09-05 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154877#comment-16154877 ] Kai Zheng commented on HDFS-1068: - Hi [~zhz], The idea to optimize {{getFileInfo}} sounds

[jira] [Comment Edited] (HDFS-7878) API - expose an unique file identifier

2017-09-05 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154865#comment-16154865 ] Chris Douglas edited comment on HDFS-7878 at 9/6/17 6:25 AM: - T

[jira] [Updated] (HDFS-12393) Fix incorrect package length for doRead in PacketReceiver

2017-09-05 Thread legend (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] legend updated HDFS-12393: -- Status: Patch Available (was: Open) > Fix incorrect package length for doRead in PacketReceiver > -

[jira] [Updated] (HDFS-12393) Fix incorrect package length for doRead in PacketReceiver

2017-09-05 Thread legend (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] legend updated HDFS-12393: -- Status: Open (was: Patch Available) > Fix incorrect package length for doRead in PacketReceiver > -

[jira] [Updated] (HDFS-12393) Fix incorrect package length for doRead in PacketReceiver

2017-09-05 Thread legend (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] legend updated HDFS-12393: -- Attachment: HDFS-12393.002.patch > Fix incorrect package length for doRead in PacketReceiver > -

[jira] [Updated] (HDFS-7878) API - expose an unique file identifier

2017-09-05 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HDFS-7878: Attachment: HDFS-7878.10.patch bq. L108: any limit on buffer size here? I'm just worrying about malic

[jira] [Commented] (HDFS-12387) Ozone: Support Ratis as a first class replication mechanism

2017-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154842#comment-16154842 ] Hadoop QA commented on HDFS-12387: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12389) Ozone: oz commandline list calls should return valid JSON format output

2017-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154841#comment-16154841 ] Hadoop QA commented on HDFS-12389: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12392) Writing striped file failed due to different cell size

2017-09-05 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-12392: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-beta1 Status: Resolved

[jira] [Commented] (HDFS-12395) Support add, remove, disable and enable erasure coding policy operations in edit log

2017-09-05 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154830#comment-16154830 ] Rakesh R commented on HDFS-12395: - Thanks [~Sammi] for the patch. Adding few comments on t

[jira] [Updated] (HDFS-12392) Writing striped file failed due to different cell size

2017-09-05 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-12392: - Summary: Writing striped file failed due to different cell size (was: Write striped file failure) > Writ

[jira] [Commented] (HDFS-12392) Write striped file failure

2017-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154814#comment-16154814 ] Hadoop QA commented on HDFS-12392: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12235) Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions

2017-09-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12235: --- Attachment: HDFS-12235-HDFS-7240.008.patch > Ozone: DeleteKey-3: KSM SCM block deletion message and AC

[jira] [Commented] (HDFS-12235) Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions

2017-09-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154787#comment-16154787 ] Weiwei Yang commented on HDFS-12235: Hi [~nandakumar131] Thanks for helping to review

[jira] [Commented] (HDFS-12389) Ozone: oz commandline list calls should return valid JSON format output

2017-09-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154771#comment-16154771 ] Weiwei Yang commented on HDFS-12389: Attach the same patch again to trigger the jenkin

[jira] [Updated] (HDFS-12389) Ozone: oz commandline list calls should return valid JSON format output

2017-09-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12389: --- Attachment: HDFS-12389-HDFS-7240.002.patch > Ozone: oz commandline list calls should return valid JSON

[jira] [Updated] (HDFS-12387) Ozone: Support Ratis as a first class replication mechanism

2017-09-05 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12387: Attachment: HDFS-12387-HDFS-7240.001.patch > Ozone: Support Ratis as a first class replication mecha

[jira] [Updated] (HDFS-12387) Ozone: Support Ratis as a first class replication mechanism

2017-09-05 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12387: Status: Patch Available (was: Open) > Ozone: Support Ratis as a first class replication mechanism >

[jira] [Commented] (HDFS-12357) Let NameNode to bypass external attribute provider for special user

2017-09-05 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154736#comment-16154736 ] Yongjun Zhang commented on HDFS-12357: -- Thanks for the review [~manojg], good catches

[jira] [Updated] (HDFS-12357) Let NameNode to bypass external attribute provider for special user

2017-09-05 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12357: - Attachment: HDFS-12357.006.patch > Let NameNode to bypass external attribute provider for special

[jira] [Commented] (HDFS-12218) Rename split EC / replicated block metrics in BlockManager

2017-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154734#comment-16154734 ] Hadoop QA commented on HDFS-12218: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12392) Write striped file failure

2017-09-05 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12392: - Attachment: HDFS-12392.003.patch 1. Fix style issues 2. Check failed unit tests, not relevant > Write str

[jira] [Comment Edited] (HDFS-11467) Support ErasureCodingPolicyManager section in OIV XML/ReverseXML and OEV tools

2017-09-05 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154705#comment-16154705 ] SammiChen edited comment on HDFS-11467 at 9/6/17 2:26 AM: -- Assign

[jira] [Commented] (HDFS-12392) Write striped file failure

2017-09-05 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154721#comment-16154721 ] Kai Zheng commented on HDFS-12392: -- The latest fix looks good. +1 on the check styles. >

[jira] [Commented] (HDFS-12384) Fixing compilation issue with BanDuplicateClasses

2017-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154710#comment-16154710 ] Hadoop QA commented on HDFS-12384: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Assigned] (HDFS-11467) Support ErasureCodingPolicyManager section in OIV XML/ReverseXML and OEV tools

2017-09-05 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen reassigned HDFS-11467: Assignee: Wei Zhou (was: SammiChen) > Support ErasureCodingPolicyManager section in OIV XML/Revers

[jira] [Commented] (HDFS-11467) Support ErasureCodingPolicyManager section in OIV XML/ReverseXML and OEV tools

2017-09-05 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154705#comment-16154705 ] SammiChen commented on HDFS-11467: -- Assign to Wei per Kai's suggestion. > Support Erasu

[jira] [Commented] (HDFS-12353) Modify Dfsuse percent of dfsadmin report inconsistent with Dfsuse percent of datanode reports.

2017-09-05 Thread steven-wugang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154703#comment-16154703 ] steven-wugang commented on HDFS-12353: -- [~drankye] Hello,Excuse me,can you help me re

[jira] [Commented] (HDFS-12369) Edit log corruption due to hard lease recovery of not-closed file

2017-09-05 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154668#comment-16154668 ] Yongjun Zhang commented on HDFS-12369: -- Hi [~xiaochen], Thanks for working on this i

[jira] [Updated] (HDFS-12221) Replace xerces in XmlEditsVisitor

2017-09-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12221: --- Summary: Replace xerces in XmlEditsVisitor (was: Replace xcerces in XmlEditsVisitor ) > Replace xer

[jira] [Updated] (HDFS-12218) Rename split EC / replicated block metrics in BlockManager

2017-09-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12218: --- Attachment: HDFS-12218.consolidated.003.patch Thanks for the review Eddy, new consolidated patch attac

[jira] [Commented] (HDFS-12222) Add EC information to BlockLocation

2017-09-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154624#comment-16154624 ] Andrew Wang commented on HDFS-1: Hi Huafeng, thanks for working on this! A few rev

[jira] [Commented] (HDFS-12357) Let NameNode to bypass external attribute provider for special user

2017-09-05 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154605#comment-16154605 ] Manoj Govindassamy commented on HDFS-12357: --- Thanks for working on this [~yzhang

[jira] [Commented] (HDFS-12218) Rename split EC / replicated block metrics in BlockManager

2017-09-05 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154574#comment-16154574 ] Lei (Eddy) Xu commented on HDFS-12218: -- Thanks [~andrew.wang] for the fix One small

[jira] [Updated] (HDFS-12384) Fixing compilation issue with BanDuplicateClasses

2017-09-05 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12384: --- Attachment: HDFS-12384-HDFS-10467-003.patch > Fixing compilation issue with BanDuplicateClasses >

[jira] [Updated] (HDFS-12377) Refactor TestReadStripedFileWithDecoding to avoid test timeouts

2017-09-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12377: --- Resolution: Fixed Fix Version/s: 3.0.0-beta1 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-12000) Ozone: Container : Add key versioning support-1

2017-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154564#comment-16154564 ] Hadoop QA commented on HDFS-12000: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12384) Fixing compilation issue with BanDuplicateClasses

2017-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154538#comment-16154538 ] Hadoop QA commented on HDFS-12384: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11821) BlockManager.getMissingReplOneBlocksCount() does not report correct value if corrupt file with replication factor of 1 gets deleted

2017-09-05 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154536#comment-16154536 ] Ravi Prakash commented on HDFS-11821: - My concern with your patch is that remove will

[jira] [Commented] (HDFS-12377) Refactor TestReadStripedFileWithDecoding to avoid test timeouts

2017-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154521#comment-16154521 ] Hadoop QA commented on HDFS-12377: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12357) Let NameNode to bypass external attribute provider for special user

2017-09-05 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154520#comment-16154520 ] Yongjun Zhang commented on HDFS-12357: -- Many thanks [~chris.douglas] for the offline

[jira] [Comment Edited] (HDFS-11821) BlockManager.getMissingReplOneBlocksCount() does not report correct value if corrupt file with replication factor of 1 gets deleted

2017-09-05 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154282#comment-16154282 ] Ravi Prakash edited comment on HDFS-11821 at 9/5/17 10:38 PM: --

[jira] [Commented] (HDFS-10702) Add a Client API and Proxy Provider to enable stale read from Standby

2017-09-05 Thread Chao Sun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154494#comment-16154494 ] Chao Sun commented on HDFS-10702: - Thanks [~clouderajiayi] and [~mackrorysd] for this grea

[jira] [Commented] (HDFS-11882) Precisely calculate acked length of striped block groups in updatePipeline

2017-09-05 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154481#comment-16154481 ] Akira Ajisaka commented on HDFS-11882: -- Thank you, [~andrew.wang] and [~drankye]! >

[jira] [Commented] (HDFS-12359) Re-encryption should operate with minimum KMS ACL requirements.

2017-09-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154445#comment-16154445 ] Xiao Chen commented on HDFS-12359: -- Aha, good catch. Thanks [~andrew.wang]! > Re-encrypt

[jira] [Updated] (HDFS-12182) BlockManager.metaSave does not distinguish between "under replicated" and "missing" blocks

2017-09-05 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12182: --- Resolution: Fixed Fix Version/s: 2.9.0 Status: Resolved (was: Patch Availabl

[jira] [Updated] (HDFS-12388) A bad error message in DFSStripedOutputStream

2017-09-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12388: --- Component/s: erasure-coding > A bad error message in DFSStripedOutputStream >

[jira] [Commented] (HDFS-12218) Rename split EC / replicated block metrics in BlockManager

2017-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154427#comment-16154427 ] Hadoop QA commented on HDFS-12218: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12392) Write striped file failure

2017-09-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12392: --- Target Version/s: 3.0.0-beta1 > Write striped file failure > -- > >

[jira] [Updated] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7859: -- Target Version/s: 3.0.0-beta1 > Erasure Coding: Persist erasure coding policies in NameNode > ---

[jira] [Updated] (HDFS-12218) Rename split EC / replicated block metrics in BlockManager

2017-09-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12218: --- Status: Patch Available (was: Open) > Rename split EC / replicated block metrics in BlockManager > --

[jira] [Commented] (HDFS-12357) Let NameNode to bypass external attribute provider for special user

2017-09-05 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154337#comment-16154337 ] Chris Douglas commented on HDFS-12357: -- Had offline discussions with [~yzhangal]. We

[jira] [Commented] (HDFS-12359) Re-encryption should operate with minimum KMS ACL requirements.

2017-09-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154329#comment-16154329 ] Andrew Wang commented on HDFS-12359: Cherry-picked this back to branch-3.0 for beta1 a

[jira] [Commented] (HDFS-12383) Re-encryption updater should handle canceled tasks better

2017-09-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154328#comment-16154328 ] Andrew Wang commented on HDFS-12383: Cherry-picked this back to branch-3.0 for beta1 a

[jira] [Commented] (HDFS-12388) A bad error message in DFSStripedOutputStream

2017-09-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154326#comment-16154326 ] Andrew Wang commented on HDFS-12388: Cherry-picked this one back to branch-3.0 as well

[jira] [Updated] (HDFS-11882) Precisely calculate acked length of striped block groups in updatePipeline

2017-09-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11882: --- Resolution: Fixed Fix Version/s: 3.0.0-beta1 Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-11882) Precisely calculate acked length of striped block groups in updatePipeline

2017-09-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11882: --- Summary: Precisely calculate acked length of striped block groups in updatePipeline (was: Client fail

[jira] [Commented] (HDFS-11882) Client fails if acknowledged size is greater than bytes sent

2017-09-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154320#comment-16154320 ] Andrew Wang commented on HDFS-11882: Thanks for reviewing Kai! I gave the failed tests

[jira] [Updated] (HDFS-12218) Rename split EC / replicated block metrics in BlockManager

2017-09-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12218: --- Priority: Blocker (was: Major) > Rename split EC / replicated block metrics in BlockManager > ---

[jira] [Updated] (HDFS-12377) Refactor TestReadStripedFileWithDecoding to avoid test timeouts

2017-09-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12377: --- Attachment: HDFS-12377.004.patch Thanks again for reviewing Xiao, new patch to cleanup the timeout set

[jira] [Commented] (HDFS-12182) BlockManager.metaSave does not distinguish between "under replicated" and "missing" blocks

2017-09-05 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154289#comment-16154289 ] Wei-Chiu Chuang commented on HDFS-12182: Thanks for the work [~wchevreuil] +1. Wil

[jira] [Updated] (HDFS-12000) Ozone: Container : Add key versioning support-1

2017-09-05 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12000: -- Attachment: HDFS-12000-HDFS-7240.004.patch Thanks [~xyao] for the comments! Addressed all your comments

[jira] [Commented] (HDFS-11821) BlockManager.getMissingReplOneBlocksCount() does not report correct value if corrupt file with replication factor of 1 gets deleted

2017-09-05 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154282#comment-16154282 ] Ravi Prakash commented on HDFS-11821: - Thank you for the report Wellington! I'm sorry

[jira] [Updated] (HDFS-11467) Support ErasureCodingPolicyManager section in OIV XML/ReverseXML and OEV tools

2017-09-05 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11467: --- Target Version/s: 3.0.0 (was: 3.0.0-beta1) SGTM thanks Sammi, let's retarget for GA then. > Support

[jira] [Updated] (HDFS-12397) Ozone: KSM: multiple delete methods in KSMMetadataManager

2017-09-05 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12397: -- Labels: (was: newbie) > Ozone: KSM: multiple delete methods in KSMMetadataManager > --

[jira] [Updated] (HDFS-12397) Ozone: KSM: multiple delete methods in KSMMetadataManager

2017-09-05 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12397: -- Labels: newbie (was: ) > Ozone: KSM: multiple delete methods in KSMMetadataManager > --

[jira] [Updated] (HDFS-12397) Ozone: KSM: multiple delete methods in KSMMetadataManager

2017-09-05 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12397: -- Summary: Ozone: KSM: multiple delete methods in KSMMetadataManager (was: Ozone: KSM: multiple delete me

[jira] [Created] (HDFS-12397) Ozone: KSM: multiple delete methods KSMMetadataManager

2017-09-05 Thread Nandakumar (JIRA)
Nandakumar created HDFS-12397: - Summary: Ozone: KSM: multiple delete methods KSMMetadataManager Key: HDFS-12397 URL: https://issues.apache.org/jira/browse/HDFS-12397 Project: Hadoop HDFS Issue Ty

[jira] [Commented] (HDFS-12235) Ozone: DeleteKey-3: KSM SCM block deletion message and ACK interactions

2017-09-05 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154259#comment-16154259 ] Nandakumar commented on HDFS-12235: --- Thanks [~yuanbo] & [~cheersyang] for working on thi

[jira] [Updated] (HDFS-12384) Fixing compilation issue with BanDuplicateClasses

2017-09-05 Thread JIRA
[ https://issues.apache.org/jira/browse/HDFS-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated HDFS-12384: --- Attachment: HDFS-12384-HDFS-10467-002.patch Rebasing HDFS-10467 seemed to fix the latest one. > Fixin

[jira] [Updated] (HDFS-12391) Ozone: TestKSMSQLCli is not working as expected

2017-09-05 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12391: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Ozone: TestKSMSQLCli is not working

[jira] [Commented] (HDFS-12391) Ozone: TestKSMSQLCli is not working as expected

2017-09-05 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154088#comment-16154088 ] Chen Liang commented on HDFS-12391: --- Thanks [~cheersyang] for the catch! +1 on the v001

[jira] [Commented] (HDFS-12386) Add fsserver defaults call to WebhdfsFileSystem.

2017-09-05 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16154025#comment-16154025 ] Kihwal Lee commented on HDFS-12386: --- What happens when a new WebHdfsFileSystem instance

[jira] [Updated] (HDFS-12386) Add fsserver defaults call to WebhdfsFileSystem.

2017-09-05 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated HDFS-12386: -- Status: Open (was: Patch Available) > Add fsserver defaults call to WebhdfsFileSystem. > --

[jira] [Updated] (HDFS-12359) Re-encryption should operate with minimum KMS ACL requirements.

2017-09-05 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-12359: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-beta1 Status: Resolved

[jira] [Commented] (HDFS-12359) Re-encryption should operate with minimum KMS ACL requirements.

2017-09-05 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153896#comment-16153896 ] Wei-Chiu Chuang commented on HDFS-12359: +1 > Re-encryption should operate with m

[jira] [Created] (HDFS-12396) Webhdfs file system should get delegation token from kms provider.

2017-09-05 Thread Rushabh S Shah (JIRA)
Rushabh S Shah created HDFS-12396: - Summary: Webhdfs file system should get delegation token from kms provider. Key: HDFS-12396 URL: https://issues.apache.org/jira/browse/HDFS-12396 Project: Hadoop HD

[jira] [Commented] (HDFS-12393) Fix incorrect package length for doRead in PacketReceiver

2017-09-05 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153848#comment-16153848 ] Rushabh S Shah commented on HDFS-12393: --- [~legend] For making such low level change,

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153756#comment-16153756 ] Hadoop QA commented on HDFS-7859: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-12390) Support to refresh DNS to switch mapping

2017-09-05 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153735#comment-16153735 ] Allen Wittenauer commented on HDFS-12390: - The usual fix to this is to rewrite the

[jira] [Commented] (HDFS-12100) Ozone: KSM: Allocate key should honour volume quota if quota is set on the volume

2017-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153694#comment-16153694 ] Hadoop QA commented on HDFS-12100: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2017-09-05 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153666#comment-16153666 ] Surendra Singh Lilhore commented on HDFS-12291: --- Thanks [~xiaochen], [~umama

[jira] [Commented] (HDFS-12392) Write striped file failure

2017-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153567#comment-16153567 ] Hadoop QA commented on HDFS-12392: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Comment Edited] (HDFS-12393) Fix incorrect package length for doRead in PacketReceiver

2017-09-05 Thread legend (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153549#comment-16153549 ] legend edited comment on HDFS-12393 at 9/5/17 12:26 PM: Thanks [~d

[jira] [Commented] (HDFS-12395) Support add, remove, disable and enable erasure coding policy operations in edit log

2017-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153557#comment-16153557 ] Hadoop QA commented on HDFS-12395: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Comment Edited] (HDFS-12393) Fix incorrect package length for doRead in PacketReceiver

2017-09-05 Thread legend (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153549#comment-16153549 ] legend edited comment on HDFS-12393 at 9/5/17 12:20 PM: Thanks [~d

[jira] [Commented] (HDFS-12393) Fix incorrect package length for doRead in PacketReceiver

2017-09-05 Thread legend (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153549#comment-16153549 ] legend commented on HDFS-12393: --- Thanks [~drankye] for review. That's right, the allocated

[jira] [Updated] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-05 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-7859: Attachment: HDFS-7859.013.patch > Erasure Coding: Persist erasure coding policies in NameNode > -

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-05 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153497#comment-16153497 ] Kai Zheng commented on HDFS-7859: - bq. I would prefer to keep the unit test. More test, bet

[jira] [Commented] (HDFS-12393) Fix incorrect package length for doRead in PacketReceiver

2017-09-05 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153491#comment-16153491 ] Kai Zheng commented on HDFS-12393: -- Thanks [~legend] for the ping. Why {{Shorts.BYTES}}

[jira] [Updated] (HDFS-12100) Ozone: KSM: Allocate key should honour volume quota if quota is set on the volume

2017-09-05 Thread Lokesh Jain (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HDFS-12100: --- Attachment: HDFS-12100-HDFS-7240.003.patch [~msingh] Thanks for the review. I have fixed the issues in

[jira] [Commented] (HDFS-11821) BlockManager.getMissingReplOneBlocksCount() does not report correct value if corrupt file with replication factor of 1 gets deleted

2017-09-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153459#comment-16153459 ] Hadoop QA commented on HDFS-11821: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-7859) Erasure Coding: Persist erasure coding policies in NameNode

2017-09-05 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16153453#comment-16153453 ] SammiChen commented on HDFS-7859: - Thanks [~drankye] for quick review! bq. 1. Did you not

[jira] [Updated] (HDFS-12392) Write striped file failure

2017-09-05 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12392: - Attachment: HDFS-12392.002.patch [~drankye] thanks for the quick review! A new patch uploaded. > Write

[jira] [Updated] (HDFS-12395) Support add, remove, disable and enable erasure coding policy operations in edit log

2017-09-05 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12395: - Status: Patch Available (was: Open) > Support add, remove, disable and enable erasure coding policy opera

[jira] [Updated] (HDFS-12395) Support add, remove, disable and enable erasure coding policy operations in edit log

2017-09-05 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HDFS-12395: - Attachment: HDFS-12395.001.patch Initial patch > Support add, remove, disable and enable erasure coding p

[jira] [Assigned] (HDFS-12393) Fix incorrect package length for doRead in PacketReceiver

2017-09-05 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng reassigned HDFS-12393: Assignee: legend > Fix incorrect package length for doRead in PacketReceiver >

  1   2   >