[jira] [Commented] (HDFS-12467) Ozone: SCM: NodeManager should log when it comes out of chill mode

2017-09-28 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185429#comment-16185429 ] Nandakumar commented on HDFS-12467: --- Thanks [~vagarychen] & [~anu] for the review and su

[jira] [Updated] (HDFS-12467) Ozone: SCM: NodeManager should log when it comes out of chill mode

2017-09-28 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandakumar updated HDFS-12467: -- Attachment: HDFS-12467-HDFS-7240.003.patch > Ozone: SCM: NodeManager should log when it comes out of chi

[jira] [Updated] (HDFS-12497) Re-enable TestDFSStripedOutputStreamWithFailure tests

2017-09-28 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huafeng Wang updated HDFS-12497: Attachment: HDFS-12497.003.patch > Re-enable TestDFSStripedOutputStreamWithFailure tests > -

[jira] [Commented] (HDFS-12497) Re-enable TestDFSStripedOutputStreamWithFailure tests

2017-09-28 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185412#comment-16185412 ] Huafeng Wang commented on HDFS-12497: - Hi [~Sammi] [~andrew.wang], I found decreasing

[jira] [Commented] (HDFS-12511) Ozone: Add tags to config

2017-09-28 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185404#comment-16185404 ] Ajay Kumar commented on HDFS-12511: --- [~anu], thanks for review and committing this. > O

[jira] [Comment Edited] (HDFS-12553) Add nameServiceId to QJournalProtocol

2017-09-28 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185386#comment-16185386 ] Bharat Viswanadham edited comment on HDFS-12553 at 9/29/17 5:49 AM:

[jira] [Updated] (HDFS-12553) Add nameServiceId to QJournalProtocol

2017-09-28 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12553: -- Attachment: HDFS-12553.05.patch > Add nameServiceId to QJournalProtocol > --

[jira] [Commented] (HDFS-12553) Add nameServiceId to QJournalProtocol

2017-09-28 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185386#comment-16185386 ] Bharat Viswanadham commented on HDFS-12553: --- Updated the v05 patch to fix checks

[jira] [Commented] (HDFS-12257) Expose getSnapshottableDirListing as a public API in HdfsAdmin

2017-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185381#comment-16185381 ] Hadoop QA commented on HDFS-12257: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12561) FavoredNodes should shuffle if more than replicas and make writer first if present at BlockPlacementPolicyDefault#chooseTarget

2017-09-28 Thread Doris Gu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185376#comment-16185376 ] Doris Gu commented on HDFS-12561: - I've reported the same issue last year, please check: h

[jira] [Commented] (HDFS-8865) Improve quota initialization performance

2017-09-28 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185374#comment-16185374 ] Wei-Chiu Chuang commented on HDFS-8865: --- [~xiaochen] would you please also add TestDi

[jira] [Updated] (HDFS-12563) Ozone: Creation time wrongly showed in OzoneRest.md

2017-09-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12563: - Summary: Ozone: Creation time wrongly showed in OzoneRest.md (was: Ozone: Creation time wrongly showd in

[jira] [Updated] (HDFS-12563) Ozone: Creation time wrongly showd in OzoneRest.md

2017-09-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12563: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status: Resolved

[jira] [Commented] (HDFS-12563) Ozone: Creation time wrongly showd in OzoneRest.md

2017-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185356#comment-16185356 ] Hadoop QA commented on HDFS-12563: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12563) Ozone: Creation time wrongly showd in OzoneRest.md

2017-09-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185335#comment-16185335 ] Anu Engineer commented on HDFS-12563: - +1, Thanks for taking care of this. Please feel

[jira] [Updated] (HDFS-12563) Ozone: Creation time wrongly showd in OzoneRest.md

2017-09-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12563: - Attachment: HDFS-12563-HDFS-7240.001.patch Attach the patch. > Ozone: Creation time wrongly showd in Ozon

[jira] [Updated] (HDFS-12563) Ozone: Creation time wrongly showd in OzoneRest.md

2017-09-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12563: - Status: Patch Available (was: Open) > Ozone: Creation time wrongly showd in OzoneRest.md > --

[jira] [Created] (HDFS-12563) Ozone: Creation time wrongly showd in OzoneRest.md

2017-09-28 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-12563: Summary: Ozone: Creation time wrongly showd in OzoneRest.md Key: HDFS-12563 URL: https://issues.apache.org/jira/browse/HDFS-12563 Project: Hadoop HDFS Issue Type: Su

[jira] [Updated] (HDFS-12563) Ozone: Creation time wrongly showd in OzoneRest.md

2017-09-28 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12563: - Description: Creation time for voulme, bucket and key has implemented now, but the doc {{OzoneRest.md}} w

[jira] [Commented] (HDFS-12553) Add nameServiceId to QJournalProtocol

2017-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185302#comment-16185302 ] Hadoop QA commented on HDFS-12553: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-8865) Improve quota initialization performance

2017-09-28 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-8865: Attachment: HDFS-8865.branch-2.6.patch The 2.6 patch provided by [~nfraison.criteo] still applies. Re-attachi

[jira] [Commented] (HDFS-12553) Add nameServiceId to QJournalProtocol

2017-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185289#comment-16185289 ] Hadoop QA commented on HDFS-12553: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-8865) Improve quota initialization performance

2017-09-28 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185288#comment-16185288 ] Xiao Chen commented on HDFS-8865: - Attached 2.7 patch, which is backported from the branch-

[jira] [Updated] (HDFS-8865) Improve quota initialization performance

2017-09-28 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-8865: Status: Patch Available (was: Reopened) > Improve quota initialization performance > ---

[jira] [Updated] (HDFS-8865) Improve quota initialization performance

2017-09-28 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-8865: Attachment: HDFS-8865.branch-2.7.patch > Improve quota initialization performance > -

[jira] [Reopened] (HDFS-8865) Improve quota initialization performance

2017-09-28 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reopened HDFS-8865: - Sorry to reopen. Trying to backport this to branch-2.7 and branch-2.6, attaching patches... > Improve quota i

[jira] [Commented] (HDFS-12257) Expose getSnapshottableDirListing as a public API in HdfsAdmin

2017-09-28 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185286#comment-16185286 ] Huafeng Wang commented on HDFS-12257: - Hi Andrew, I just added a new API as you propos

[jira] [Commented] (HDFS-7337) Configurable and pluggable erasure codec and policy

2017-09-28 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185280#comment-16185280 ] SammiChen commented on HDFS-7337: - Hi [~andrew.wang], the release note is ready. Is there

[jira] [Updated] (HDFS-12257) Expose getSnapshottableDirListing as a public API in HdfsAdmin

2017-09-28 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huafeng Wang updated HDFS-12257: Attachment: HDFS-12257.003.patch > Expose getSnapshottableDirListing as a public API in HdfsAdmin >

[jira] [Commented] (HDFS-12561) FavoredNodes should shuffle if more than replicas and make writer first if present at BlockPlacementPolicyDefault#chooseTarget

2017-09-28 Thread DENG FEI (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185274#comment-16185274 ] DENG FEI commented on HDFS-12561: - Upload the first patch for review.Thanks > FavoredNode

[jira] [Updated] (HDFS-12561) FavoredNodes should shuffle if more than replicas and make writer first if present at BlockPlacementPolicyDefault#chooseTarget

2017-09-28 Thread DENG FEI (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DENG FEI updated HDFS-12561: Description: As default behavior,will choose in the front of favorite nodes, may lead to unbalance(IO/Storag

[jira] [Updated] (HDFS-12561) FavoredNodes should shuffle if more than replicas and make writer first if present at BlockPlacementPolicyDefault#chooseTarget

2017-09-28 Thread DENG FEI (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DENG FEI updated HDFS-12561: Description: As default behavior,will choose in the front of > FavoredNodes should shuffle if more than rep

[jira] [Updated] (HDFS-12561) FavoredNodes should shuffle if more than replicas and make writer first if present at BlockPlacementPolicyDefault#chooseTarget

2017-09-28 Thread DENG FEI (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DENG FEI updated HDFS-12561: Attachment: HDFS-12561-trunk-001.patch > FavoredNodes should shuffle if more than replicas and make writer f

[jira] [Commented] (HDFS-12561) FavoredNodes should shuffle if more than replicas and make writer first if present at BlockPlacementPolicyDefault#chooseTarget

2017-09-28 Thread Doris Gu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185223#comment-16185223 ] Doris Gu commented on HDFS-12561: - I'am very interested in this, please assign it to me.

[jira] [Comment Edited] (HDFS-12551) Ozone: Documentation: Add Ozone overview documentation.

2017-09-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185221#comment-16185221 ] Xiaoyu Yao edited comment on HDFS-12551 at 9/29/17 1:35 AM: Th

[jira] [Commented] (HDFS-12551) Ozone: Documentation: Add Ozone overview documentation.

2017-09-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185221#comment-16185221 ] Xiaoyu Yao commented on HDFS-12551: --- Thanks [~anu] for working on this. The patch looks

[jira] [Commented] (HDFS-11987) DistributedFileSystem#create and append do not honor CreateFlag.CREATE|APPEND

2017-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185204#comment-16185204 ] Hadoop QA commented on HDFS-11987: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12551) Ozone: Documentation: Add Ozone overview documentation.

2017-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185181#comment-16185181 ] Hadoop QA commented on HDFS-12551: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12543) Ozone : allow create key without specifying size

2017-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185173#comment-16185173 ] Hadoop QA commented on HDFS-12543: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12511) Ozone: Add tags to config

2017-09-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12511: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) [~

[jira] [Updated] (HDFS-12553) Add nameServiceId to QJournalProtocol

2017-09-28 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12553: -- Attachment: HDFS-12553.04.patch > Add nameServiceId to QJournalProtocol > --

[jira] [Updated] (HDFS-12553) Add nameServiceId to QJournalProtocol

2017-09-28 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12553: -- Attachment: (was: HDFS-12553.04.patch) > Add nameServiceId to QJournalProtocol > ---

[jira] [Commented] (HDFS-12387) Ozone: Support Ratis as a first class replication mechanism

2017-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185146#comment-16185146 ] Hadoop QA commented on HDFS-12387: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12511) Ozone: Add tags to config

2017-09-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185143#comment-16185143 ] Anu Engineer commented on HDFS-12511: - +1, I am going to commit this path. Some of the

[jira] [Comment Edited] (HDFS-12060) Ozone: OzoneClient: Add list calls in RpcClient

2017-09-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185126#comment-16185126 ] Xiaoyu Yao edited comment on HDFS-12060 at 9/28/17 11:55 PM: -

[jira] [Commented] (HDFS-12060) Ozone: OzoneClient: Add list calls in RpcClient

2017-09-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185126#comment-16185126 ] Xiaoyu Yao commented on HDFS-12060: --- Thanks [~msingh] for the patch. It looks pretty goo

[jira] [Updated] (HDFS-12562) Ozone: Add ASF license to docker files

2017-09-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12562: Labels: ozoneMerge (was: ) > Ozone: Add ASF license to docker files > -

[jira] [Updated] (HDFS-12562) Ozone: Add ASF license to docker files

2017-09-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12562: Description: HDFS-12469 was checked in without valid ASF headers for these files. Not sure if we ca

[jira] [Updated] (HDFS-12562) Ozone: Add ASF license to docker files

2017-09-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12562: Priority: Blocker (was: Major) > Ozone: Add ASF license to docker files > -

[jira] [Updated] (HDFS-12562) Ozone: Add ASF license to docker files

2017-09-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12562: Description: HDFS-12469 was checked in without valid ASF headers for these files. Not sure if we ca

[jira] [Updated] (HDFS-12562) Ozone: Add ASF license to docker files

2017-09-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12562: Description: HDFS-12469 was checked in without valid ASF headers for these files. Not sure if we ca

[jira] [Updated] (HDFS-12562) Ozone: Add ASF license to docker files

2017-09-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12562: Description: Lines that start with ? in the ASF License report indicate files that do not have

[jira] [Created] (HDFS-12562) Ozone

2017-09-28 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-12562: --- Summary: Ozone Key: HDFS-12562 URL: https://issues.apache.org/jira/browse/HDFS-12562 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Anu Engine

[jira] [Updated] (HDFS-12562) Ozone: Add ASF license to docker files

2017-09-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12562: Summary: Ozone: Add ASF license to docker files (was: Ozone) > Ozone: Add ASF license to docker fil

[jira] [Updated] (HDFS-12551) Ozone: Documentation: Add Ozone overview documentation.

2017-09-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12551: Attachment: HDFS-12551-HDFS-7240.003.patch Fix ASF licence issue and white space at the end of line

[jira] [Commented] (HDFS-12551) Ozone: Documentation: Add Ozone overview documentation.

2017-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185112#comment-16185112 ] Hadoop QA commented on HDFS-12551: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12543) Ozone : allow create key without specifying size

2017-09-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12543: -- Attachment: HDFS-12543-HDFS-7240.007.patch Thanks [~xyao] for the review! All comments addressed in v0

[jira] [Commented] (HDFS-12553) Add nameServiceId to QJournalProtocol

2017-09-28 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185092#comment-16185092 ] Bharat Viswanadham commented on HDFS-12553: --- 1. Removed the HDFSServerConstant u

[jira] [Updated] (HDFS-12553) Add nameServiceId to QJournalProtocol

2017-09-28 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDFS-12553: -- Attachment: HDFS-12553.04.patch > Add nameServiceId to QJournalProtocol > --

[jira] [Commented] (HDFS-12420) Add an option to disallow 'namenode format -force'

2017-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185087#comment-16185087 ] Hadoop QA commented on HDFS-12420: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11825) Make dfshealth datanode information more readable

2017-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185069#comment-16185069 ] Hadoop QA commented on HDFS-11825: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Commented] (HDFS-12537) Ozone: Reduce key creation overhead in Corona

2017-09-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185070#comment-16185070 ] Anu Engineer commented on HDFS-12537: - [~ljain] Looks very good to me. Thanks for gett

[jira] [Commented] (HDFS-12464) Ozone: More detailed documentation about the ozone components

2017-09-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185060#comment-16185060 ] Anu Engineer commented on HDFS-12464: - [~elek] All of the above are excellent question

[jira] [Commented] (HDFS-12467) Ozone: SCM: NodeManager should log when it comes out of chill mode

2017-09-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185047#comment-16185047 ] Anu Engineer commented on HDFS-12467: - +1 to what [~vagarychen] said, the getMinimum j

[jira] [Updated] (HDFS-12488) Ozone: OzoneRestClient timeout is not configurable

2017-09-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12488: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status: Reso

[jira] [Commented] (HDFS-7964) Add support for async edit logging

2017-09-28 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185037#comment-16185037 ] Zhe Zhang commented on HDFS-7964: - Very impressive numbers [~daryn]. How many handler threa

[jira] [Updated] (HDFS-12464) Ozone: More detailed documentation about the ozone components

2017-09-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12464: Status: In Progress (was: Patch Available) > Ozone: More detailed documentation about the ozone com

[jira] [Commented] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2017-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185022#comment-16185022 ] Hadoop QA commented on HDFS-12291: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12488) Ozone: OzoneRestClient timeout is not configurable

2017-09-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16185016#comment-16185016 ] Anu Engineer commented on HDFS-12488: - +1, thanks for the fix. It is very simple and a

[jira] [Updated] (HDFS-12551) Ozone: Documentation: Add Ozone overview documentation.

2017-09-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12551: Attachment: HDFS-12551-HDFS-7240.002.patch [~msingh] I have addressed all comments except moving the

[jira] [Commented] (HDFS-11350) Document the missing settings relevant to DataNode disk IO statistics

2017-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16184986#comment-16184986 ] Hadoop QA commented on HDFS-11350: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Comment Edited] (HDFS-12551) Ozone: Documentation: Add Ozone overview documentation.

2017-09-28 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16184932#comment-16184932 ] Ajay Kumar edited comment on HDFS-12551 at 9/28/17 9:41 PM: LG

[jira] [Commented] (HDFS-12543) Ozone : allow create key without specifying size

2017-09-28 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16184960#comment-16184960 ] Xiaoyu Yao commented on HDFS-12543: --- Thanks [~vagarychen] for working on this and postin

[jira] [Updated] (HDFS-12387) Ozone: Support Ratis as a first class replication mechanism

2017-09-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12387: Attachment: HDFS-12387-HDFS-7240.004.patch [~xyao] Thanks for the comments, I have fixed the issues

[jira] [Commented] (HDFS-12551) Ozone: Documentation: Add Ozone overview documentation.

2017-09-28 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16184932#comment-16184932 ] Ajay Kumar commented on HDFS-12551: --- LGTM. 1 minor suggestion on extra space. {code}mach

[jira] [Updated] (HDFS-12442) WebHdfsFileSystem#getFileBlockLocations will always return BlockLocation#corrupt as false

2017-09-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12442: --- Target Version/s: 2.9.0, 3.0.0, 3.1.0 (was: 2.9.0, 3.0.0-beta1, 3.1.0) > WebHdfsFileSystem#getFileBlo

[jira] [Updated] (HDFS-12257) Expose getSnapshottableDirListing as a public API in HdfsAdmin

2017-09-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12257: --- Target Version/s: 2.9.0, 2.8.3, 3.0.0 (was: 2.9.0, 3.0.0-beta1, 2.8.3) > Expose getSnapshottableDirLi

[jira] [Updated] (HDFS-11885) createEncryptionZone should not block on initializing EDEK cache

2017-09-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-11885: --- Target Version/s: 2.9.0, 2.8.3, 3.0.0 (was: 2.9.0, 3.0.0-beta1, 2.8.3) > createEncryptionZone should

[jira] [Commented] (HDFS-12543) Ozone : allow create key without specifying size

2017-09-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16184833#comment-16184833 ] Chen Liang commented on HDFS-12543: --- Failed tests are unrelated, the asflicence warning

[jira] [Commented] (HDFS-12543) Ozone : allow create key without specifying size

2017-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16184831#comment-16184831 ] Hadoop QA commented on HDFS-12543: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12453) TestDataNodeHotSwapVolumes fails in trunk Jenkins runs

2017-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16184803#comment-16184803 ] Hadoop QA commented on HDFS-12453: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vot

[jira] [Commented] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2017-09-28 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16184749#comment-16184749 ] Surendra Singh Lilhore commented on HDFS-12291: --- ---

[jira] [Updated] (HDFS-12291) [SPS]: Provide a mechanism to recursively iterate and satisfy storage policy of all the files under the given dir

2017-09-28 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore updated HDFS-12291: -- Attachment: HDFS-12291-HDFS-10285-09.patch Attached v9. Fixed tab warnings.. All

[jira] [Commented] (HDFS-12549) Ozone: OzoneClient: Support for REST protocol

2017-09-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16184719#comment-16184719 ] Hadoop QA commented on HDFS-12549: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12420) Add an option to disallow 'namenode format -force'

2017-09-28 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajay Kumar updated HDFS-12420: -- Attachment: HDFS-12420.12.patch [~daryn], thanks for review. Removed log msg from {{NameNode#format}} in

[jira] [Commented] (HDFS-7964) Add support for async edit logging

2017-09-28 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16184659#comment-16184659 ] Daryn Sharp commented on HDFS-7964: --- Wow that looks super broken. I hope you don't get d

[jira] [Commented] (HDFS-12496) Make QuorumJournalManager timeout properties configurable

2017-09-28 Thread Ajay Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16184558#comment-16184558 ] Ajay Kumar commented on HDFS-12496: --- Thanks [~andrew.wang] > Make QuorumJournalManager

[jira] [Updated] (HDFS-8817) Make StorageType for Volumes in DataNode visible through JMX

2017-09-28 Thread Hanisha Koneru (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-8817: - Resolution: Duplicate Status: Resolved (was: Patch Available) Duplicate of HDFS-11375. >

[jira] [Commented] (HDFS-12458) TestReencryptionWithKMS fails regularly

2017-09-28 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16184545#comment-16184545 ] Xiao Chen commented on HDFS-12458: -- Thanks for the review and commit! > TestReencryption

[jira] [Updated] (HDFS-12400) Provide a way for NN to drain the local key cache before re-encryption

2017-09-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12400: --- Fix Version/s: 3.0.0-beta1 > Provide a way for NN to drain the local key cache before re-encryption >

[jira] [Updated] (HDFS-12458) TestReencryptionWithKMS fails regularly

2017-09-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12458: --- Fix Version/s: (was: 3.0.0) 3.0.0-beta1 > TestReencryptionWithKMS fails regular

[jira] [Commented] (HDFS-12560) Remove the extra word "it" in HdfsUserGuide.md

2017-09-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16184531#comment-16184531 ] Hudson commented on HDFS-12560: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1

[jira] [Updated] (HDFS-12453) TestDataNodeHotSwapVolumes fails in trunk Jenkins runs

2017-09-28 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-12453: - Attachment: HDFS-12453.01.patch Thanks [~xiaochen] for the reviews. Update the patch to use {{Mul

[jira] [Updated] (HDFS-12543) Ozone : allow create key without specifying size

2017-09-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12543: -- Attachment: HDFS-12543-HDFS-7240.006.patch Fix checkstyle, the license warning is unrelated. > Ozone :

[jira] [Commented] (HDFS-12560) Remove the extra word "it" in HdfsUserGuide.md

2017-09-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16184507#comment-16184507 ] Chen Liang commented on HDFS-12560: --- +1 on v001 patch, I've committed to trunk, thanks [

[jira] [Updated] (HDFS-12560) Remove the extra word "it" in HdfsUserGuide.md

2017-09-28 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-12560: -- Resolution: Fixed Status: Resolved (was: Patch Available) > Remove the extra word "it" in Hdfs

[jira] [Commented] (HDFS-12404) Rename hdfs config authorization.provider.bypass.users to attributes.provider.bypass.users

2017-09-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16184505#comment-16184505 ] Andrew Wang commented on HDFS-12404: I've cherry-picked this to branch-3.0 for beta1.

[jira] [Commented] (HDFS-12409) Add metrics of execution time of different stages in EC recovery task

2017-09-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16184503#comment-16184503 ] Andrew Wang commented on HDFS-12409: I've cherry-picked this to branch-3.0 for beta1.

[jira] [Commented] (HDFS-12412) Change ErasureCodingWorker.stripedReadPool to cached thread pool

2017-09-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16184501#comment-16184501 ] Andrew Wang commented on HDFS-12412: I've cherry-picked this to branch-3.0 for beta1.

[jira] [Commented] (HDFS-12470) DiskBalancer: Some tests create plan files under system directory

2017-09-28 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16184499#comment-16184499 ] Anu Engineer commented on HDFS-12470: - [~andrew.wang] Thanks > DiskBalancer: Some te

  1   2   >