[jira] [Commented] (HDFS-12088) Remove a user defined EC Policy,the policy is not removed from the userPolicies map

2017-07-26 Thread lufei (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102801#comment-16102801 ] lufei commented on HDFS-12088: -- ok,this issue can be closed.Please close it thank you. [~dran

[jira] [Commented] (HDFS-12036) Add audit log for getErasureCodingPolicy, getErasureCodingPolicies, getErasureCodingCodecs

2017-07-26 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102787#comment-16102787 ] Wei-Chiu Chuang commented on HDFS-12036: [~HuafengWang] assigned it to you. > Add

[jira] [Updated] (HDFS-12036) Add audit log for getErasureCodingPolicy, getErasureCodingPolicies, getErasureCodingCodecs

2017-07-26 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-12036: --- Description: These three FSNameSystem operations do not yet record audit logs. I am not sure h

[jira] [Assigned] (HDFS-12036) Add audit log for getErasureCodingPolicy, getErasureCodingPolicies, getErasureCodingCodecs

2017-07-26 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HDFS-12036: -- Assignee: Huafeng Wang > Add audit log for getErasureCodingPolicy, getErasureCodingPoli

[jira] [Commented] (HDFS-12088) Remove a user defined EC Policy,the policy is not removed from the userPolicies map

2017-07-26 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102776#comment-16102776 ] Kai Zheng commented on HDFS-12088: -- If the current behavior is correct by design and no w

[jira] [Commented] (HDFS-12036) Add audit log for getErasureCodingPolicy, getErasureCodingPolicies, getErasureCodingCodecs

2017-07-26 Thread Huafeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102774#comment-16102774 ] Huafeng Wang commented on HDFS-12036: - Hi [~andrew.wang] , I'd like to take this one.

[jira] [Commented] (HDFS-12088) Remove a user defined EC Policy,the policy is not removed from the userPolicies map

2017-07-26 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102773#comment-16102773 ] Kai Zheng commented on HDFS-12088: -- Hi folks, I thought the current behavior was discuss

[jira] [Commented] (HDFS-11814) Benchmark and tune for prefered default cell size

2017-07-26 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102770#comment-16102770 ] Kai Zheng commented on HDFS-11814: -- Note *ErasureCodeBenchmarkThroughput* could be used t

[jira] [Commented] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-26 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102769#comment-16102769 ] Wei-Chiu Chuang commented on HDFS-12190: Hi [~yzhangal] the code looks mostly good

[jira] [Commented] (HDFS-11814) Benchmark and tune for prefered default cell size

2017-07-26 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102765#comment-16102765 ] Kai Zheng commented on HDFS-11814: -- Per off-line [~zhouwei] would take this. Thanks! > B

[jira] [Assigned] (HDFS-11814) Benchmark and tune for prefered default cell size

2017-07-26 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng reassigned HDFS-11814: Assignee: Wei Zhou > Benchmark and tune for prefered default cell size > --

[jira] [Commented] (HDFS-11814) Benchmark and tune for prefered default cell size

2017-07-26 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102764#comment-16102764 ] Kai Zheng commented on HDFS-11814: -- I just re-purposed this issue to narrow it down and d

[jira] [Updated] (HDFS-11814) Benchmark and tune for prefered default cell size

2017-07-26 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-11814: - Description: Doing some benchmarking to see which cell size is more desirable, other than current 64k

[jira] [Updated] (HDFS-11814) Benchmark and tune for prefered default cell size

2017-07-26 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-11814: - Summary: Benchmark and tune for prefered default cell size (was: Revisit and fine turning HDFS erasure co

[jira] [Updated] (HDFS-12159) Ozone: SCM: Add create replication pipeline RPC

2017-07-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12159: Status: Patch Available (was: Open) > Ozone: SCM: Add create replication pipeline RPC > ---

[jira] [Commented] (HDFS-12200) Optimize CachedDNSToSwitchMapping to avoid 100% cpu utilization

2017-07-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102753#comment-16102753 ] Hadoop QA commented on HDFS-12200: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12180) Ozone: Corona: Add stats and progress bar to corona

2017-07-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-12180: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-7240 Status: Reso

[jira] [Commented] (HDFS-12145) Ozone: OzoneFileSystem: Ozone & KSM should support "/" delimited key names

2017-07-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102743#comment-16102743 ] Weiwei Yang commented on HDFS-12145: Thanks a lot [~anu] (y)(y) > Ozone: OzoneFileSys

[jira] [Commented] (HDFS-12145) Ozone: OzoneFileSystem: Ozone & KSM should support "/" delimited key names

2017-07-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102741#comment-16102741 ] Weiwei Yang commented on HDFS-12145: Oh right.. I am terribly sorry about this... than

[jira] [Commented] (HDFS-12145) Ozone: OzoneFileSystem: Ozone & KSM should support "/" delimited key names

2017-07-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102739#comment-16102739 ] Anu Engineer commented on HDFS-12145: - Cherry-picked and deleted the accidental *DFS-7

[jira] [Commented] (HDFS-12145) Ozone: OzoneFileSystem: Ozone & KSM should support "/" delimited key names

2017-07-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102736#comment-16102736 ] Anu Engineer commented on HDFS-12145: - [~cheersyang] Looks like you had a typo when yo

[jira] [Commented] (HDFS-12180) Ozone: Corona: Add stats and progress bar to corona

2017-07-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102733#comment-16102733 ] Anu Engineer commented on HDFS-12180: - +1, I am going to commit this shortly. > Ozon

[jira] [Commented] (HDFS-12178) Ozone: OzoneClient: Handling SCM container creationFlag at client side

2017-07-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102729#comment-16102729 ] Anu Engineer commented on HDFS-12178: - [~nandakumar131] Would it be possible to check

[jira] [Commented] (HDFS-12062) removeErasureCodingPolicy needs super user permission

2017-07-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102725#comment-16102725 ] Andrew Wang commented on HDFS-12062: Ping, is this JIRA going in? > removeErasureCodi

[jira] [Updated] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12190: - Attachment: HDFS-12190.003.patch rev3 to take care of a missed place in last rev. > Enable 'hdfs

[jira] [Commented] (HDFS-12195) Ozone: DeleteKey-1: KSM replies delete key request asynchronously

2017-07-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102720#comment-16102720 ] Anu Engineer commented on HDFS-12195: - *OzoneConsts.java* {code} public stati

[jira] [Commented] (HDFS-11896) Non-dfsUsed will be doubled on dead node re-registration

2017-07-26 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102719#comment-16102719 ] Zhe Zhang commented on HDFS-11896: -- Thanks for the work [~brahmareddy]. I modified the c

[jira] [Updated] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12190: - Attachment: (was: HDFS-12190.003.patch) > Enable 'hdfs dfs -stat' to display access time > ---

[jira] [Issue Comment Deleted] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12190: - Comment: was deleted (was: 003 to fix a place missed earlier. ) > Enable 'hdfs dfs -stat' to disp

[jira] [Updated] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12190: - Attachment: HDFS-12190.003.patch 003 to fix a place missed earlier. > Enable 'hdfs dfs -stat' to

[jira] [Updated] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12190: - Attachment: (was: HDFS-12190.002.patch) > Enable 'hdfs dfs -stat' to display access time > ---

[jira] [Comment Edited] (HDFS-12145) Ozone: OzoneFileSystem: Ozone & KSM should support "/" delimited key names

2017-07-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102694#comment-16102694 ] Weiwei Yang edited comment on HDFS-12145 at 7/27/17 4:42 AM: -

[jira] [Updated] (HDFS-12145) Ozone: OzoneFileSystem: Ozone & KSM should support "/" delimited key names

2017-07-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated HDFS-12145: --- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Just

[jira] [Commented] (HDFS-12145) Ozone: OzoneFileSystem: Ozone & KSM should support "/" delimited key names

2017-07-26 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102693#comment-16102693 ] Weiwei Yang commented on HDFS-12145: Thanks [~msingh] for confirming that, +1 to lates

[jira] [Commented] (HDFS-12145) Ozone: OzoneFileSystem: Ozone & KSM should support "/" delimited key names

2017-07-26 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102690#comment-16102690 ] Mukul Kumar Singh commented on HDFS-12145: -- The failure of hadoop.ozone.web.clie

[jira] [Commented] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102680#comment-16102680 ] Hadoop QA commented on HDFS-12190: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12034) Ozone: Web interface for KSM

2017-07-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102676#comment-16102676 ] Anu Engineer commented on HDFS-12034: - https://builds.apache.org/blue/organizations/je

[jira] [Comment Edited] (HDFS-12034) Ozone: Web interface for KSM

2017-07-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102668#comment-16102668 ] Anu Engineer edited comment on HDFS-12034 at 7/27/17 4:08 AM: --

[jira] [Commented] (HDFS-12034) Ozone: Web interface for KSM

2017-07-26 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102668#comment-16102668 ] Anu Engineer commented on HDFS-12034: - +1, I will commit this shortly. > Ozone: Web

[jira] [Updated] (HDFS-12170) Ozone: OzoneFileSystem: KSM should maintain key creation time and modification time

2017-07-26 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-12170: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Committe

[jira] [Commented] (HDFS-11580) Ozone: Support asynchronus client API for SCM and containers

2017-07-26 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102649#comment-16102649 ] Nandakumar commented on HDFS-11580: --- Thanks [~vagarychen] for updating the patch. +1 for

[jira] [Commented] (HDFS-12170) Ozone: OzoneFileSystem: KSM should maintain key creation time and modification time

2017-07-26 Thread Yiqun Lin (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102648#comment-16102648 ] Yiqun Lin commented on HDFS-12170: -- Thanks for the confirmation, [~msingh]. I will commit

[jira] [Commented] (HDFS-12117) HttpFS does not seem to support SNAPSHOT related methods for WebHDFS REST Interface

2017-07-26 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102645#comment-16102645 ] Wei-Chiu Chuang commented on HDFS-12117: Thanks for the patch! [~wchevreuil] Overa

[jira] [Commented] (HDFS-12200) Optimize CachedDNSToSwitchMapping to avoid 100% cpu utilization

2017-07-26 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102642#comment-16102642 ] Jiandan Yang commented on HDFS-12200: -- upload HDFS-12200-003.patch, fix ut and check

[jira] [Updated] (HDFS-12200) Optimize CachedDNSToSwitchMapping to avoid 100% cpu utilization

2017-07-26 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated HDFS-12200: - Attachment: HDFS-12200-003.patch > Optimize CachedDNSToSwitchMapping to avoid 100% cpu utilization

[jira] [Commented] (HDFS-6939) Support path-based filtering of inotify events

2017-07-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102635#comment-16102635 ] Hadoop QA commented on HDFS-6939: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-6939) Support path-based filtering of inotify events

2017-07-26 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102626#comment-16102626 ] Surendra Singh Lilhore commented on HDFS-6939: -- Hi [~mingma], Can we push thi

[jira] [Commented] (HDFS-12151) Hadoop 2 clients cannot writeBlock to Hadoop 3 DataNodes

2017-07-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102600#comment-16102600 ] Hadoop QA commented on HDFS-12151: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12190: - Attachment: HDFS-12190.002.patch > Enable 'hdfs dfs -stat' to display access time > --

[jira] [Commented] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102536#comment-16102536 ] Hadoop QA commented on HDFS-12190: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102531#comment-16102531 ] Yongjun Zhang commented on HDFS-12190: -- Thanks a lot [~jojochuang], very good point!

[jira] [Updated] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-12190: - Attachment: HDFS-12190.002.patch > Enable 'hdfs dfs -stat' to display access time > --

[jira] [Updated] (HDFS-11920) Ozone : add key partition

2017-07-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11920: -- Status: Open (was: Patch Available) > Ozone : add key partition > - > >

[jira] [Updated] (HDFS-11920) Ozone : add key partition

2017-07-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-11920: -- Status: Patch Available (was: Open) > Ozone : add key partition > - > >

[jira] [Commented] (HDFS-11920) Ozone : add key partition

2017-07-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102515#comment-16102515 ] Xiaoyu Yao commented on HDFS-11920: --- Thanks [~vagarychen] for the update. +1 for v5 pat

[jira] [Updated] (HDFS-12151) Hadoop 2 clients cannot writeBlock to Hadoop 3 DataNodes

2017-07-26 Thread Sean Mackrory (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Mackrory updated HDFS-12151: - Attachment: HDFS-12151.002.patch Attaching a test that ensures you can pass in null-ish values (at

[jira] [Commented] (HDFS-12131) Add some of the FSNamesystem JMX values as metrics

2017-07-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102480#comment-16102480 ] Andrew Wang commented on HDFS-12131: I don't see a downside to exposing these as metri

[jira] [Commented] (HDFS-11957) Enable POSIX ACL inheritance by default

2017-07-26 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102478#comment-16102478 ] John Zhuge commented on HDFS-11957: --- Thanks [~andrew.wang]! [~cnauroth], what do you th

[jira] [Commented] (HDFS-11896) Non-dfsUsed will be doubled on dead node re-registration

2017-07-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102469#comment-16102469 ] Hadoop QA commented on HDFS-11896: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11957) Enable POSIX ACL inheritance by default

2017-07-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102465#comment-16102465 ] Andrew Wang commented on HDFS-11957: +1 LGTM, thanks John! > Enable POSIX ACL inherit

[jira] [Commented] (HDFS-12134) libhdfs++: Add a synchronization interface for the GSSAPI

2017-07-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102447#comment-16102447 ] Hadoop QA commented on HDFS-12134: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12088) Remove a user defined EC Policy,the policy is not removed from the userPolicies map

2017-07-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12088: --- Target Version/s: 3.0.0-beta1 (was: 3.0.0-beta1, 3.0.0-alpha4) > Remove a user defined EC Policy,the

[jira] [Updated] (HDFS-10480) Add an admin command to list currently open files

2017-07-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-10480: --- Target Version/s: 2.9.0, 3.0.0-beta1 (was: 2.9.0, 3.0.0-alpha4) > Add an admin command to list curren

[jira] [Updated] (HDFS-12157) Do fsyncDirectory(..) outside of FSDataset lock

2017-07-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-12157: --- Target Version/s: 3.0.0-beta1 (was: 3.0.0-alpha4) > Do fsyncDirectory(..) outside of FSDataset lock >

[jira] [Commented] (HDFS-12190) Enable 'hdfs dfs -stat' to display access time

2017-07-26 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102443#comment-16102443 ] Wei-Chiu Chuang commented on HDFS-12190: Hi [~yzhangal] thanks for the patch. I am

[jira] [Updated] (HDFS-12201) INode#getSnapshotINode() should get INodeAttributes from INodeAttributesProvider for the current INode

2017-07-26 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-12201: -- Attachment: HDFS-12201.test.01.patch > INode#getSnapshotINode() should get INodeAttribut

[jira] [Updated] (HDFS-12201) INode#getSnapshotINode() should get INodeAttributes from INodeAttributesProvider for the current INode

2017-07-26 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-12201: -- Attachment: (was: HDFS-12201.test.01.patch) > INode#getSnapshotINode() should get IN

[jira] [Commented] (HDFS-11896) Non-dfsUsed will be doubled on dead node re-registration

2017-07-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102417#comment-16102417 ] Hadoop QA commented on HDFS-11896: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-11203) Rename support during re-encrypt EDEK

2017-07-26 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-11203: - Description: Currently HDFS-10899 disables renames within the EZ if it's under re-encryption. (similar to

[jira] [Updated] (HDFS-12201) INode#getSnapshotINode() should get INodeAttributes from INodeAttributesProvider for the current INode

2017-07-26 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-12201: -- Attachment: HDFS-12201.test.01.patch Attached a test patch to show ACL changes happening

[jira] [Commented] (HDFS-11896) Non-dfsUsed will be doubled on dead node re-registration

2017-07-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102408#comment-16102408 ] Hadoop QA commented on HDFS-11896: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-11580) Ozone: Support asynchronus client API for SCM and containers

2017-07-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102391#comment-16102391 ] Hadoop QA commented on HDFS-11580: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-07-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102374#comment-16102374 ] Hadoop QA commented on HDFS-10899: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-12201) INode#getSnapshotINode() should get INodeAttributes from INodeAttributesProvider for the current INode

2017-07-26 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HDFS-12201: -- Description: Problem: When an external INodeAttributesProvider is enabled, SnapshotDiff

[jira] [Updated] (HDFS-12134) libhdfs++: Add a synchronization interface for the GSSAPI

2017-07-26 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-12134: --- Status: Patch Available (was: Open) > libhdfs++: Add a synchronization interface for the GSSA

[jira] [Updated] (HDFS-12134) libhdfs++: Add a synchronization interface for the GSSAPI

2017-07-26 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-12134: --- Attachment: HDFS-12134.HDFS-8707.000.patch First pass at this work. Don't have kerberized CI

[jira] [Comment Edited] (HDFS-12203) INodeAttributesProvider#getAttributes() support for default/passthrough mode

2017-07-26 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102195#comment-16102195 ] Manoj Govindassamy edited comment on HDFS-12203 at 7/26/17 8:48 PM:

[jira] [Updated] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-07-26 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-10899: - Attachment: HDFS-10899.11.patch Attaching patch 11 for review purposes. Delta: - Only store inodeid in th

[jira] [Updated] (HDFS-11580) Ozone: Support asynchronus client API for SCM and containers

2017-07-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated HDFS-11580: -- Attachment: HDFS-11580-HDFS-7240.010.patch Post v010 patch to save some iteration time, since I think [~

[jira] [Created] (HDFS-12203) INodeAttributesProvider#getAttributes() support for default/passthrough mode

2017-07-26 Thread Manoj Govindassamy (JIRA)
Manoj Govindassamy created HDFS-12203: - Summary: INodeAttributesProvider#getAttributes() support for default/passthrough mode Key: HDFS-12203 URL: https://issues.apache.org/jira/browse/HDFS-12203

[jira] [Commented] (HDFS-12203) INodeAttributesProvider#getAttributes() support for default/passthrough mode

2017-07-26 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102195#comment-16102195 ] Manoj Govindassamy commented on HDFS-12203: --- Adding [~yzhangal], [~jojochuang],

[jira] [Commented] (HDFS-11203) Rename support during re-encrypt EDEK

2017-07-26 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102191#comment-16102191 ] Xiao Chen commented on HDFS-11203: -- Thanks for the comment [~daryn]! You're correct, the

[jira] [Commented] (HDFS-12202) Provide new set of FileSystem API to bypass external attribute provider

2017-07-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102188#comment-16102188 ] Yongjun Zhang commented on HDFS-12202: -- Hi [~arun.sur...@gmail.com], [~daryn], [~jing

[jira] [Assigned] (HDFS-12202) Provide new set of FileSystem API to bypass external attribute provider

2017-07-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang reassigned HDFS-12202: Assignee: Yongjun Zhang > Provide new set of FileSystem API to bypass external attribute pr

[jira] [Created] (HDFS-12202) Provide new set of FileSystem API to bypass external attribute provider

2017-07-26 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HDFS-12202: Summary: Provide new set of FileSystem API to bypass external attribute provider Key: HDFS-12202 URL: https://issues.apache.org/jira/browse/HDFS-12202 Project: Hadoop

[jira] [Commented] (HDFS-11580) Ozone: Support asynchronus client API for SCM and containers

2017-07-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102178#comment-16102178 ] Chen Liang commented on HDFS-11580: --- Thanks for the reply [~nandakumar131]. I did not re

[jira] [Commented] (HDFS-12145) Ozone: OzoneFileSystem: Ozone & KSM should support "/" delimited key names

2017-07-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102172#comment-16102172 ] Hadoop QA commented on HDFS-12145: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12201) INode#getSnapshotINode() should get INodeAttributes from INodeAttributesProvider for the current INode

2017-07-26 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102171#comment-16102171 ] Daryn Sharp commented on HDFS-12201: INodes instances should know absolutely nothing a

[jira] [Commented] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-07-26 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102159#comment-16102159 ] Xiao Chen commented on HDFS-10899: -- Thanks a lot [~daryn] for the heads up. Would love yo

[jira] [Commented] (HDFS-11203) Rename support during re-encrypt EDEK

2017-07-26 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102158#comment-16102158 ] Daryn Sharp commented on HDFS-11203: What is the actual problem statement? Presumably

[jira] [Commented] (HDFS-10899) Add functionality to re-encrypt EDEKs

2017-07-26 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102154#comment-16102154 ] Daryn Sharp commented on HDFS-10899: Looks like Andrew has been providing very good in

[jira] [Commented] (HDFS-12199) Ozone: OzoneFileSystem: OzoneFileystem initialization code

2017-07-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102148#comment-16102148 ] Hadoop QA commented on HDFS-12199: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (HDFS-12201) INode#getSnapshotINode() should get INodeAttributes from INodeAttributesProvider for the current INode

2017-07-26 Thread Manoj Govindassamy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102133#comment-16102133 ] Manoj Govindassamy commented on HDFS-12201: --- Adding [~yzhangal], [~jojochuang],

[jira] [Commented] (HDFS-11580) Ozone: Support asynchronus client API for SCM and containers

2017-07-26 Thread Nandakumar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102132#comment-16102132 ] Nandakumar commented on HDFS-11580: --- I totally agree with you [~vagarychen]. But in our

[jira] [Created] (HDFS-12201) INode#getSnapshotINode() should get INodeAttributes from INodeAttributesProvider for the current INode

2017-07-26 Thread Manoj Govindassamy (JIRA)
Manoj Govindassamy created HDFS-12201: - Summary: INode#getSnapshotINode() should get INodeAttributes from INodeAttributesProvider for the current INode Key: HDFS-12201 URL: https://issues.apache.org/jira/brows

[jira] [Commented] (HDFS-12090) Handling writes from HDFS to Provided storages

2017-07-26 Thread Rakesh R (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16102032#comment-16102032 ] Rakesh R commented on HDFS-12090: - bq. This is the case only if -createMountOnly is specif

[jira] [Comment Edited] (HDFS-11580) Ozone: Support asynchronus client API for SCM and containers

2017-07-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16101998#comment-16101998 ] Chen Liang edited comment on HDFS-11580 at 7/26/17 5:47 PM: Th

[jira] [Commented] (HDFS-11580) Ozone: Support asynchronus client API for SCM and containers

2017-07-26 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16101998#comment-16101998 ] Chen Liang commented on HDFS-11580: --- Thanks [~nandakumar131] for the comments! As far a

[jira] [Updated] (HDFS-12145) Ozone: OzoneFileSystem: Ozone & KSM should support "/" delimited key names

2017-07-26 Thread Mukul Kumar Singh (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-12145: - Attachment: HDFS-12145-HDFS-7240.007.patch Thanks for the review and patch [~cheersyang],

[jira] [Resolved] (HDFS-6082) List all NNs with state

2017-07-26 Thread Surendra Singh Lilhore (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Surendra Singh Lilhore resolved HDFS-6082. -- Resolution: Duplicate This is already fixed in HADOOP-13933. Closing as duplicate

  1   2   >