[jira] [Created] (HDDS-3592) Pipeline evict policy

2020-05-14 Thread maobaolong (Jira)
maobaolong created HDDS-3592: Summary: Pipeline evict policy Key: HDDS-3592 URL: https://issues.apache.org/jira/browse/HDDS-3592 Project: Hadoop Distributed Data Store Issue Type: Sub-task

[jira] [Resolved] (HDDS-3555) Failed to create bucket by s3g

2020-05-14 Thread runzhiwang (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] runzhiwang resolved HDDS-3555. -- Resolution: Resolved > Failed to create bucket by s3g > -- > >

[GitHub] [hadoop-ozone] xiaoyuyao commented on pull request #918: WIP HDDS-3572. Make sure ozone. administrators have access to all keys when acl enabled.

2020-05-14 Thread GitBox
xiaoyuyao commented on pull request #918: URL: https://github.com/apache/hadoop-ozone/pull/918#issuecomment-629051052 @captainzmc Please check: https://github.com/apache/hadoop-ozone/pull/923 Thanks! This is an automated mes

[jira] [Updated] (HDDS-3391) Delegate admin ACL checks to Ozone authorizer plugin

2020-05-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3391: - Labels: pull-request-available (was: ) > Delegate admin ACL checks to Ozone authorizer plugin > -

[GitHub] [hadoop-ozone] xiaoyuyao opened a new pull request #923: HDDS-3391. Delegate admin ACL checks to Ozone authorizer plugin.

2020-05-14 Thread GitBox
xiaoyuyao opened a new pull request #923: URL: https://github.com/apache/hadoop-ozone/pull/923 ## What changes were proposed in this pull request? Delegate admin check (volume create and list) to authorizer plugin. Bypass admin acl check for ozone native authorizer. ## What is

[GitHub] [hadoop-ozone] captainzmc commented on a change in pull request #918: WIP HDDS-3572. Make sure ozone. administrators have access to all keys when acl enabled.

2020-05-14 Thread GitBox
captainzmc commented on a change in pull request #918: URL: https://github.com/apache/hadoop-ozone/pull/918#discussion_r425563994 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/KeyManagerImpl.java ## @@ -1589,6 +1593,15 @@ public boolean chec

[GitHub] [hadoop-ozone] captainzmc commented on a change in pull request #918: WIP HDDS-3572. Make sure ozone. administrators have access to all keys when acl enabled.

2020-05-14 Thread GitBox
captainzmc commented on a change in pull request #918: URL: https://github.com/apache/hadoop-ozone/pull/918#discussion_r425563994 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/KeyManagerImpl.java ## @@ -1589,6 +1593,15 @@ public boolean chec

[GitHub] [hadoop-ozone] captainzmc commented on a change in pull request #918: WIP HDDS-3572. Make sure ozone. administrators have access to all keys when acl enabled.

2020-05-14 Thread GitBox
captainzmc commented on a change in pull request #918: URL: https://github.com/apache/hadoop-ozone/pull/918#discussion_r425563994 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/KeyManagerImpl.java ## @@ -1589,6 +1593,15 @@ public boolean chec

[jira] [Updated] (HDDS-3591) ozone. administrators支持动态修改通过cli.

2020-05-14 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingchao zhao updated HDDS-3591: Description: The current configuration of ozone. Administrators is static, so we need to restart om

[jira] [Created] (HDDS-3591) ozone. administrators支持动态修改通过cli.

2020-05-14 Thread mingchao zhao (Jira)
mingchao zhao created HDDS-3591: --- Summary: ozone. administrators支持动态修改通过cli. Key: HDDS-3591 URL: https://issues.apache.org/jira/browse/HDDS-3591 Project: Hadoop Distributed Data Store Issue Typ

[GitHub] [hadoop-ozone] captainzmc edited a comment on pull request #918: WIP HDDS-3572. Make sure ozone. administrators have access to all keys when acl enabled.

2020-05-14 Thread GitBox
captainzmc edited a comment on pull request #918: URL: https://github.com/apache/hadoop-ozone/pull/918#issuecomment-629015864 > If hdfs superuser bypass is desired, we can add this as an option to native ozone authorizer to honor it. We can easily add that after [HDDS-3391] (I had the patc

[GitHub] [hadoop-ozone] captainzmc commented on pull request #918: WIP HDDS-3572. Make sure ozone. administrators have access to all keys when acl enabled.

2020-05-14 Thread GitBox
captainzmc commented on pull request #918: URL: https://github.com/apache/hadoop-ozone/pull/918#issuecomment-629015864 > If hdfs superuser bypass is desired, we can add this as an option to native ozone authorizer to honor it. We can easily add that after [HDDS-3391] (I had the patch for [

[jira] [Comment Edited] (HDDS-3587) OM HA can be started with stale OM server

2020-05-14 Thread Hanisha Koneru (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17107903#comment-17107903 ] Hanisha Koneru edited comment on HDDS-3587 at 5/15/20, 3:49 AM:

[jira] [Commented] (HDDS-3587) OM HA can be started with stale OM server

2020-05-14 Thread Hanisha Koneru (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17107903#comment-17107903 ] Hanisha Koneru commented on HDDS-3587: -- [~elek],  {quote}The ozone-om-0 and ozone-om-

[GitHub] [hadoop-ozone] umamaheswararao commented on pull request #906: HDDS-3494. Implement ofs://: Support volume and bucket deletion

2020-05-14 Thread GitBox
umamaheswararao commented on pull request #906: URL: https://github.com/apache/hadoop-ozone/pull/906#issuecomment-628929693 Thanks @smengcl for addressing them. Latest changes LGTM +1 BTW, could you please comment about CI failures? ---

[jira] [Created] (HDDS-3590) Recon UI: Add visualization for file size distribution

2020-05-14 Thread Vivek Ratnavel Subramanian (Jira)
Vivek Ratnavel Subramanian created HDDS-3590: Summary: Recon UI: Add visualization for file size distribution Key: HDDS-3590 URL: https://issues.apache.org/jira/browse/HDDS-3590 Project: H

[jira] [Assigned] (HDDS-3572) Make sure ozone. administrators have access to all keys when acl enabled.

2020-05-14 Thread Vivek Ratnavel Subramanian (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vivek Ratnavel Subramanian reassigned HDDS-3572: Assignee: mingchao zhao > Make sure ozone. administrators have acce

[jira] [Resolved] (HDDS-3571) Recon: Display leader count in Datanodes page

2020-05-14 Thread Vivek Ratnavel Subramanian (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vivek Ratnavel Subramanian resolved HDDS-3571. -- Resolution: Fixed > Recon: Display leader count in Datanodes page >

[GitHub] [hadoop-ozone] umamaheswararao commented on a change in pull request #906: HDDS-3494. Implement ofs://: Support volume and bucket deletion

2020-05-14 Thread GitBox
umamaheswararao commented on a change in pull request #906: URL: https://github.com/apache/hadoop-ozone/pull/906#discussion_r425445307 ## File path: hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/BasicRootedOzoneFileSystem.java ## @@ -469,15 +478,72 @@ public bo

[GitHub] [hadoop-ozone] vivekratnavel merged pull request #919: HDDS-3571. Recon: Display leader count in Datanodes page

2020-05-14 Thread GitBox
vivekratnavel merged pull request #919: URL: https://github.com/apache/hadoop-ozone/pull/919 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Assigned] (HDDS-3586) OM HA can be started with 3 isolated LEADER instead of one OM ring

2020-05-14 Thread Hanisha Koneru (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru reassigned HDDS-3586: Assignee: Hanisha Koneru > OM HA can be started with 3 isolated LEADER instead of one OM ri

[GitHub] [hadoop-ozone] smengcl commented on pull request #906: HDDS-3494. Implement ofs://: Support volume and bucket deletion

2020-05-14 Thread GitBox
smengcl commented on pull request #906: URL: https://github.com/apache/hadoop-ozone/pull/906#issuecomment-628880435 Thanks @umamaheswararao for the review and comments. I have updated on all of them. Please take a look. Thi

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #906: HDDS-3494. Implement ofs://: Support volume and bucket deletion

2020-05-14 Thread GitBox
smengcl commented on a change in pull request #906: URL: https://github.com/apache/hadoop-ozone/pull/906#discussion_r42548 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestRootedOzoneFileSystem.java ## @@ -766,4 +768,103 @@ public vo

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #906: HDDS-3494. Implement ofs://: Support volume and bucket deletion

2020-05-14 Thread GitBox
smengcl commented on a change in pull request #906: URL: https://github.com/apache/hadoop-ozone/pull/906#discussion_r42548 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestRootedOzoneFileSystem.java ## @@ -766,4 +768,103 @@ public vo

[GitHub] [hadoop-ozone] avijayanhwx commented on pull request #919: HDDS-3571. Recon: Display leader count in Datanodes page

2020-05-14 Thread GitBox
avijayanhwx commented on pull request #919: URL: https://github.com/apache/hadoop-ozone/pull/919#issuecomment-628878676 LGTM +1 This is an automated message from the Apache Git Service. To respond to the message, please log o

[GitHub] [hadoop-ozone] xiaoyuyao edited a comment on pull request #918: WIP HDDS-3572. Make sure ozone. administrators have access to all keys when acl enabled.

2020-05-14 Thread GitBox
xiaoyuyao edited a comment on pull request #918: URL: https://github.com/apache/hadoop-ozone/pull/918#issuecomment-628768210 bq. I found that the current ozone Administrators cannot access all keys. Administrators of ozone are also checked for permissions. In HDFS, dfs.cluster.administrato

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #906: HDDS-3494. Implement ofs://: Support volume and bucket deletion

2020-05-14 Thread GitBox
smengcl commented on a change in pull request #906: URL: https://github.com/apache/hadoop-ozone/pull/906#discussion_r425418891 ## File path: hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/BasicRootedOzoneFileSystem.java ## @@ -457,6 +462,10 @@ public boolean del

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #906: HDDS-3494. Implement ofs://: Support volume and bucket deletion

2020-05-14 Thread GitBox
smengcl commented on a change in pull request #906: URL: https://github.com/apache/hadoop-ozone/pull/906#discussion_r425416517 ## File path: hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/BasicRootedOzoneFileSystem.java ## @@ -469,15 +478,72 @@ public boolean de

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #906: HDDS-3494. Implement ofs://: Support volume and bucket deletion

2020-05-14 Thread GitBox
smengcl commented on a change in pull request #906: URL: https://github.com/apache/hadoop-ozone/pull/906#discussion_r425412927 ## File path: hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/BasicRootedOzoneFileSystem.java ## @@ -469,15 +478,72 @@ public boolean de

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #906: HDDS-3494. Implement ofs://: Support volume and bucket deletion

2020-05-14 Thread GitBox
smengcl commented on a change in pull request #906: URL: https://github.com/apache/hadoop-ozone/pull/906#discussion_r425412927 ## File path: hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/BasicRootedOzoneFileSystem.java ## @@ -469,15 +478,72 @@ public boolean de

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #906: HDDS-3494. Implement ofs://: Support volume and bucket deletion

2020-05-14 Thread GitBox
smengcl commented on a change in pull request #906: URL: https://github.com/apache/hadoop-ozone/pull/906#discussion_r425412927 ## File path: hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/BasicRootedOzoneFileSystem.java ## @@ -469,15 +478,72 @@ public boolean de

[GitHub] [hadoop-ozone] smengcl edited a comment on pull request #865: HDDS-2969. Implement ofs://: Add contract test

2020-05-14 Thread GitBox
smengcl edited a comment on pull request #865: URL: https://github.com/apache/hadoop-ozone/pull/865#issuecomment-627515342 @xiaoyuyao The volume and bucket deletion support work will be done in HDDS-3494 (https://github.com/apache/hadoop-ozone/pull/906). I will remove the commits

[GitHub] [hadoop-ozone] smengcl edited a comment on pull request #865: HDDS-2969. Implement ofs://: Add contract test

2020-05-14 Thread GitBox
smengcl edited a comment on pull request #865: URL: https://github.com/apache/hadoop-ozone/pull/865#issuecomment-627515342 @xiaoyuyao The volume and bucket deletion support work will be done in HDDS-3494 (https://github.com/apache/hadoop-ozone/pull/906). I will remove the commits

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #863: HDDS-3461. Add acceptance test to smoketest CSI service startup

2020-05-14 Thread GitBox
adoroszlai commented on pull request #863: URL: https://github.com/apache/hadoop-ozone/pull/863#issuecomment-628866401 > @adoroszlai Problem is fixed. Do you have any concern to recommit it? So the fix is 0a8b3d68ff3db7a03b634ea68d03db3cc4e1c8fe? LGTM. -

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #906: HDDS-3494. Implement ofs://: Support volume and bucket deletion

2020-05-14 Thread GitBox
smengcl commented on a change in pull request #906: URL: https://github.com/apache/hadoop-ozone/pull/906#discussion_r425397121 ## File path: hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/BasicRootedOzoneFileSystem.java ## @@ -469,15 +478,72 @@ public boolean de

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #906: HDDS-3494. Implement ofs://: Support volume and bucket deletion

2020-05-14 Thread GitBox
smengcl commented on a change in pull request #906: URL: https://github.com/apache/hadoop-ozone/pull/906#discussion_r425397121 ## File path: hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/BasicRootedOzoneFileSystem.java ## @@ -469,15 +478,72 @@ public boolean de

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #906: HDDS-3494. Implement ofs://: Support volume and bucket deletion

2020-05-14 Thread GitBox
smengcl commented on a change in pull request #906: URL: https://github.com/apache/hadoop-ozone/pull/906#discussion_r425397121 ## File path: hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/BasicRootedOzoneFileSystem.java ## @@ -469,15 +478,72 @@ public boolean de

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #906: HDDS-3494. Implement ofs://: Support volume and bucket deletion

2020-05-14 Thread GitBox
smengcl commented on a change in pull request #906: URL: https://github.com/apache/hadoop-ozone/pull/906#discussion_r425397121 ## File path: hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/BasicRootedOzoneFileSystem.java ## @@ -469,15 +478,72 @@ public boolean de

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #906: HDDS-3494. Implement ofs://: Support volume and bucket deletion

2020-05-14 Thread GitBox
smengcl commented on a change in pull request #906: URL: https://github.com/apache/hadoop-ozone/pull/906#discussion_r425397121 ## File path: hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/BasicRootedOzoneFileSystem.java ## @@ -469,15 +478,72 @@ public boolean de

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #906: HDDS-3494. Implement ofs://: Support volume and bucket deletion

2020-05-14 Thread GitBox
smengcl commented on a change in pull request #906: URL: https://github.com/apache/hadoop-ozone/pull/906#discussion_r425395766 ## File path: hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/BasicRootedOzoneFileSystem.java ## @@ -469,15 +478,72 @@ public boolean de

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #906: HDDS-3494. Implement ofs://: Support volume and bucket deletion

2020-05-14 Thread GitBox
smengcl commented on a change in pull request #906: URL: https://github.com/apache/hadoop-ozone/pull/906#discussion_r425393746 ## File path: hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/BasicRootedOzoneFileSystem.java ## @@ -469,15 +478,72 @@ public boolean de

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #906: HDDS-3494. Implement ofs://: Support volume and bucket deletion

2020-05-14 Thread GitBox
smengcl commented on a change in pull request #906: URL: https://github.com/apache/hadoop-ozone/pull/906#discussion_r425360917 ## File path: hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/BasicRootedOzoneFileSystem.java ## @@ -469,15 +478,72 @@ public boolean de

[jira] [Updated] (HDDS-3589) Support running HBase on Ozone.

2020-05-14 Thread Sadanand Shenoy (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sadanand Shenoy updated HDDS-3589: -- Attachment: Hflush_impl.patch Status: Patch Available (was: In Progress) > Support runn

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #906: HDDS-3494. Implement ofs://: Support volume and bucket deletion

2020-05-14 Thread GitBox
smengcl commented on a change in pull request #906: URL: https://github.com/apache/hadoop-ozone/pull/906#discussion_r425364285 ## File path: hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/BasicRootedOzoneFileSystem.java ## @@ -469,15 +478,72 @@ public boolean de

[jira] [Updated] (HDDS-3589) Support running HBase on Ozone.

2020-05-14 Thread Sadanand Shenoy (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sadanand Shenoy updated HDDS-3589: -- Status: In Progress (was: Patch Available) > Support running HBase on Ozone. >

[jira] [Created] (HDDS-3589) Support running HBase on Ozone.

2020-05-14 Thread Sadanand Shenoy (Jira)
Sadanand Shenoy created HDDS-3589: - Summary: Support running HBase on Ozone. Key: HDDS-3589 URL: https://issues.apache.org/jira/browse/HDDS-3589 Project: Hadoop Distributed Data Store Issue T

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #906: HDDS-3494. Implement ofs://: Support volume and bucket deletion

2020-05-14 Thread GitBox
smengcl commented on a change in pull request #906: URL: https://github.com/apache/hadoop-ozone/pull/906#discussion_r425360917 ## File path: hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/BasicRootedOzoneFileSystem.java ## @@ -469,15 +478,72 @@ public boolean de

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #906: HDDS-3494. Implement ofs://: Support volume and bucket deletion

2020-05-14 Thread GitBox
smengcl commented on a change in pull request #906: URL: https://github.com/apache/hadoop-ozone/pull/906#discussion_r425349213 ## File path: hadoop-ozone/ozonefs/src/main/java/org/apache/hadoop/fs/ozone/BasicRootedOzoneFileSystem.java ## @@ -457,6 +462,10 @@ public boolean del

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #906: HDDS-3494. Implement ofs://: Support volume and bucket deletion

2020-05-14 Thread GitBox
smengcl commented on a change in pull request #906: URL: https://github.com/apache/hadoop-ozone/pull/906#discussion_r425347619 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestRootedOzoneFileSystem.java ## @@ -766,4 +768,103 @@ public vo

[GitHub] [hadoop-ozone] smengcl commented on pull request #876: HDDS-3389. Add response to SetVolumePropertyResponse proto

2020-05-14 Thread GitBox
smengcl commented on pull request #876: URL: https://github.com/apache/hadoop-ozone/pull/876#issuecomment-628807039 Thanks @xiaoyuyao for reviewing and committing. This is an automated message from the Apache Git Service. To

[GitHub] [hadoop-ozone] maobaolong commented on a change in pull request #922: HDDS-3588. Fix NPE while getPipelines if absent in query2OpenPipelines

2020-05-14 Thread GitBox
maobaolong commented on a change in pull request #922: URL: https://github.com/apache/hadoop-ozone/pull/922#discussion_r425332943 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/PipelineStateMap.java ## @@ -210,6 +210,11 @@ Pipeline getPi

[GitHub] [hadoop-ozone] xiaoyuyao commented on pull request #672: HDDS-3154. Intermittent failure in Test2WayCommitInRatis.

2020-05-14 Thread GitBox
xiaoyuyao commented on pull request #672: URL: https://github.com/apache/hadoop-ozone/pull/672#issuecomment-628797855 I also hit this intermittently even after HDDS-3154. ```[ERROR] test2WayCommitForRetryfailure(org.apache.hadoop.ozone.client.rpc.Test2WayCommitInRatis) Time elapsed

[GitHub] [hadoop-ozone] vivekratnavel commented on pull request #919: HDDS-3571. Recon: Display leader count in Datanodes page

2020-05-14 Thread GitBox
vivekratnavel commented on pull request #919: URL: https://github.com/apache/hadoop-ozone/pull/919#issuecomment-628792544 @avijayanhwx @xiaoyuyao Thanks for the reviews. I have updated the patch to fix review comments and updated the db.json file to fix the mock API server to serve correct

[GitHub] [hadoop-ozone] vivekratnavel commented on a change in pull request #919: HDDS-3571. Recon: Display leader count in Datanodes page

2020-05-14 Thread GitBox
vivekratnavel commented on a change in pull request #919: URL: https://github.com/apache/hadoop-ozone/pull/919#discussion_r425321099 ## File path: hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/api/NodeEndpoint.java ## @@ -81,31 +83,44 @@ public Response getDat

[GitHub] [hadoop-ozone] avijayanhwx commented on a change in pull request #919: HDDS-3571. Recon: Display leader count in Datanodes page

2020-05-14 Thread GitBox
avijayanhwx commented on a change in pull request #919: URL: https://github.com/apache/hadoop-ozone/pull/919#discussion_r425316738 ## File path: hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/api/NodeEndpoint.java ## @@ -81,31 +83,44 @@ public Response getDatan

[GitHub] [hadoop-ozone] avijayanhwx commented on a change in pull request #909: HDDS-3416. Enable TestSCMNodeManager#testScmStatsFromNodeReport

2020-05-14 Thread GitBox
avijayanhwx commented on a change in pull request #909: URL: https://github.com/apache/hadoop-ozone/pull/909#discussion_r425309321 ## File path: hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/node/TestSCMNodeManager.java ## @@ -855,6 +860,10 @@ public void tes

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #866: HDDS-2764. security/_index.md translation

2020-05-14 Thread GitBox
xiaoyuyao commented on a change in pull request #866: URL: https://github.com/apache/hadoop-ozone/pull/866#discussion_r425311254 ## File path: hadoop-hdds/docs/content/security/_index.zh.md ## @@ -0,0 +1,33 @@ +--- +title: 安全 +name: Security +identifier: SecureOzone +menu: main

[GitHub] [hadoop-ozone] avijayanhwx commented on a change in pull request #922: HDDS-3588. Fix NPE while getPipelines if absent in query2OpenPipelines

2020-05-14 Thread GitBox
avijayanhwx commented on a change in pull request #922: URL: https://github.com/apache/hadoop-ozone/pull/922#discussion_r425311403 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/PipelineStateMap.java ## @@ -210,6 +210,11 @@ Pipeline getP

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #866: HDDS-2764. security/_index.md translation

2020-05-14 Thread GitBox
xiaoyuyao commented on a change in pull request #866: URL: https://github.com/apache/hadoop-ozone/pull/866#discussion_r425310720 ## File path: hadoop-hdds/docs/content/security/_index.zh.md ## @@ -0,0 +1,33 @@ +--- +title: 安全 +name: Security +identifier: SecureOzone +menu: main

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #866: HDDS-2764. security/_index.md translation

2020-05-14 Thread GitBox
xiaoyuyao commented on a change in pull request #866: URL: https://github.com/apache/hadoop-ozone/pull/866#discussion_r425309715 ## File path: hadoop-hdds/docs/content/security/_index.zh.md ## @@ -0,0 +1,33 @@ +--- +title: 安全 +name: Security +identifier: SecureOzone +menu: main

[GitHub] [hadoop-ozone] avijayanhwx commented on a change in pull request #909: HDDS-3416. Enable TestSCMNodeManager#testScmStatsFromNodeReport

2020-05-14 Thread GitBox
avijayanhwx commented on a change in pull request #909: URL: https://github.com/apache/hadoop-ozone/pull/909#discussion_r425309321 ## File path: hadoop-hdds/server-scm/src/test/java/org/apache/hadoop/hdds/scm/node/TestSCMNodeManager.java ## @@ -855,6 +860,10 @@ public void tes

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #919: HDDS-3571. Recon: Display leader count in Datanodes page

2020-05-14 Thread GitBox
xiaoyuyao commented on a change in pull request #919: URL: https://github.com/apache/hadoop-ozone/pull/919#discussion_r425304517 ## File path: hadoop-ozone/recon/src/main/java/org/apache/hadoop/ozone/recon/api/NodeEndpoint.java ## @@ -81,31 +83,44 @@ public Response getDatanod

[jira] [Updated] (HDDS-3389) Add response to SetVolumePropertyResponse proto

2020-05-14 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDDS-3389: - Fix Version/s: 0.6.0 Resolution: Fixed Status: Resolved (was: Patch Available) Thanks [

[GitHub] [hadoop-ozone] xiaoyuyao merged pull request #876: HDDS-3389. Add response to SetVolumePropertyResponse proto

2020-05-14 Thread GitBox
xiaoyuyao merged pull request #876: URL: https://github.com/apache/hadoop-ozone/pull/876 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [hadoop-ozone] xiaoyuyao edited a comment on pull request #918: WIP HDDS-3572. Make sure ozone. administrators have access to all keys when acl enabled.

2020-05-14 Thread GitBox
xiaoyuyao edited a comment on pull request #918: URL: https://github.com/apache/hadoop-ozone/pull/918#issuecomment-628768210 bq. I found that the current ozone Administrators cannot access all keys. Administrators of ozone are also checked for permissions. In HDFS, dfs.cluster.administrato

[GitHub] [hadoop-ozone] xiaoyuyao commented on pull request #918: WIP HDDS-3572. Make sure ozone. administrators have access to all keys when acl enabled.

2020-05-14 Thread GitBox
xiaoyuyao commented on pull request #918: URL: https://github.com/apache/hadoop-ozone/pull/918#issuecomment-628768210 bq. I found that the current ozone Administrators cannot access all keys. Administrators of ozone are also checked for permissions. In HDFS, dfs.cluster.administrators can

[GitHub] [hadoop-ozone] xiaoyuyao merged pull request #903: HDDS-3453. Use UrlConnectionFactory to handle HTTP Client SPNEGO for …

2020-05-14 Thread GitBox
xiaoyuyao merged pull request #903: URL: https://github.com/apache/hadoop-ozone/pull/903 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[jira] [Resolved] (HDDS-3453) Use UrlConnectionFactory to handle HTTP Client SPNEGO for ozone components

2020-05-14 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDDS-3453. -- Fix Version/s: 0.6.0 Resolution: Fixed Thanks all for the reviews and discussions. I've merged th

[GitHub] [hadoop-ozone] xiaoyuyao commented on pull request #920: HDDS-3581. Make replicationfactor can be set as a number

2020-05-14 Thread GitBox
xiaoyuyao commented on pull request #920: URL: https://github.com/apache/hadoop-ozone/pull/920#issuecomment-628750171 My understanding is that we can change the replication count for closed container? Can we add some document or discussion before making this change as RATIS can't handle al

[jira] [Commented] (HDDS-3582) Update Checkstyle rule

2020-05-14 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17107446#comment-17107446 ] maobaolong commented on HDDS-3582: -- [~elek][~sodonnell] Thank you for support this idea.

[GitHub] [hadoop-ozone] hanishakoneru commented on pull request #911: HDDS-3564. Update Ozone to latest Ratis Snapshot(0.6.0-1720b1f-SNAPSHOT).

2020-05-14 Thread GitBox
hanishakoneru commented on pull request #911: URL: https://github.com/apache/hadoop-ozone/pull/911#issuecomment-628733298 Thanks @mukul1987 This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Updated] (HDDS-3586) OM HA can be started with 3 isolated LEADER instead of one OM ring

2020-05-14 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-3586: Priority: Critical (was: Major) > OM HA can be started with 3 isolated LEADER instead of one OM rin

[GitHub] [hadoop-ozone] elek commented on pull request #900: HDDS-3500. Hide OMFailoverProxyProvider usage behind an interface

2020-05-14 Thread GitBox
elek commented on pull request #900: URL: https://github.com/apache/hadoop-ozone/pull/900#issuecomment-628644215 @bharatviswa504 Can you please help me the review? This is an automated message from the Apache Git Service. To

[jira] [Updated] (HDDS-3588) Fix NPE while getPipelines with OPEN state if absent in query2OpenPipelines

2020-05-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3588: - Labels: pull-request-available (was: ) > Fix NPE while getPipelines with OPEN state if absent in

[GitHub] [hadoop-ozone] maobaolong opened a new pull request #922: HDDS-3588. Fix NPE while getPipelines if absent in query2OpenPipelines

2020-05-14 Thread GitBox
maobaolong opened a new pull request #922: URL: https://github.com/apache/hadoop-ozone/pull/922 ## What changes were proposed in this pull request? As title described, there maybe a NPE if get pipeline from query2OpenPipelines return null. It is possible if we can specify a replicati

[jira] [Created] (HDDS-3588) Fix NPE while getPipelines with OPEN state if absent in query2OpenPipelines

2020-05-14 Thread maobaolong (Jira)
maobaolong created HDDS-3588: Summary: Fix NPE while getPipelines with OPEN state if absent in query2OpenPipelines Key: HDDS-3588 URL: https://issues.apache.org/jira/browse/HDDS-3588 Project: Hadoop Distr

[jira] [Created] (HDDS-3587) OM HA can be started with stale OM server

2020-05-14 Thread Marton Elek (Jira)
Marton Elek created HDDS-3587: - Summary: OM HA can be started with stale OM server Key: HDDS-3587 URL: https://issues.apache.org/jira/browse/HDDS-3587 Project: Hadoop Distributed Data Store Issue

[jira] [Updated] (HDDS-3572) Make sure ozone. administrators have access to all keys when acl enabled.

2020-05-14 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingchao zhao updated HDDS-3572: Description: After our cluster is acl-enabled, the original user cannot continue to access his or h

[jira] [Assigned] (HDDS-2907) Make checkPointManager and checkpoint folder of RDBStore configurable

2020-05-14 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maobaolong reassigned HDDS-2907: Assignee: maobaolong > Make checkPointManager and checkpoint folder of RDBStore configurable >

[jira] [Commented] (HDDS-3582) Update Checkstyle rule

2020-05-14 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17107146#comment-17107146 ] Stephen O'Donnell commented on HDDS-3582: - +1 to this, especially relaxing the lin

[jira] [Created] (HDDS-3586) OM HA can be started with 3 isolated LEADER instead of one OM ring

2020-05-14 Thread Marton Elek (Jira)
Marton Elek created HDDS-3586: - Summary: OM HA can be started with 3 isolated LEADER instead of one OM ring Key: HDDS-3586 URL: https://issues.apache.org/jira/browse/HDDS-3586 Project: Hadoop Distributed

[jira] [Updated] (HDDS-3585) Remove the ReplicationFactor enum from repo

2020-05-14 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maobaolong updated HDDS-3585: - Description: This issue is a clean action of HDDS-3581 > Remove the ReplicationFactor enum from repo > ---

[jira] [Created] (HDDS-3585) Remove the ReplicationFactor enum from repo

2020-05-14 Thread maobaolong (Jira)
maobaolong created HDDS-3585: Summary: Remove the ReplicationFactor enum from repo Key: HDDS-3585 URL: https://issues.apache.org/jira/browse/HDDS-3585 Project: Hadoop Distributed Data Store Issue

[jira] [Updated] (HDDS-3572) Make sure ozone. administrators have access to all keys when acl enabled.

2020-05-14 Thread mingchao zhao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] mingchao zhao updated HDDS-3572: Description: After our cluster is acl-enabled, the original user cannot continue to access his or h

[jira] [Created] (HDDS-3584) Support write 2 replication

2020-05-14 Thread maobaolong (Jira)
maobaolong created HDDS-3584: Summary: Support write 2 replication Key: HDDS-3584 URL: https://issues.apache.org/jira/browse/HDDS-3584 Project: Hadoop Distributed Data Store Issue Type: Sub-task

[jira] [Updated] (HDDS-3583) Loosen some rule restrictions of checkstyle

2020-05-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3583: - Labels: pull-request-available (was: ) > Loosen some rule restrictions of checkstyle > --

[GitHub] [hadoop-ozone] maobaolong opened a new pull request #921: HDDS-3583. Loosen some rule restrictions of checkstyle

2020-05-14 Thread GitBox
maobaolong opened a new pull request #921: URL: https://github.com/apache/hadoop-ozone/pull/921 ## What changes were proposed in this pull request? Change config file of checkstyle only, loosen some rule restrictions of checkstyle. ## What is the link to the Apache JIRA

[jira] [Assigned] (HDDS-3582) Update Checkstyle rule

2020-05-14 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maobaolong reassigned HDDS-3582: Assignee: maobaolong > Update Checkstyle rule > -- > > Key: HDD

[jira] [Updated] (HDDS-3582) Update Checkstyle rule

2020-05-14 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maobaolong updated HDDS-3582: - Description: Now. the rules of checkstyle is hadoop style, as we all know, hadoop repo started 10 years a

[jira] [Created] (HDDS-3583) Loosen some rule restrictions of checkstyle

2020-05-14 Thread maobaolong (Jira)
maobaolong created HDDS-3583: Summary: Loosen some rule restrictions of checkstyle Key: HDDS-3583 URL: https://issues.apache.org/jira/browse/HDDS-3583 Project: Hadoop Distributed Data Store Issue

[jira] [Comment Edited] (HDDS-3001) NFS support for Ozone

2020-05-14 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17107028#comment-17107028 ] maobaolong edited comment on HDDS-3001 at 5/14/20, 7:44 AM: ht

[jira] [Commented] (HDDS-3001) NFS support for Ozone

2020-05-14 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17107028#comment-17107028 ] maobaolong commented on HDDS-3001: -- https://github.com/opendataio/hcfsfuse > NFS support

[jira] [Commented] (HDDS-3582) Update Checkstyle rule

2020-05-14 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17107014#comment-17107014 ] maobaolong commented on HDDS-3582: -- [~elek] I think the checkstyle of Alluxio can be a ca

[jira] [Commented] (HDDS-3582) Update Checkstyle rule

2020-05-14 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17107004#comment-17107004 ] Marton Elek commented on HDDS-3582: --- Thanks to open this, I totally agree. I think the

[GitHub] [hadoop-ozone] timmylicheng commented on a change in pull request #918: HDDS-3572. Make sure ozone. administrators have access to all keys when acl enabled.

2020-05-14 Thread GitBox
timmylicheng commented on a change in pull request #918: URL: https://github.com/apache/hadoop-ozone/pull/918#discussion_r424916337 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/BucketManagerImpl.java ## @@ -555,6 +564,14 @@ public boolean c