[jira] [Resolved] (HDDS-4137) Turn on the verbose mode of safe mode check on testlib

2020-08-27 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai resolved HDDS-4137. Fix Version/s: 0.7.0 Resolution: Implemented > Turn on the verbose mode of safe mode

[jira] [Updated] (HDDS-4137) Turn on the verbose mode of safe mode check on testlib

2020-08-27 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-4137: --- Labels: (was: pull-request-available) > Turn on the verbose mode of safe mode check on testl

[GitHub] [hadoop-ozone] adoroszlai merged pull request #1343: HDDS-4137. Turn on the verbose mode of safe mode check on testlib

2020-08-27 Thread GitBox
adoroszlai merged pull request #1343: URL: https://github.com/apache/hadoop-ozone/pull/1343 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[GitHub] [hadoop-ozone] captainzmc edited a comment on pull request #1233: HDDS-3725. Ozone sh volume client support quota option.

2020-08-27 Thread GitBox
captainzmc edited a comment on pull request #1233: URL: https://github.com/apache/hadoop-ozone/pull/1233#issuecomment-682285487 Had fixed issues as HDDS-4129 suggested. Use Long.MAX_VALUE to determine if the parameter values for quota are reasonableCC @ChenSammi. -

[GitHub] [hadoop-ozone] linyiqun commented on a change in pull request #1322: HDDS-3829. Introduce Layout Feature interface in Ozone.

2020-08-27 Thread GitBox
linyiqun commented on a change in pull request #1322: URL: https://github.com/apache/hadoop-ozone/pull/1322#discussion_r478813083 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/upgrade/AbstractLayoutVersionManager.java ## @@ -0,0 +1,110 @@ +/** + * Lice

[GitHub] [hadoop-ozone] amaliujia commented on pull request #1346: [WIP] HDDS-4115. CLI command to show current SCM leader and follower status.

2020-08-27 Thread GitBox
amaliujia commented on pull request #1346: URL: https://github.com/apache/hadoop-ozone/pull/1346#issuecomment-682325031 Ok I think I can work to have an example output first. This is an automated message from the Apache Git

[GitHub] [hadoop-ozone] linyiqun commented on a change in pull request #1322: HDDS-3829. Introduce Layout Feature interface in Ozone.

2020-08-27 Thread GitBox
linyiqun commented on a change in pull request #1322: URL: https://github.com/apache/hadoop-ozone/pull/1322#discussion_r478813083 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/upgrade/AbstractLayoutVersionManager.java ## @@ -0,0 +1,110 @@ +/** + * Lice

[GitHub] [hadoop-ozone] linyiqun commented on a change in pull request #1322: HDDS-3829. Introduce Layout Feature interface in Ozone.

2020-08-27 Thread GitBox
linyiqun commented on a change in pull request #1322: URL: https://github.com/apache/hadoop-ozone/pull/1322#discussion_r478813083 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/upgrade/AbstractLayoutVersionManager.java ## @@ -0,0 +1,110 @@ +/** + * Lice

[GitHub] [hadoop-ozone] ChenSammi commented on pull request #1354: HDDS-4151. Skip the inputstream while offset larger than zero in s3g

2020-08-27 Thread GitBox
ChenSammi commented on pull request #1354: URL: https://github.com/apache/hadoop-ozone/pull/1354#issuecomment-682303622 @maobaolong , s3WrapperInputStream.copyLarge implements the skip and copy. You can just leverage this function.

[GitHub] [hadoop-ozone] ChenSammi edited a comment on pull request #1354: HDDS-4151. Skip the inputstream while offset larger than zero in s3g

2020-08-27 Thread GitBox
ChenSammi edited a comment on pull request #1354: URL: https://github.com/apache/hadoop-ozone/pull/1354#issuecomment-682303622 @maobaolong , s3WrapperInputStream.copyLarge has implemented the skip and copy. You can just leverage this function.

[GitHub] [hadoop-ozone] maobaolong closed pull request #1354: HDDS-4151. Skip the inputstream while offset larger than zero in s3g

2020-08-27 Thread GitBox
maobaolong closed pull request #1354: URL: https://github.com/apache/hadoop-ozone/pull/1354 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[GitHub] [hadoop-ozone] captainzmc commented on pull request #1233: HDDS-3725. Ozone sh volume client support quota option.

2020-08-27 Thread GitBox
captainzmc commented on pull request #1233: URL: https://github.com/apache/hadoop-ozone/pull/1233#issuecomment-682285487 Had fixed issues as HDDS-4129 suggested. CC @ChenSammi. This is an automated message from the Apache Git

[GitHub] [hadoop-ozone] maobaolong commented on pull request #1343: HDDS-4137. Turn on the verbose mode of safe mode check on testlib

2020-08-27 Thread GitBox
maobaolong commented on pull request #1343: URL: https://github.com/apache/hadoop-ozone/pull/1343#issuecomment-682270914 @adoroszlai Thank you for trigger CI checks for me, I see full green now, 😁. PTAL. This is an automated

[GitHub] [hadoop-ozone] maobaolong commented on pull request #1354: HDDS-4151. Skip the inputstream while offset larger than zero in s3g

2020-08-27 Thread GitBox
maobaolong commented on pull request #1354: URL: https://github.com/apache/hadoop-ozone/pull/1354#issuecomment-682270416 @bharatviswa504 Thanks for your review and suggestion, I push a new commit to address your comment, PTAL. --

[GitHub] [hadoop-ozone] maobaolong commented on a change in pull request #1354: HDDS-4151. Skip the inputstream while offset larger than zero in s3g

2020-08-27 Thread GitBox
maobaolong commented on a change in pull request #1354: URL: https://github.com/apache/hadoop-ozone/pull/1354#discussion_r478778013 ## File path: hadoop-ozone/s3gateway/src/main/java/org/apache/hadoop/ozone/s3/endpoint/ObjectEndpoint.java ## @@ -557,8 +559,14 @@ private Respon

[GitHub] [hadoop-ozone] github-actions[bot] commented on pull request #926: HDDS-3596. Clean up unused code after HDDS-2940 and HDDS-2942

2020-08-27 Thread GitBox
github-actions[bot] commented on pull request #926: URL: https://github.com/apache/hadoop-ozone/pull/926#issuecomment-682259775 Thank you very much for the patch. I am closing this PR __temporarily__ as there was no activity recently and it is waiting for response from its author. It

[GitHub] [hadoop-ozone] github-actions[bot] commented on pull request #958: HDDS-2426. Support recover-trash to an existing bucket.

2020-08-27 Thread GitBox
github-actions[bot] commented on pull request #958: URL: https://github.com/apache/hadoop-ozone/pull/958#issuecomment-682259771 Thank you very much for the patch. I am closing this PR __temporarily__ as there was no activity recently and it is waiting for response from its author. It

[GitHub] [hadoop-ozone] github-actions[bot] closed pull request #926: HDDS-3596. Clean up unused code after HDDS-2940 and HDDS-2942

2020-08-27 Thread GitBox
github-actions[bot] closed pull request #926: URL: https://github.com/apache/hadoop-ozone/pull/926 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hadoop-ozone] github-actions[bot] closed pull request #958: HDDS-2426. Support recover-trash to an existing bucket.

2020-08-27 Thread GitBox
github-actions[bot] closed pull request #958: URL: https://github.com/apache/hadoop-ozone/pull/958 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hadoop-ozone] github-actions[bot] commented on pull request #1068: HDDS-3611. Ozone client should not consider closed container error as failure.

2020-08-27 Thread GitBox
github-actions[bot] commented on pull request #1068: URL: https://github.com/apache/hadoop-ozone/pull/1068#issuecomment-682259728 Thank you very much for the patch. I am closing this PR __temporarily__ as there was no activity recently and it is waiting for response from its author.

[GitHub] [hadoop-ozone] xiaoyuyao commented on pull request #1150: HDDS-3903. OzoneRpcClient support batch rename keys.

2020-08-27 Thread GitBox
xiaoyuyao commented on pull request #1150: URL: https://github.com/apache/hadoop-ozone/pull/1150#issuecomment-682251058 I'm +1 to merge this patch as-is and we can revisit this when HDDS-2939 is merged. @arp7 we can mitigate the long lock holding issue by adding a limit on the max

[jira] [Updated] (HDDS-4146) Show the ScmId and ClusterId in the scm web ui.

2020-08-27 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-4146: - Fix Version/s: (was: 1.1) 1.1.0 > Show the ScmId and ClusterId in t

[jira] [Resolved] (HDDS-4146) Show the ScmId and ClusterId in the scm web ui.

2020-08-27 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDDS-4146. -- Fix Version/s: 1.1 Resolution: Fixed Thanks [~maobaolong] for the contribution. Patch has been me

[jira] [Resolved] (HDDS-4145) Bump version to 1.1.0-SNAPSHOT on master

2020-08-27 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham resolved HDDS-4145. -- Fix Version/s: 1.1.0 Resolution: Fixed > Bump version to 1.1.0-SNAPSHOT on master

[GitHub] [hadoop-ozone] xiaoyuyao merged pull request #1350: HDDS-4146. Show the ScmId and ClusterId in the scm web ui.

2020-08-27 Thread GitBox
xiaoyuyao merged pull request #1350: URL: https://github.com/apache/hadoop-ozone/pull/1350 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Updated] (HDDS-4145) Bump version to 1.1.0-SNAPSHOT on master

2020-08-27 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-4145: - Target Version/s: 1.1.0 (was: 0.7.0) > Bump version to 1.1.0-SNAPSHOT on master > ---

[GitHub] [hadoop-ozone] bharatviswa504 merged pull request #1349: HDDS-4145. Bump version to 1.1.0-SNAPSHOT on master

2020-08-27 Thread GitBox
bharatviswa504 merged pull request #1349: URL: https://github.com/apache/hadoop-ozone/pull/1349 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1349: HDDS-4145. Bump version to 1.1.0-SNAPSHOT on master

2020-08-27 Thread GitBox
bharatviswa504 commented on pull request #1349: URL: https://github.com/apache/hadoop-ozone/pull/1349#issuecomment-682247005 Thank You @elek for the contribution and @xiaoyuyao for the review. This is an automated message fro

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1354: HDDS-4151. Skip the inputstream while offset larger than zero in s3g

2020-08-27 Thread GitBox
bharatviswa504 commented on pull request #1354: URL: https://github.com/apache/hadoop-ozone/pull/1354#issuecomment-682238379 @maobaolong Thanks for the detailed explanation. I have one comment, rest LGTM. This is an au

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1354: HDDS-4151. Skip the inputstream while offset larger than zero in s3g

2020-08-27 Thread GitBox
bharatviswa504 commented on a change in pull request #1354: URL: https://github.com/apache/hadoop-ozone/pull/1354#discussion_r478744360 ## File path: hadoop-ozone/s3gateway/src/main/java/org/apache/hadoop/ozone/s3/endpoint/ObjectEndpoint.java ## @@ -557,8 +559,14 @@ private Re

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1354: HDDS-4151. Skip the inputstream while offset larger than zero in s3g

2020-08-27 Thread GitBox
bharatviswa504 commented on a change in pull request #1354: URL: https://github.com/apache/hadoop-ozone/pull/1354#discussion_r478744846 ## File path: hadoop-ozone/s3gateway/src/main/java/org/apache/hadoop/ozone/s3/endpoint/ObjectEndpoint.java ## @@ -277,7 +278,8 @@ public Resp

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1354: HDDS-4151. Skip the inputstream while offset larger than zero in s3g

2020-08-27 Thread GitBox
bharatviswa504 commented on a change in pull request #1354: URL: https://github.com/apache/hadoop-ozone/pull/1354#discussion_r478744768 ## File path: hadoop-ozone/s3gateway/src/main/java/org/apache/hadoop/ozone/s3/endpoint/ObjectEndpoint.java ## @@ -557,8 +559,14 @@ private Re

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1354: HDDS-4151. Skip the inputstream while offset larger than zero in s3g

2020-08-27 Thread GitBox
bharatviswa504 commented on a change in pull request #1354: URL: https://github.com/apache/hadoop-ozone/pull/1354#discussion_r478744360 ## File path: hadoop-ozone/s3gateway/src/main/java/org/apache/hadoop/ozone/s3/endpoint/ObjectEndpoint.java ## @@ -557,8 +559,14 @@ private Re

[jira] [Updated] (HDDS-4163) Enable filesystem semantics on bucket during creation of bucket

2020-08-27 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-4163: - Summary: Enable filesystem semantics on bucket during creation of bucket (was: Enable fil

[jira] [Updated] (HDDS-4163) Enable filesystem semantics on bucket during creation

2020-08-27 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-4163: - Description: HDDS-3955 added a config to ozoneManager ozone.om.enable.filesystem.paths to

[GitHub] [hadoop-ozone] xiaoyuyao commented on pull request #1349: HDDS-4145. Bump version to 1.1.0-SNAPSHOT on master

2020-08-27 Thread GitBox
xiaoyuyao commented on pull request #1349: URL: https://github.com/apache/hadoop-ozone/pull/1349#issuecomment-682233784 LGTM, +1. Thanks @elek for the patch. This is an automated message from the Apache Git Service. To respo

[jira] [Created] (HDDS-4163) Enable filesystem semantics on bucket during creation

2020-08-27 Thread Bharat Viswanadham (Jira)
Bharat Viswanadham created HDDS-4163: Summary: Enable filesystem semantics on bucket during creation Key: HDDS-4163 URL: https://issues.apache.org/jira/browse/HDDS-4163 Project: Hadoop Distributed

[GitHub] [hadoop-ozone] xiaoyuyao commented on pull request #1350: HDDS-4146. Show the ScmId and ClusterId in the scm web ui.

2020-08-27 Thread GitBox
xiaoyuyao commented on pull request #1350: URL: https://github.com/apache/hadoop-ozone/pull/1350#issuecomment-682233240 Thanks @maobaolong for the patch. LGTM, +1. This is an automated message from the Apache Git Service. T

[GitHub] [hadoop-ozone] smengcl commented on pull request #1330: HDDS-4074. [OFS] Implement AbstractFileSystem for RootedOzoneFileSystem

2020-08-27 Thread GitBox
smengcl commented on pull request #1330: URL: https://github.com/apache/hadoop-ozone/pull/1330#issuecomment-682204233 @adoroszlai No worries! Thanks you for creating this PR ) This is an automated message from the Apache Git

[jira] [Updated] (HDDS-4155) Directory and filename can end up with same name in a path

2020-08-27 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-4155: - Status: Patch Available (was: Open) > Directory and filename can end up with same name in

[jira] [Updated] (HDDS-4155) Directory and filename can end up with same name in a path

2020-08-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4155: - Labels: pull-request-available (was: ) > Directory and filename can end up with same name in a pa

[GitHub] [hadoop-ozone] bharatviswa504 opened a new pull request #1361: HDDS-4155. Directory and filename can end up with same name in a path.

2020-08-27 Thread GitBox
bharatviswa504 opened a new pull request #1361: URL: https://github.com/apache/hadoop-ozone/pull/1361 ## What changes were proposed in this pull request? Disallow creation/complete MPU when a directory already exists with same name. ## What is the link to the Apache JIRA

[jira] [Updated] (HDDS-4109) Tests in TestOzoneFileSystem should use the existing MiniOzoneCluster

2020-08-27 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-4109: - Fix Version/s: 0.7.0 Resolution: Fixed Status: Resolved (was: Patch Available) > Tests

[jira] [Updated] (HDDS-4162) Use BeforeClass to init test cluster in TestOzoneFileSystem

2020-08-27 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-4162: - Summary: Use BeforeClass to init test cluster in TestOzoneFileSystem (was: Use BeforeClass init test clus

[GitHub] [hadoop-ozone] smengcl merged pull request #1316: HDDS-4109. Tests in TestOzoneFileSystem should use the existing MiniOzoneCluster

2020-08-27 Thread GitBox
smengcl merged pull request #1316: URL: https://github.com/apache/hadoop-ozone/pull/1316 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[jira] [Created] (HDDS-4162) Use BeforeClass init test cluster in TestOzoneFileSystem

2020-08-27 Thread Siyao Meng (Jira)
Siyao Meng created HDDS-4162: Summary: Use BeforeClass init test cluster in TestOzoneFileSystem Key: HDDS-4162 URL: https://issues.apache.org/jira/browse/HDDS-4162 Project: Hadoop Distributed Data Store

[GitHub] [hadoop-ozone] smengcl commented on pull request #1316: HDDS-4109. Tests in TestOzoneFileSystem should use the existing MiniOzoneCluster

2020-08-27 Thread GitBox
smengcl commented on pull request #1316: URL: https://github.com/apache/hadoop-ozone/pull/1316#issuecomment-682198590 Thanks @ayushtkn for reviewing this. I have filed https://issues.apache.org/jira/browse/HDDS-4162 for the follow-up refactoring (use `BeforeClass`). Will merge shor

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #1316: HDDS-4109. Tests in TestOzoneFileSystem should use the existing MiniOzoneCluster

2020-08-27 Thread GitBox
smengcl commented on a change in pull request #1316: URL: https://github.com/apache/hadoop-ozone/pull/1316#discussion_r478703575 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestOzoneFileSystem.java ## @@ -154,21 +155,21 @@ public void

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #1316: HDDS-4109. Tests in TestOzoneFileSystem should use the existing MiniOzoneCluster

2020-08-27 Thread GitBox
smengcl commented on a change in pull request #1316: URL: https://github.com/apache/hadoop-ozone/pull/1316#discussion_r478700729 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestOzoneFileSystem.java ## @@ -154,21 +155,21 @@ public void

[GitHub] [hadoop-ozone] stackedsax opened a new pull request #1360: Remove archaic reference to Skaffold

2020-08-27 Thread GitBox
stackedsax opened a new pull request #1360: URL: https://github.com/apache/hadoop-ozone/pull/1360 ## What changes were proposed in this pull request? I got sidetracked when I ran into the README in the dist folder because it referenced Skaffold which hasn't been used in a while.

[GitHub] [hadoop-ozone] amaliujia edited a comment on pull request #1346: [WIP] HDDS-4115. CLI command to show current SCM leader and follower status.

2020-08-27 Thread GitBox
amaliujia edited a comment on pull request #1346: URL: https://github.com/apache/hadoop-ozone/pull/1346#issuecomment-682120312 @timmylicheng The output is empty array. In current test setup, `scm.getScmHAManager().getRatisServer().getRaftPeers()` returns empty list. My current gues

[GitHub] [hadoop-ozone] avijayanhwx closed pull request #1358: HDDS-4143. Implement a version factory for OM Apply Transaction that …

2020-08-27 Thread GitBox
avijayanhwx closed pull request #1358: URL: https://github.com/apache/hadoop-ozone/pull/1358 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Assigned] (HDDS-4155) Directory and filename can end up with same name in a path

2020-08-27 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned HDDS-4155: Assignee: Bharat Viswanadham > Directory and filename can end up with same name in

[jira] [Comment Edited] (HDDS-4097) S3/Ozone Filesystem inter-op

2020-08-27 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17186062#comment-17186062 ] Bharat Viswanadham edited comment on HDDS-4097 at 8/27/20, 7:20 PM:

[jira] [Commented] (HDDS-4097) S3/Ozone Filesystem inter-op

2020-08-27 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17186062#comment-17186062 ] Bharat Viswanadham commented on HDDS-4097: -- AWS S3 also allows creating a key wit

[jira] [Commented] (HDDS-4097) S3/Ozone Filesystem inter-op

2020-08-27 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17186060#comment-17186060 ] Marton Elek commented on HDDS-4097: --- When do you suggest turning on a compatibility flag

[GitHub] [hadoop-ozone] bharatviswa504 edited a comment on pull request #1328: HDDS-4102. Normalize Keypath for lookupKey.

2020-08-27 Thread GitBox
bharatviswa504 edited a comment on pull request #1328: URL: https://github.com/apache/hadoop-ozone/pull/1328#issuecomment-682070057 > > Opened a jira [HDDS-4154](https://issues.apache.org/jira/browse/HDDS-4154) to test S3 test suite with ozone.om.enable.filesystem.paths enabled. > >

[GitHub] [hadoop-ozone] ayushtkn commented on a change in pull request #1316: HDDS-4109. Tests in TestOzoneFileSystem should use the existing MiniOzoneCluster

2020-08-27 Thread GitBox
ayushtkn commented on a change in pull request #1316: URL: https://github.com/apache/hadoop-ozone/pull/1316#discussion_r478634376 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestOzoneFileSystem.java ## @@ -154,21 +155,21 @@ public void

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #1316: HDDS-4109. Tests in TestOzoneFileSystem should use the existing MiniOzoneCluster

2020-08-27 Thread GitBox
smengcl commented on a change in pull request #1316: URL: https://github.com/apache/hadoop-ozone/pull/1316#discussion_r478623689 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestOzoneFileSystem.java ## @@ -154,21 +155,21 @@ public void

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #1316: HDDS-4109. Tests in TestOzoneFileSystem should use the existing MiniOzoneCluster

2020-08-27 Thread GitBox
smengcl commented on a change in pull request #1316: URL: https://github.com/apache/hadoop-ozone/pull/1316#discussion_r478623689 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestOzoneFileSystem.java ## @@ -154,21 +155,21 @@ public void

[jira] [Updated] (HDDS-4161) Set fs.defaultFS in docker compose cluster config to OFS

2020-08-27 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-4161: - Description: Set fs.defaultFS in docker compose cluster config to OFS by default. This shouldn't impact a

[GitHub] [hadoop-ozone] amaliujia commented on pull request #1346: [WIP] HDDS-4115. CLI command to show current SCM leader and follower status.

2020-08-27 Thread GitBox
amaliujia commented on pull request #1346: URL: https://github.com/apache/hadoop-ozone/pull/1346#issuecomment-682120312 @timmylicheng The output is empty array. In the test setup, `scm.getScmHAManager().getRatisServer().getRaftPeers();` return empty list. My current guess is I have

[GitHub] [hadoop-ozone] smengcl commented on pull request #1352: HDDS-4147. Add OFS to FileSystem META-INF

2020-08-27 Thread GitBox
smengcl commented on pull request #1352: URL: https://github.com/apache/hadoop-ozone/pull/1352#issuecomment-682116300 Thanks @adoroszlai for verifying the changes. @elek Is there anything left to be desired for this PR? ---

[jira] [Updated] (HDDS-4161) Set fs.defaultFS in docker compose cluster config to OFS

2020-08-27 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-4161: - Target Version/s: 0.7.0 > Set fs.defaultFS in docker compose cluster config to OFS > -

[jira] [Updated] (HDDS-4161) Set fs.defaultFS in docker compose cluster config to OFS

2020-08-27 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-4161: - Priority: Minor (was: Major) > Set fs.defaultFS in docker compose cluster config to OFS > ---

[jira] [Created] (HDDS-4161) Set fs.defaultFS in docker compose cluster config to OFS

2020-08-27 Thread Siyao Meng (Jira)
Siyao Meng created HDDS-4161: Summary: Set fs.defaultFS in docker compose cluster config to OFS Key: HDDS-4161 URL: https://issues.apache.org/jira/browse/HDDS-4161 Project: Hadoop Distributed Data Store

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #1352: HDDS-4147. Add OFS to FileSystem META-INF

2020-08-27 Thread GitBox
smengcl commented on a change in pull request #1352: URL: https://github.com/apache/hadoop-ozone/pull/1352#discussion_r478612798 ## File path: hadoop-ozone/dist/src/main/compose/ozone-csi/docker-config ## @@ -14,6 +14,8 @@ # See the License for the specific language governing

[GitHub] [hadoop-ozone] smengcl commented on a change in pull request #1352: HDDS-4147. Add OFS to FileSystem META-INF

2020-08-27 Thread GitBox
smengcl commented on a change in pull request #1352: URL: https://github.com/apache/hadoop-ozone/pull/1352#discussion_r478607594 ## File path: hadoop-ozone/dist/src/main/compose/ozone-csi/docker-config ## @@ -14,6 +14,8 @@ # See the License for the specific language governing

[GitHub] [hadoop-ozone] avijayanhwx commented on a change in pull request #1322: HDDS-3829. Introduce Layout Feature interface in Ozone.

2020-08-27 Thread GitBox
avijayanhwx commented on a change in pull request #1322: URL: https://github.com/apache/hadoop-ozone/pull/1322#discussion_r478578045 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/upgrade/AbstractLayoutVersionManager.java ## @@ -0,0 +1,110 @@ +/** + * L

[GitHub] [hadoop-ozone] ayushtkn commented on a change in pull request #1316: HDDS-4109. Tests in TestOzoneFileSystem should use the existing MiniOzoneCluster

2020-08-27 Thread GitBox
ayushtkn commented on a change in pull request #1316: URL: https://github.com/apache/hadoop-ozone/pull/1316#discussion_r478571715 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/fs/ozone/TestOzoneFileSystem.java ## @@ -154,21 +155,21 @@ public void

[GitHub] [hadoop-ozone] avijayanhwx commented on a change in pull request #1322: HDDS-3829. Introduce Layout Feature interface in Ozone.

2020-08-27 Thread GitBox
avijayanhwx commented on a change in pull request #1322: URL: https://github.com/apache/hadoop-ozone/pull/1322#discussion_r478562678 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/upgrade/AbstractLayoutVersionManager.java ## @@ -0,0 +1,110 @@ +/** + * L

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1328: HDDS-4102. Normalize Keypath for lookupKey.

2020-08-27 Thread GitBox
bharatviswa504 commented on pull request #1328: URL: https://github.com/apache/hadoop-ozone/pull/1328#issuecomment-682070057 > > Opened a jira [HDDS-4154](https://issues.apache.org/jira/browse/HDDS-4154) to test S3 test suite with ozone.om.enable.filesystem.paths enabled. > > Thanks

[GitHub] [hadoop-ozone] avijayanhwx commented on a change in pull request #1322: HDDS-3829. Introduce Layout Feature interface in Ozone.

2020-08-27 Thread GitBox
avijayanhwx commented on a change in pull request #1322: URL: https://github.com/apache/hadoop-ozone/pull/1322#discussion_r478561281 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/upgrade/AbstractLayoutVersionManager.java ## @@ -0,0 +1,110 @@ +/** + * L

[GitHub] [hadoop-ozone] avijayanhwx commented on a change in pull request #1322: HDDS-3829. Introduce Layout Feature interface in Ozone.

2020-08-27 Thread GitBox
avijayanhwx commented on a change in pull request #1322: URL: https://github.com/apache/hadoop-ozone/pull/1322#discussion_r478560803 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/upgrade/AbstractLayoutVersionManager.java ## @@ -0,0 +1,110 @@ +/** + * L

[GitHub] [hadoop-ozone] aryangupta1998 edited a comment on pull request #1333: HDDS-3151. TestCloseContainerHandlingByClient Enable-testMultiBlockW…

2020-08-27 Thread GitBox
aryangupta1998 edited a comment on pull request #1333: URL: https://github.com/apache/hadoop-ozone/pull/1333#issuecomment-682064868 > Thanks @aryangupta1998 for working on this. Can you please try running these two test classes repeatedly? > > https://cwiki.apache.org/confluence/dis

[jira] [Commented] (HDDS-4097) S3/Ozone Filesystem inter-op

2020-08-27 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185970#comment-17185970 ] Bharat Viswanadham commented on HDDS-4097: -- [~arp] Yes, correct. > S3/Ozone Fil

[GitHub] [hadoop-ozone] aryangupta1998 edited a comment on pull request #1333: HDDS-3151. TestCloseContainerHandlingByClient Enable-testMultiBlockW…

2020-08-27 Thread GitBox
aryangupta1998 edited a comment on pull request #1333: URL: https://github.com/apache/hadoop-ozone/pull/1333#issuecomment-682064868 > Thanks @aryangupta1998 for working on this. Can you please try running these two test classes repeatedly? > > https://cwiki.apache.org/confluence/dis

[GitHub] [hadoop-ozone] aryangupta1998 commented on pull request #1333: HDDS-3151. TestCloseContainerHandlingByClient Enable-testMultiBlockW…

2020-08-27 Thread GitBox
aryangupta1998 commented on pull request #1333: URL: https://github.com/apache/hadoop-ozone/pull/1333#issuecomment-682064868 > Thanks @aryangupta1998 for working on this. Can you please try running these two test classes repeatedly? > > https://cwiki.apache.org/confluence/display/HA

[jira] [Commented] (HDDS-4097) S3/Ozone Filesystem inter-op

2020-08-27 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17185953#comment-17185953 ] Arpit Agarwal commented on HDDS-4097: - Yes that will be the case if filesystem compati

[GitHub] [hadoop-ozone] linyiqun commented on a change in pull request #1322: HDDS-3829. Introduce Layout Feature interface in Ozone.

2020-08-27 Thread GitBox
linyiqun commented on a change in pull request #1322: URL: https://github.com/apache/hadoop-ozone/pull/1322#discussion_r478531377 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/upgrade/AbstractLayoutVersionManager.java ## @@ -0,0 +1,110 @@ +/** + * Lice

[jira] [Updated] (HDDS-4123) Integrate OM Open Key Cleanup Service Into Existing Code

2020-08-27 Thread Ethan Rose (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Rose updated HDDS-4123: - Description: Finish the existing implementation of OpenKeyDeletingService#call. Start the OpenKeyCleanupSe

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #1352: HDDS-4147. Add OFS to FileSystem META-INF

2020-08-27 Thread GitBox
adoroszlai commented on a change in pull request #1352: URL: https://github.com/apache/hadoop-ozone/pull/1352#discussion_r478399273 ## File path: hadoop-ozone/dist/src/main/compose/ozone-om-ha/docker-config ## @@ -14,8 +14,8 @@ # See the License for the specific language gover

[GitHub] [hadoop-ozone] elek commented on a change in pull request #1352: HDDS-4147. Add OFS to FileSystem META-INF

2020-08-27 Thread GitBox
elek commented on a change in pull request #1352: URL: https://github.com/apache/hadoop-ozone/pull/1352#discussion_r477227993 ## File path: hadoop-ozone/dist/src/main/compose/ozone-csi/docker-config ## @@ -14,6 +14,8 @@ # See the License for the specific language governing per

[GitHub] [hadoop-ozone] elek commented on a change in pull request #1352: HDDS-4147. Add OFS to FileSystem META-INF

2020-08-27 Thread GitBox
elek commented on a change in pull request #1352: URL: https://github.com/apache/hadoop-ozone/pull/1352#discussion_r478391849 ## File path: hadoop-ozone/dist/src/main/compose/ozone-om-ha/docker-config ## @@ -14,8 +14,8 @@ # See the License for the specific language governing p

[GitHub] [hadoop-ozone] elek commented on a change in pull request #1352: HDDS-4147. Add OFS to FileSystem META-INF

2020-08-27 Thread GitBox
elek commented on a change in pull request #1352: URL: https://github.com/apache/hadoop-ozone/pull/1352#discussion_r478388391 ## File path: hadoop-ozone/dist/src/main/compose/ozone-csi/docker-config ## @@ -14,6 +14,8 @@ # See the License for the specific language governing per

[GitHub] [hadoop-ozone] elek commented on pull request #1208: HDDS-3755. Storage-class support for Ozone

2020-08-27 Thread GitBox
elek commented on pull request #1208: URL: https://github.com/apache/hadoop-ozone/pull/1208#issuecomment-681922380 > Dynamic model seems a good way, so this storage class will bee a user-defined storage class, right? And then, we should persist storage class info (factor/type) into db and

[jira] [Assigned] (HDDS-2411) Create DataChunkValidator Freon test

2020-08-27 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek reassigned HDDS-2411: - Assignee: François Risch > Create DataChunkValidator Freon test > ---

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #1336: HDDS-4119. Improve performance of the BufferPool management of Ozone client

2020-08-27 Thread GitBox
adoroszlai commented on a change in pull request #1336: URL: https://github.com/apache/hadoop-ozone/pull/1336#discussion_r478375054 ## File path: hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BlockOutputStream.java ## @@ -209,9 +224,16 @@ public IOExcepti

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #1336: HDDS-4119. Improve performance of the BufferPool management of Ozone client

2020-08-27 Thread GitBox
adoroszlai commented on a change in pull request #1336: URL: https://github.com/apache/hadoop-ozone/pull/1336#discussion_r478374944 ## File path: hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BlockOutputStream.java ## @@ -481,11 +514,9 @@ private void han

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #1336: HDDS-4119. Improve performance of the BufferPool management of Ozone client

2020-08-27 Thread GitBox
adoroszlai commented on a change in pull request #1336: URL: https://github.com/apache/hadoop-ozone/pull/1336#discussion_r478372579 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/common/ChunkBuffer.java ## @@ -44,9 +45,6 @@ static ChunkBuffer allocate(i

[GitHub] [hadoop-ozone] elek commented on pull request #1328: HDDS-4102. Normalize Keypath for lookupKey.

2020-08-27 Thread GitBox
elek commented on pull request #1328: URL: https://github.com/apache/hadoop-ozone/pull/1328#issuecomment-681903253 > Opened a jira HDDS-4154 to test S3 test suite with ozone.om.enable.filesystem.paths enabled. Thanks. I think we need additional s3 tests as the behavior what I tested

[GitHub] [hadoop-ozone] linyiqun commented on pull request #1208: HDDS-3755. Storage-class support for Ozone

2020-08-27 Thread GitBox
linyiqun commented on pull request #1208: URL: https://github.com/apache/hadoop-ozone/pull/1208#issuecomment-681901472 Thanks @elek for the detailed comments. >However, we can support to change the "definition" of the storage class. Currently, it's hard coded, but it's easy to be mo

[GitHub] [hadoop-ozone] elek commented on a change in pull request #1336: HDDS-4119. Improve performance of the BufferPool management of Ozone client

2020-08-27 Thread GitBox
elek commented on a change in pull request #1336: URL: https://github.com/apache/hadoop-ozone/pull/1336#discussion_r478358963 ## File path: hadoop-hdds/client/src/main/java/org/apache/hadoop/hdds/scm/storage/BlockOutputStream.java ## @@ -209,9 +224,16 @@ public IOException get

[GitHub] [hadoop-ozone] elek commented on a change in pull request #1336: HDDS-4119. Improve performance of the BufferPool management of Ozone client

2020-08-27 Thread GitBox
elek commented on a change in pull request #1336: URL: https://github.com/apache/hadoop-ozone/pull/1336#discussion_r478353429 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/ozone/common/ChunkBuffer.java ## @@ -44,9 +45,6 @@ static ChunkBuffer allocate(int cap

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #1356: HDDS-4149. Implement OzoneFileStatus#toString

2020-08-27 Thread GitBox
adoroszlai commented on pull request #1356: URL: https://github.com/apache/hadoop-ozone/pull/1356#issuecomment-681893023 Thanks @bshashikant for reviewing and committing it. This is an automated message from the Apache Git Se

[jira] [Updated] (HDDS-4149) Implement OzoneFileStatus#toString

2020-08-27 Thread Shashikant Banerjee (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDDS-4149: -- Fix Version/s: 0.6.0 Resolution: Fixed Status: Resolved (was: Patch Av

[GitHub] [hadoop-ozone] bshashikant commented on pull request #1356: HDDS-4149. Implement OzoneFileStatus#toString

2020-08-27 Thread GitBox
bshashikant commented on pull request #1356: URL: https://github.com/apache/hadoop-ozone/pull/1356#issuecomment-681892604 Thanks @adoroszlai for the contribution. This is an automated message from the Apache Git Service. To r

[GitHub] [hadoop-ozone] bshashikant merged pull request #1356: HDDS-4149. Implement OzoneFileStatus#toString

2020-08-27 Thread GitBox
bshashikant merged pull request #1356: URL: https://github.com/apache/hadoop-ozone/pull/1356 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Resolved] (HDDS-4153) Increase default timeout in kubernetes tests

2020-08-27 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai resolved HDDS-4153. Fix Version/s: 0.7.0 Resolution: Implemented > Increase default timeout in kubernetes

[GitHub] [hadoop-ozone] adoroszlai merged pull request #1357: HDDS-4153. Increase default timeout in kubernetes tests

2020-08-27 Thread GitBox
adoroszlai merged pull request #1357: URL: https://github.com/apache/hadoop-ozone/pull/1357 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

  1   2   >