[GitHub] [hadoop-ozone] cxorm commented on a change in pull request #1233: HDDS-3725. Ozone sh volume client support quota option.

2020-07-22 Thread GitBox
cxorm commented on a change in pull request #1233: URL: https://github.com/apache/hadoop-ozone/pull/1233#discussion_r459245623 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/client/OzoneQuota.java ## @@ -25,26 +25,75 @@ * represents an OzoneQuota Objec

[GitHub] [hadoop-ozone] cxorm commented on a change in pull request #1233: HDDS-3725. Ozone sh volume client support quota option.

2020-07-22 Thread GitBox
cxorm commented on a change in pull request #1233: URL: https://github.com/apache/hadoop-ozone/pull/1233#discussion_r459245623 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/client/OzoneQuota.java ## @@ -25,26 +25,75 @@ * represents an OzoneQuota Objec

[GitHub] [hadoop-ozone] cxorm commented on a change in pull request #1233: HDDS-3725. Ozone sh volume client support quota option.

2020-07-22 Thread GitBox
cxorm commented on a change in pull request #1233: URL: https://github.com/apache/hadoop-ozone/pull/1233#discussion_r459244192 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/client/OzoneQuota.java ## @@ -25,26 +25,75 @@ * represents an OzoneQuota Objec

[jira] [Commented] (HDDS-3798) Display version and setupTime of DN in recon web

2020-07-22 Thread HuangTao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163262#comment-17163262 ] HuangTao commented on HDDS-3798: When I pull request for HDDS-3960, I was confused that wh

[jira] [Comment Edited] (HDDS-3798) Display version and setupTime of DN in recon web

2020-07-22 Thread HuangTao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163262#comment-17163262 ] HuangTao edited comment on HDDS-3798 at 7/23/20, 6:40 AM: -- When I

[jira] [Commented] (HDDS-3798) Display version and setupTime of DN in recon web

2020-07-22 Thread HuangTao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163256#comment-17163256 ] HuangTao commented on HDDS-3798: Sorry, [~Sammi] it is my mistake, I type wrong Jira numbe

[jira] [Updated] (HDDS-3369) Cleanup old write-path of volume in OM

2020-07-22 Thread YiSheng Lien (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YiSheng Lien updated HDDS-3369: --- Fix Version/s: 0.7.0 > Cleanup old write-path of volume in OM > --

[jira] [Updated] (HDDS-3798) Display version and setupTime of DN in recon web

2020-07-22 Thread HuangTao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] HuangTao updated HDDS-3798: --- Attachment: image-2020-07-23-14-31-04-715.png > Display version and setupTime of DN in recon web > ---

[jira] [Updated] (HDDS-4016) AbortMultipartUpload's audit should be changed to ABORT_MULTIPART_UPLOAD

2020-07-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4016: - Labels: pull-request-available (was: ) > AbortMultipartUpload's audit should be changed to ABORT_

[GitHub] [hadoop-ozone] captainzmc opened a new pull request #1246: HDDS-4016. Change AbortMultipartUpload's audit log type to ABORT_MULTIPART_UPLOAD

2020-07-22 Thread GitBox
captainzmc opened a new pull request #1246: URL: https://github.com/apache/hadoop-ozone/pull/1246 ## What changes were proposed in this pull request? Currently, the audit log of AbortMultipartUpload is COMPLETE_MULTIPART_UPLOAD, which cannot be expressed clearly. We need to change i

[jira] [Commented] (HDDS-3999) OM NPE and shutdown while S3MultipartUploadCommitPartResponse#checkAndUpdateDB

2020-07-22 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163242#comment-17163242 ] maobaolong commented on HDDS-3999: -- [~bharat] Thank you for your PR, I left some comments

[jira] [Created] (HDDS-4016) AbortMultipartUpload's audit should be changed to ABORT_MULTIPART_UPLOAD

2020-07-22 Thread mingchao zhao (Jira)
mingchao zhao created HDDS-4016: --- Summary: AbortMultipartUpload's audit should be changed to ABORT_MULTIPART_UPLOAD Key: HDDS-4016 URL: https://issues.apache.org/jira/browse/HDDS-4016 Project: Hadoop Di

[GitHub] [hadoop-ozone] cxorm commented on a change in pull request #1233: HDDS-3725. Ozone sh volume client support quota option.

2020-07-22 Thread GitBox
cxorm commented on a change in pull request #1233: URL: https://github.com/apache/hadoop-ozone/pull/1233#discussion_r459194918 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/VolumeManagerImpl.java ## @@ -273,12 +272,14 @@ private void setOwne

[GitHub] [hadoop-ozone] cxorm commented on a change in pull request #1233: HDDS-3725. Ozone sh volume client support quota option.

2020-07-22 Thread GitBox
cxorm commented on a change in pull request #1233: URL: https://github.com/apache/hadoop-ozone/pull/1233#discussion_r459222501 ## File path: hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/shell/volume/UpdateVolumeHandler.java ## @@ -39,22 +40,34 @@ description

[GitHub] [hadoop-ozone] cxorm commented on pull request #1233: HDDS-3725. Ozone sh volume client support quota option.

2020-07-22 Thread GitBox
cxorm commented on pull request #1233: URL: https://github.com/apache/hadoop-ozone/pull/1233#issuecomment-662824611 Thanks @captainzmc for the work. Overall the functionalily-part is good and some suggestions is added inline, test-related-part would be reviewd soon. Here I have tw

[GitHub] [hadoop-ozone] cxorm commented on a change in pull request #1233: HDDS-3725. Ozone sh volume client support quota option.

2020-07-22 Thread GitBox
cxorm commented on a change in pull request #1233: URL: https://github.com/apache/hadoop-ozone/pull/1233#discussion_r459214380 ## File path: hadoop-hdds/common/src/main/java/org/apache/hadoop/hdds/StringUtils.java ## @@ -149,6 +150,13 @@ public static String createStartupShut

[GitHub] [hadoop-ozone] leosunli commented on a change in pull request #1033: HDDS-3667. If we gracefully stop datanode it would be better to notify scm and r…

2020-07-22 Thread GitBox
leosunli commented on a change in pull request #1033: URL: https://github.com/apache/hadoop-ozone/pull/1033#discussion_r459203434 ## File path: hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/HddsDatanodeService.java ## @@ -164,9 +171,29 @@ public Void call

[GitHub] [hadoop-ozone] leosunli commented on a change in pull request #1033: HDDS-3667. If we gracefully stop datanode it would be better to notify scm and r…

2020-07-22 Thread GitBox
leosunli commented on a change in pull request #1033: URL: https://github.com/apache/hadoop-ozone/pull/1033#discussion_r459203399 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/node/NodeStateManager.java ## @@ -708,6 +707,21 @@ private void updat

[GitHub] [hadoop-ozone] cxorm commented on a change in pull request #1233: HDDS-3725. Ozone sh volume client support quota option.

2020-07-22 Thread GitBox
cxorm commented on a change in pull request #1233: URL: https://github.com/apache/hadoop-ozone/pull/1233#discussion_r459202494 ## File path: hadoop-ozone/client/src/main/java/org/apache/hadoop/ozone/client/VolumeArgs.java ## @@ -73,11 +78,19 @@ public String getOwner() { }

[GitHub] [hadoop-ozone] cxorm commented on a change in pull request #1233: HDDS-3725. Ozone sh volume client support quota option.

2020-07-22 Thread GitBox
cxorm commented on a change in pull request #1233: URL: https://github.com/apache/hadoop-ozone/pull/1233#discussion_r459202326 ## File path: hadoop-ozone/client/src/main/java/org/apache/hadoop/ozone/client/VolumeArgs.java ## @@ -33,25 +33,30 @@ private final String admin;

[GitHub] [hadoop-ozone] cxorm commented on a change in pull request #1233: HDDS-3725. Ozone sh volume client support quota option.

2020-07-22 Thread GitBox
cxorm commented on a change in pull request #1233: URL: https://github.com/apache/hadoop-ozone/pull/1233#discussion_r459200918 ## File path: hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/shell/volume/CreateVolumeHandler.java ## @@ -58,9 +62,12 @@ protected void exec

[GitHub] [hadoop-ozone] cxorm commented on a change in pull request #1233: HDDS-3725. Ozone sh volume client support quota option.

2020-07-22 Thread GitBox
cxorm commented on a change in pull request #1233: URL: https://github.com/apache/hadoop-ozone/pull/1233#discussion_r459200918 ## File path: hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/shell/volume/CreateVolumeHandler.java ## @@ -58,9 +62,12 @@ protected void exec

[GitHub] [hadoop-ozone] cxorm commented on a change in pull request #1233: HDDS-3725. Ozone sh volume client support quota option.

2020-07-22 Thread GitBox
cxorm commented on a change in pull request #1233: URL: https://github.com/apache/hadoop-ozone/pull/1233#discussion_r459200596 ## File path: hadoop-ozone/client/src/main/java/org/apache/hadoop/ozone/client/VolumeArgs.java ## @@ -122,8 +136,13 @@ public String getQuota() {

[jira] [Assigned] (HDDS-3952) Merge small container

2020-07-22 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen reassigned HDDS-3952: Assignee: Sammi Chen (was: runzhiwang) > Merge small container > - > >

[jira] [Updated] (HDDS-3952) Container compact

2020-07-22 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3952: - Summary: Container compact (was: Merge small container) > Container compact > -- > >

[GitHub] [hadoop-ozone] cxorm commented on a change in pull request #1233: HDDS-3725. Ozone sh volume client support quota option.

2020-07-22 Thread GitBox
cxorm commented on a change in pull request #1233: URL: https://github.com/apache/hadoop-ozone/pull/1233#discussion_r459196128 ## File path: hadoop-ozone/tools/src/main/java/org/apache/hadoop/ozone/shell/volume/CreateVolumeHandler.java ## @@ -58,9 +62,12 @@ protected void exec

[GitHub] [hadoop-ozone] cxorm commented on a change in pull request #1233: HDDS-3725. Ozone sh volume client support quota option.

2020-07-22 Thread GitBox
cxorm commented on a change in pull request #1233: URL: https://github.com/apache/hadoop-ozone/pull/1233#discussion_r459194878 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/VolumeManager.java ## @@ -49,10 +49,12 @@ void setOwner(String volum

[GitHub] [hadoop-ozone] cxorm commented on a change in pull request #1233: HDDS-3725. Ozone sh volume client support quota option.

2020-07-22 Thread GitBox
cxorm commented on a change in pull request #1233: URL: https://github.com/apache/hadoop-ozone/pull/1233#discussion_r459192304 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OzoneManager.java ## @@ -1706,21 +1706,24 @@ public boolean setOwner

[GitHub] [hadoop-ozone] codecov-commenter commented on pull request #1243: HDDS-4008. Recon should fallback to ozone.om.service.ids when the internal service id is not defined.

2020-07-22 Thread GitBox
codecov-commenter commented on pull request #1243: URL: https://github.com/apache/hadoop-ozone/pull/1243#issuecomment-662795727 # [Codecov](https://codecov.io/gh/apache/hadoop-ozone/pull/1243?src=pr&el=h1) Report > Merging [#1243](https://codecov.io/gh/apache/hadoop-ozone/pull/1243?src

[GitHub] [hadoop-ozone] maobaolong commented on a change in pull request #1228: HDDS-3995. Fix s3g met NPE exception while write file by multiPartUpload

2020-07-22 Thread GitBox
maobaolong commented on a change in pull request #1228: URL: https://github.com/apache/hadoop-ozone/pull/1228#discussion_r459188437 ## File path: hadoop-ozone/s3gateway/src/main/java/org/apache/hadoop/ozone/s3/endpoint/ObjectEndpoint.java ## @@ -562,13 +562,18 @@ private Respo

[GitHub] [hadoop-ozone] maobaolong commented on pull request #1231: HDDS-3994. Make retry policy can be set by configuration.

2020-07-22 Thread GitBox
maobaolong commented on pull request #1231: URL: https://github.com/apache/hadoop-ozone/pull/1231#issuecomment-662792198 @ChenSammi Please take a look, thank you very mush. This is an automated message from the Apache Git Ser

[GitHub] [hadoop-ozone] maobaolong commented on a change in pull request #1244: HDDS-3999. OM Shutdown when Commit part tries to commit the part, after abort upload.

2020-07-22 Thread GitBox
maobaolong commented on a change in pull request #1244: URL: https://github.com/apache/hadoop-ozone/pull/1244#discussion_r459180028 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/client/rpc/TestOzoneRpcClientAbstract.java ## @@ -1911,10 +1912

[jira] [Created] (HDDS-4015) TestKeyValueContainer#testContainerImportExport[0]

2020-07-22 Thread maobaolong (Jira)
maobaolong created HDDS-4015: Summary: TestKeyValueContainer#testContainerImportExport[0] Key: HDDS-4015 URL: https://issues.apache.org/jira/browse/HDDS-4015 Project: Hadoop Distributed Data Store

[jira] [Created] (HDDS-4014) FLAKY-UT: TestCommitWatcher#testReleaseBuffersOnException

2020-07-22 Thread maobaolong (Jira)
maobaolong created HDDS-4014: Summary: FLAKY-UT: TestCommitWatcher#testReleaseBuffersOnException Key: HDDS-4014 URL: https://issues.apache.org/jira/browse/HDDS-4014 Project: Hadoop Distributed Data Store

[jira] [Created] (HDDS-4013) FLAKY-UT: TestWatchForCommit#testWatchForCommitForGroupMismatchException

2020-07-22 Thread maobaolong (Jira)
maobaolong created HDDS-4013: Summary: FLAKY-UT: TestWatchForCommit#testWatchForCommitForGroupMismatchException Key: HDDS-4013 URL: https://issues.apache.org/jira/browse/HDDS-4013 Project: Hadoop Distribu

[jira] [Created] (HDDS-4012) FLAKY-UT: TestWatchForCommit#test2WayCommitForTimeoutException

2020-07-22 Thread maobaolong (Jira)
maobaolong created HDDS-4012: Summary: FLAKY-UT: TestWatchForCommit#test2WayCommitForTimeoutException Key: HDDS-4012 URL: https://issues.apache.org/jira/browse/HDDS-4012 Project: Hadoop Distributed Data S

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1243: HDDS-4008. Recon should fallback to ozone.om.service.ids when the internal service id is not defined.

2020-07-22 Thread GitBox
bharatviswa504 commented on a change in pull request #1243: URL: https://github.com/apache/hadoop-ozone/pull/1243#discussion_r459166889 ## File path: hadoop-ozone/recon/src/main/resources/webapps/recon/ozone-recon-web/src/views/overview/overview.tsx ## @@ -180,7 +180,7 @@ expo

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1243: HDDS-4008. Recon should fallback to ozone.om.service.ids when the internal service id is not defined.

2020-07-22 Thread GitBox
bharatviswa504 commented on a change in pull request #1243: URL: https://github.com/apache/hadoop-ozone/pull/1243#discussion_r459165738 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/OmUtils.java ## @@ -527,4 +529,45 @@ public static void validateKeyNa

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1237: HDDS-3998. Shorten Ozone FS Hadoop compatibility module names

2020-07-22 Thread GitBox
bharatviswa504 commented on pull request #1237: URL: https://github.com/apache/hadoop-ozone/pull/1237#issuecomment-662759415 Thank You @adoroszlai for the contribution. This is an automated message from the Apache Git Service

[GitHub] [hadoop-ozone] bharatviswa504 merged pull request #1237: HDDS-3998. Shorten Ozone FS Hadoop compatibility module names

2020-07-22 Thread GitBox
bharatviswa504 merged pull request #1237: URL: https://github.com/apache/hadoop-ozone/pull/1237 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[jira] [Updated] (HDDS-3998) Shorten Ozone FS Hadoop compatibility module names

2020-07-22 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-3998: - Fix Version/s: 0.7.0 Resolution: Fixed Status: Resolved (was: Patch Avai

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1239: HDDS-3827. Intermittent failure in TestKeyManagerUnit#listMultipartUploads

2020-07-22 Thread GitBox
bharatviswa504 commented on pull request #1239: URL: https://github.com/apache/hadoop-ozone/pull/1239#issuecomment-662759218 Thank You @adoroszlai for the fix. This is an automated message from the Apache Git Service. To resp

[jira] [Updated] (HDDS-3827) Intermittent failure in TestKeyManagerUnit#listMultipartUploads

2020-07-22 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-3827: - Fix Version/s: 0.7.0 Resolution: Fixed Status: Resolved (was: Patch Avai

[GitHub] [hadoop-ozone] bharatviswa504 merged pull request #1239: HDDS-3827. Intermittent failure in TestKeyManagerUnit#listMultipartUploads

2020-07-22 Thread GitBox
bharatviswa504 merged pull request #1239: URL: https://github.com/apache/hadoop-ozone/pull/1239 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[jira] [Updated] (HDDS-4011) Update S3 related documentation

2020-07-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4011: - Labels: pull-request-available (was: ) > Update S3 related documentation > --

[GitHub] [hadoop-ozone] bharatviswa504 opened a new pull request #1245: HDDS-4011. Update S3 related documentation.

2020-07-22 Thread GitBox
bharatviswa504 opened a new pull request #1245: URL: https://github.com/apache/hadoop-ozone/pull/1245 ## What changes were proposed in this pull request? HDDS-3993 created volume required for S3G during the OM startup. So, remove the step that s3v volume needs to be created.

[jira] [Created] (HDDS-4011) Update S3 related documentation

2020-07-22 Thread Bharat Viswanadham (Jira)
Bharat Viswanadham created HDDS-4011: Summary: Update S3 related documentation Key: HDDS-4011 URL: https://issues.apache.org/jira/browse/HDDS-4011 Project: Hadoop Distributed Data Store I

[GitHub] [hadoop-ozone] avijayanhwx closed pull request #1243: HDDS-4008. Recon should fallback to ozone.om.service.ids when the internal service id is not defined.

2020-07-22 Thread GitBox
avijayanhwx closed pull request #1243: URL: https://github.com/apache/hadoop-ozone/pull/1243 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Updated] (HDDS-4010) S3G startup fails when multiple service ids are configured.

2020-07-22 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-4010: - Labels: newbie (was: ) > S3G startup fails when multiple service ids are configured. > --

[jira] [Created] (HDDS-4010) S3G startup fails when multiple service ids are configured.

2020-07-22 Thread Bharat Viswanadham (Jira)
Bharat Viswanadham created HDDS-4010: Summary: S3G startup fails when multiple service ids are configured. Key: HDDS-4010 URL: https://issues.apache.org/jira/browse/HDDS-4010 Project: Hadoop Distr

[jira] [Created] (HDDS-4009) Recon Overview page: The volume, bucket and key counts are not accurate

2020-07-22 Thread Vivek Ratnavel Subramanian (Jira)
Vivek Ratnavel Subramanian created HDDS-4009: Summary: Recon Overview page: The volume, bucket and key counts are not accurate Key: HDDS-4009 URL: https://issues.apache.org/jira/browse/HDDS-4009

[jira] [Commented] (HDDS-3999) OM NPE and shutdown while S3MultipartUploadCommitPartResponse#checkAndUpdateDB

2020-07-22 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163120#comment-17163120 ] Bharat Viswanadham commented on HDDS-3999: -- [~maobaolong] I hope you have not sta

[GitHub] [hadoop-ozone] bharatviswa504 opened a new pull request #1244: HDDS-3999. OM Shutdown when Commit part tries to commit the part, after abort upload.

2020-07-22 Thread GitBox
bharatviswa504 opened a new pull request #1244: URL: https://github.com/apache/hadoop-ozone/pull/1244 ## What changes were proposed in this pull request? This is caused by HDDS-3685. And the tests have not caught this because there is no test for the below scenario in our test suite.

[jira] [Updated] (HDDS-3999) OM NPE and shutdown while S3MultipartUploadCommitPartResponse#checkAndUpdateDB

2020-07-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3999: - Labels: pull-request-available (was: ) > OM NPE and shutdown while S3MultipartUploadCommitPartRes

[jira] [Comment Edited] (HDDS-3999) OM NPE and shutdown while S3MultipartUploadCommitPartResponse#checkAndUpdateDB

2020-07-22 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163112#comment-17163112 ] Bharat Viswanadham edited comment on HDDS-3999 at 7/22/20, 10:47 PM: ---

[jira] [Comment Edited] (HDDS-3999) OM NPE and shutdown while S3MultipartUploadCommitPartResponse#checkAndUpdateDB

2020-07-22 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163112#comment-17163112 ] Bharat Viswanadham edited comment on HDDS-3999 at 7/22/20, 10:44 PM: ---

[jira] [Updated] (HDDS-3999) OM NPE and shutdown while S3MultipartUploadCommitPartResponse#checkAndUpdateDB

2020-07-22 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-3999: - Priority: Blocker (was: Major) > OM NPE and shutdown while S3MultipartUploadCommitPartRes

[jira] [Updated] (HDDS-3999) OM NPE and shutdown while S3MultipartUploadCommitPartResponse#checkAndUpdateDB

2020-07-22 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-3999: - Attachment: test-repro.patch > OM NPE and shutdown while S3MultipartUploadCommitPartRespon

[jira] [Commented] (HDDS-3999) OM NPE and shutdown while S3MultipartUploadCommitPartResponse#checkAndUpdateDB

2020-07-22 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163112#comment-17163112 ] Bharat Viswanadham commented on HDDS-3999: -- Hi [~maobaolong] Thanks for reporting

[jira] [Updated] (HDDS-4008) Recon should fallback to ozone.om.service.ids when the internal service id is not defined.

2020-07-22 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDDS-4008: Target Version/s: 0.6.0 Priority: Blocker (was: Critical) > Recon should fallback to oz

[jira] [Commented] (HDDS-4008) Recon should fallback to ozone.om.service.ids when the internal service id is not defined.

2020-07-22 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163098#comment-17163098 ] Aravindan Vijayan commented on HDDS-4008: - Got it, thanks! I will update the PR.

[jira] [Updated] (HDDS-4008) Recon should fallback to ozone.om.service.ids when the internal service id is not defined.

2020-07-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4008: - Labels: pull-request-available (was: ) > Recon should fallback to ozone.om.service.ids when the i

[GitHub] [hadoop-ozone] avijayanhwx opened a new pull request #1243: HDDS-4008. Recon should fallback to ozone.om.service.ids when the internal service id is not defined.

2020-07-22 Thread GitBox
avijayanhwx opened a new pull request #1243: URL: https://github.com/apache/hadoop-ozone/pull/1243 ## What changes were proposed in this pull request? Recon connects to OM via RPC using the "ozone.om.internal.service.id" to get updates. If the above config is not defined, but the ozone.o

[jira] [Resolved] (HDDS-4003) Delete the redundant word of the description

2020-07-22 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham resolved HDDS-4003. -- Fix Version/s: 0.7.0 Resolution: Fixed > Delete the redundant word of the descrip

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1240: HDDS-4003. Delete the redundant word of the description

2020-07-22 Thread GitBox
bharatviswa504 commented on pull request #1240: URL: https://github.com/apache/hadoop-ozone/pull/1240#issuecomment-662705884 Thank You @john28152815 for the contribution. This is an automated message from the Apache Git Servi

[GitHub] [hadoop-ozone] bharatviswa504 merged pull request #1240: HDDS-4003. Delete the redundant word of the description

2020-07-22 Thread GitBox
bharatviswa504 merged pull request #1240: URL: https://github.com/apache/hadoop-ozone/pull/1240 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1228: HDDS-3995. Fix s3g met NPE exception while write file by multiPartUpload

2020-07-22 Thread GitBox
bharatviswa504 commented on a change in pull request #1228: URL: https://github.com/apache/hadoop-ozone/pull/1228#discussion_r459087101 ## File path: hadoop-ozone/s3gateway/src/main/java/org/apache/hadoop/ozone/s3/endpoint/ObjectEndpoint.java ## @@ -562,13 +562,18 @@ private R

[jira] [Commented] (HDDS-4008) Recon should fallback to ozone.om.service.ids when the internal service id is not defined.

2020-07-22 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163067#comment-17163067 ] Arpit Agarwal commented on HDDS-4008: - bq. Hence, if multiple ids are defined, Recon w

[jira] [Commented] (HDDS-4008) Recon should fallback to ozone.om.service.ids when the internal service id is not defined.

2020-07-22 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163064#comment-17163064 ] Bharat Viswanadham commented on HDDS-4008: -- If single OM HA is a common case, the

[jira] [Resolved] (HDDS-3969) Validate KeyNames created in FileSystem requests.

2020-07-22 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDDS-3969. - Fix Version/s: 0.6.0 Resolution: Fixed > Validate KeyNames created in FileSystem requests.

[GitHub] [hadoop-ozone] arp7 merged pull request #1211: HDDS-3969. Add validName check for FileSystem requests

2020-07-22 Thread GitBox
arp7 merged pull request #1211: URL: https://github.com/apache/hadoop-ozone/pull/1211 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[jira] [Commented] (HDDS-4008) Recon should fallback to ozone.om.service.ids when the internal service id is not defined.

2020-07-22 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163052#comment-17163052 ] Aravindan Vijayan commented on HDDS-4008: - [~bharat] Yes, I agree. That seems like

[jira] [Comment Edited] (HDDS-4008) Recon should fallback to ozone.om.service.ids when the internal service id is not defined.

2020-07-22 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163035#comment-17163035 ] Bharat Viswanadham edited comment on HDDS-4008 at 7/22/20, 7:59 PM:

[jira] [Commented] (HDDS-4008) Recon should fallback to ozone.om.service.ids when the internal service id is not defined.

2020-07-22 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163035#comment-17163035 ] Bharat Viswanadham commented on HDDS-4008: -- [~avijayan] ozone.om.internal.service

[jira] [Comment Edited] (HDDS-4008) Recon should fallback to ozone.om.service.ids when the internal service id is not defined.

2020-07-22 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17163035#comment-17163035 ] Bharat Viswanadham edited comment on HDDS-4008 at 7/22/20, 7:58 PM:

[jira] [Created] (HDDS-4008) Recon should fallback to ozone.om.service.ids when the internal service id is not defined.

2020-07-22 Thread Aravindan Vijayan (Jira)
Aravindan Vijayan created HDDS-4008: --- Summary: Recon should fallback to ozone.om.service.ids when the internal service id is not defined. Key: HDDS-4008 URL: https://issues.apache.org/jira/browse/HDDS-4008

[GitHub] [hadoop-ozone] bharatviswa504 opened a new pull request #1242: HDDS-4007. Generate encryption info for the bucket outside bucket lock.

2020-07-22 Thread GitBox
bharatviswa504 opened a new pull request #1242: URL: https://github.com/apache/hadoop-ozone/pull/1242 ## What changes were proposed in this pull request? Generate encryption info for the bucket outside bucket lock ## What is the link to the Apache JIRA https://issues.apa

[jira] [Updated] (HDDS-4007) Generate encryption info for the bucket outside bucket lock

2020-07-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4007: - Labels: pull-request-available (was: ) > Generate encryption info for the bucket outside bucket l

[jira] [Updated] (HDDS-4007) Generate encryption info for the bucket outside bucket lock

2020-07-22 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-4007: - Component/s: Security Ozone Manager Issue Type: Improvement (was: Bu

[jira] [Created] (HDDS-4007) Generate encryption info for the bucket outside bucket lock

2020-07-22 Thread Bharat Viswanadham (Jira)
Bharat Viswanadham created HDDS-4007: Summary: Generate encryption info for the bucket outside bucket lock Key: HDDS-4007 URL: https://issues.apache.org/jira/browse/HDDS-4007 Project: Hadoop Distr

[jira] [Updated] (HDDS-4006) Disallow MPU on encrypted buckets.

2020-07-22 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4006: - Labels: pull-request-available (was: ) > Disallow MPU on encrypted buckets. > ---

[GitHub] [hadoop-ozone] bharatviswa504 opened a new pull request #1241: HDDS-4006. Disallow MPU on encrypted buckets.

2020-07-22 Thread GitBox
bharatviswa504 opened a new pull request #1241: URL: https://github.com/apache/hadoop-ozone/pull/1241 ## What changes were proposed in this pull request? Disallow MPU operation on Encrypted buckets when KMS is configured. ## What is the link to the Apache JIRA https://is

[jira] [Updated] (HDDS-4006) Disallow MPU on encrypted buckets.

2020-07-22 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-4006: - Summary: Disallow MPU on encrypted buckets. (was: S3 MPU not supported on encrypted bucke

[jira] [Updated] (HDDS-4006) S3 MPU not supported on encrypted buckets

2020-07-22 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-4006: - Target Version/s: 0.6.0 (was: 0.7.0) > S3 MPU not supported on encrypted buckets > --

[jira] [Updated] (HDDS-4006) S3 MPU not supported on encrypted buckets

2020-07-22 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-4006: - Priority: Blocker (was: Major) > S3 MPU not supported on encrypted buckets >

[jira] [Assigned] (HDDS-4006) S3 MPU not supported on encrypted buckets

2020-07-22 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned HDDS-4006: Assignee: Bharat Viswanadham > S3 MPU not supported on encrypted buckets >

[jira] [Updated] (HDDS-4005) Support S3 MPU on encrypted buckets

2020-07-22 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-4005: - Summary: Support S3 MPU on encrypted buckets (was: S3 MPU not supported on encrypted buck

[jira] [Updated] (HDDS-4006) S3 MPU not supported on encrypted buckets

2020-07-22 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-4006: - Description: With HDDS-3612 buckets created via ozone are also accessible via S3. This has

[jira] [Updated] (HDDS-4006) S3 MPU not supported on encrypted buckets

2020-07-22 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-4006: - Description: With HDDS-3612 buckets created via ozone are also accessible via S3. This has

[jira] [Updated] (HDDS-4005) S3 MPU not supported on encrypted buckets

2020-07-22 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-4005: - Issue Type: New Feature (was: Bug) > S3 MPU not supported on encrypted buckets >

[jira] [Created] (HDDS-4006) S3 MPU not supported on encrypted buckets

2020-07-22 Thread Bharat Viswanadham (Jira)
Bharat Viswanadham created HDDS-4006: Summary: S3 MPU not supported on encrypted buckets Key: HDDS-4006 URL: https://issues.apache.org/jira/browse/HDDS-4006 Project: Hadoop Distributed Data Store

[jira] [Created] (HDDS-4005) S3 MPU not supported on encrypted buckets

2020-07-22 Thread Bharat Viswanadham (Jira)
Bharat Viswanadham created HDDS-4005: Summary: S3 MPU not supported on encrypted buckets Key: HDDS-4005 URL: https://issues.apache.org/jira/browse/HDDS-4005 Project: Hadoop Distributed Data Store

[jira] [Updated] (HDDS-4005) S3 MPU not supported on encrypted buckets

2020-07-22 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-4005: - Target Version/s: 0.7.0 > S3 MPU not supported on encrypted buckets >

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1240: HDDS-4003. Delete the redundant word of the description

2020-07-22 Thread GitBox
bharatviswa504 commented on pull request #1240: URL: https://github.com/apache/hadoop-ozone/pull/1240#issuecomment-662566886 @john28152815 I have assigned this to you. I have added you to the contributor list, you can assign yourself if you are interested in picking up any open Jiras fro

[jira] [Assigned] (HDDS-4003) Delete the redundant word of the description

2020-07-22 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned HDDS-4003: Assignee: Ho-Chin Lin > Delete the redundant word of the description >

[jira] [Updated] (HDDS-3827) Intermittent failure in TestKeyManagerUnit#listMultipartUploads

2020-07-22 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3827: --- Status: Patch Available (was: In Progress) > Intermittent failure in TestKeyManagerUnit#listM

[jira] [Resolved] (HDDS-3993) Create volume required for S3G during OM startup

2020-07-22 Thread Arpit Agarwal (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDDS-3993. - Fix Version/s: 0.6.0 Resolution: Fixed > Create volume required for S3G during OM startup >

[GitHub] [hadoop-ozone] arp7 merged pull request #1227: HDDS-3993. Create volume required for S3G during OM startup.

2020-07-22 Thread GitBox
arp7 merged pull request #1227: URL: https://github.com/apache/hadoop-ozone/pull/1227 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [hadoop-ozone] arp7 merged pull request #1238: HDDS-4004. Remove optional jersey-json dependency

2020-07-22 Thread GitBox
arp7 merged pull request #1238: URL: https://github.com/apache/hadoop-ozone/pull/1238 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [hadoop-ozone] nandakumar131 commented on a change in pull request #1145: HDDS-3895. Implement container related operations in ContainerManagerImpl

2020-07-22 Thread GitBox
nandakumar131 commented on a change in pull request #1145: URL: https://github.com/apache/hadoop-ozone/pull/1145#discussion_r458884430 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/ContainerStateManagerV2.java ## @@ -130,6 +141,21 @@ C

  1   2   >