[jira] [Commented] (HDDS-3970) ContainerStateManager: invalid state transition state: CLOSING event: FINALIZE

2020-07-15 Thread Prashant Pogde (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17158916#comment-17158916 ] Prashant Pogde commented on HDDS-3970: -- In the logs it seems there was an event trigg

[jira] [Updated] (HDDS-3970) ContainerStateManager: invalid state transition state: CLOSING event: FINALIZE

2020-07-15 Thread Prashant Pogde (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Pogde updated HDDS-3970: - Attachment: TEST-org.apache.hadoop.ozone.TestStorageContainerManager.xml > ContainerStateManager:

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #1182: HDDS-3926. OM Token Identifier table should use in-house serialization.

2020-07-15 Thread GitBox
xiaoyuyao commented on a change in pull request #1182: URL: https://github.com/apache/hadoop-ozone/pull/1182#discussion_r455519840 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/codec/TokenIdentifierCodec.java ## @@ -42,8 +42,9 @@ public Ozon

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #1182: HDDS-3926. OM Token Identifier table should use in-house serialization.

2020-07-15 Thread GitBox
xiaoyuyao commented on a change in pull request #1182: URL: https://github.com/apache/hadoop-ozone/pull/1182#discussion_r455519631 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/codec/TokenIdentifierCodec.java ## @@ -42,8 +42,9 @@ public Ozon

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #1182: HDDS-3926. OM Token Identifier table should use in-house serialization.

2020-07-15 Thread GitBox
xiaoyuyao commented on a change in pull request #1182: URL: https://github.com/apache/hadoop-ozone/pull/1182#discussion_r455519197 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/codec/TokenIdentifierCodec.java ## @@ -42,8 +42,9 @@ public Ozon

[GitHub] [hadoop-ozone] xiaoyuyao commented on a change in pull request #1182: HDDS-3926. OM Token Identifier table should use in-house serialization.

2020-07-15 Thread GitBox
xiaoyuyao commented on a change in pull request #1182: URL: https://github.com/apache/hadoop-ozone/pull/1182#discussion_r455519197 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/codec/TokenIdentifierCodec.java ## @@ -42,8 +42,9 @@ public Ozon

[jira] [Updated] (HDDS-3923) Display the safemode status on scm page

2020-07-15 Thread Dinesh Chitlangia (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dinesh Chitlangia updated HDDS-3923: Affects Version/s: (was: 0.7.0) > Display the safemode status on scm page >

[jira] [Resolved] (HDDS-3923) Display the safemode status on scm page

2020-07-15 Thread Dinesh Chitlangia (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dinesh Chitlangia resolved HDDS-3923. - Fix Version/s: 0.7.0 Resolution: Fixed > Display the safemode status on scm page >

[GitHub] [hadoop-ozone] dineshchitlangia merged pull request #1165: HDDS-3923. Display the safemode status on scm page

2020-07-15 Thread GitBox
dineshchitlangia merged pull request #1165: URL: https://github.com/apache/hadoop-ozone/pull/1165 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[GitHub] [hadoop-ozone] ChenSammi commented on a change in pull request #1147: HDDS-3892. Datanode initialization is too slow when there are thousan…

2020-07-15 Thread GitBox
ChenSammi commented on a change in pull request #1147: URL: https://github.com/apache/hadoop-ozone/pull/1147#discussion_r455480045 ## File path: hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/common/utils/ContainerCache.java ## @@ -113,22 +113,41

[GitHub] [hadoop-ozone] ChenSammi commented on pull request #1147: HDDS-3892. Datanode initialization is too slow when there are thousan…

2020-07-15 Thread GitBox
ChenSammi commented on pull request #1147: URL: https://github.com/apache/hadoop-ozone/pull/1147#issuecomment-659112467 > > Thanks @bharatviswa504 and @adoroszlai for the review. lock per containerDBPath in ContainerCache is a good idea. I tried it but cannot solve our problem given a volu

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-07-15 Thread GitBox
adoroszlai commented on pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#issuecomment-659108416 > > > When deleting a bucket, we check bucket is empty or not. Do we need to check resolvedBucket is empty or not? > > > > Link can be deleted regardless of the ex

[jira] [Comment Edited] (HDDS-3965) SCM failed to start up for duplicated pipeline detected

2020-07-15 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17158832#comment-17158832 ] Aravindan Vijayan edited comment on HDDS-3965 at 7/16/20, 1:46 AM: -

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-07-15 Thread GitBox
adoroszlai commented on a change in pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#discussion_r455460584 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyDeleteRequest.java ## @@ -111,6 +110,10 @@ pub

[GitHub] [hadoop-ozone] iamabug commented on a change in pull request #1190: HDDS-2770. security/SecurityAcls.md

2020-07-15 Thread GitBox
iamabug commented on a change in pull request #1190: URL: https://github.com/apache/hadoop-ozone/pull/1190#discussion_r455459623 ## File path: hadoop-hdds/docs/content/security/SecurityAcls.zh.md ## @@ -0,0 +1,66 @@ +--- +title: "Ozone 访问控制列表" +date: "2019-April-03" +weight: 6

[GitHub] [hadoop-ozone] iamabug commented on a change in pull request #1190: HDDS-2770. security/SecurityAcls.md

2020-07-15 Thread GitBox
iamabug commented on a change in pull request #1190: URL: https://github.com/apache/hadoop-ozone/pull/1190#discussion_r455460136 ## File path: hadoop-hdds/docs/content/security/SecurityAcls.zh.md ## @@ -0,0 +1,66 @@ +--- +title: "Ozone 访问控制列表" +date: "2019-April-03" +weight: 6

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #1204: HDDS-3964. Ratis config key mismatch

2020-07-15 Thread GitBox
adoroszlai commented on pull request #1204: URL: https://github.com/apache/hadoop-ozone/pull/1204#issuecomment-659106380 @cku328 thanks for finding the `watch.request.timeout` problem, please review This is an automated messa

[jira] [Updated] (HDDS-3958) Intermittent failure in Recon acceptance test due to mixed stdout and stderr

2020-07-15 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3958: --- Fix Version/s: 0.7.0 Target Version/s: (was: 0.7.0) Resolution: Fixed

[jira] [Updated] (HDDS-3958) Intermittent failure in Recon acceptance test due to mixed stdout and stderr

2020-07-15 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3958: --- Labels: (was: pull-request-available) > Intermittent failure in Recon acceptance test due to

[jira] [Updated] (HDDS-3958) Intermittent failure in Recon acceptance test due to mixed stdout and stderr

2020-07-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3958: - Labels: pull-request-available (was: ) > Intermittent failure in Recon acceptance test due to mix

[GitHub] [hadoop-ozone] adoroszlai merged pull request #1200: HDDS-3958. Intermittent failure in Recon acceptance test due to mixed stdout and stderr

2020-07-15 Thread GitBox
adoroszlai merged pull request #1200: URL: https://github.com/apache/hadoop-ozone/pull/1200 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[GitHub] [hadoop-ozone] iamabug commented on a change in pull request #1190: HDDS-2770. security/SecurityAcls.md

2020-07-15 Thread GitBox
iamabug commented on a change in pull request #1190: URL: https://github.com/apache/hadoop-ozone/pull/1190#discussion_r455459623 ## File path: hadoop-hdds/docs/content/security/SecurityAcls.zh.md ## @@ -0,0 +1,66 @@ +--- +title: "Ozone 访问控制列表" +date: "2019-April-03" +weight: 6

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #1200: HDDS-3958. Intermittent failure in Recon acceptance test due to mixed stdout and stderr

2020-07-15 Thread GitBox
adoroszlai commented on pull request #1200: URL: https://github.com/apache/hadoop-ozone/pull/1200#issuecomment-659105616 Thanks @vivekratnavel for the review. This is an automated message from the Apache Git Service. To respo

[jira] [Created] (HDDS-3970) ContainerStateManager: invalid state transition state: CLOSING event: FINALIZE

2020-07-15 Thread Prashant Pogde (Jira)
Prashant Pogde created HDDS-3970: Summary: ContainerStateManager: invalid state transition state: CLOSING event: FINALIZE Key: HDDS-3970 URL: https://issues.apache.org/jira/browse/HDDS-3970 Project: H

[jira] [Comment Edited] (HDDS-3965) SCM failed to start up for duplicated pipeline detected

2020-07-15 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17158832#comment-17158832 ] Aravindan Vijayan edited comment on HDDS-3965 at 7/16/20, 1:27 AM: -

[jira] [Commented] (HDDS-3965) SCM failed to start up for duplicated pipeline detected

2020-07-15 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17158832#comment-17158832 ] Aravindan Vijayan commented on HDDS-3965: - [~Sammi] On investigating the issue wit

[jira] [Comment Edited] (HDDS-3965) SCM failed to start up for duplicated pipeline detected

2020-07-15 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17158827#comment-17158827 ] Sammi Chen edited comment on HDDS-3965 at 7/16/20, 1:22 AM: To

[jira] [Created] (HDDS-3969) Validate KeyNames created using KeyCreate and FileCreate

2020-07-15 Thread Bharat Viswanadham (Jira)
Bharat Viswanadham created HDDS-3969: Summary: Validate KeyNames created using KeyCreate and FileCreate Key: HDDS-3969 URL: https://issues.apache.org/jira/browse/HDDS-3969 Project: Hadoop Distribut

[jira] [Comment Edited] (HDDS-3965) SCM failed to start up for duplicated pipeline detected

2020-07-15 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17158822#comment-17158822 ] Sammi Chen edited comment on HDDS-3965 at 7/16/20, 1:19 AM: It

[jira] [Commented] (HDDS-3965) SCM failed to start up for duplicated pipeline detected

2020-07-15 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17158827#comment-17158827 ] Sammi Chen commented on HDDS-3965: -- To fix this issue, one solution I can image is keep t

[jira] [Commented] (HDDS-3965) SCM failed to start up for duplicated pipeline detected

2020-07-15 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17158822#comment-17158822 ] Sammi Chen commented on HDDS-3965: -- It doesn't have pipeline remove unsuccessful log duri

[jira] [Resolved] (HDDS-2767) security/SecuringTDE.md

2020-07-15 Thread Xiaoyu Yao (Jira)
[ https://issues.apache.org/jira/browse/HDDS-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDDS-2767. -- Fix Version/s: 0.7.0 Resolution: Fixed Thanks [~iamabug] for the contribution. I've merged the PR

[GitHub] [hadoop-ozone] xiaoyuyao merged pull request #1184: HDDS-2767. security/SecuringTDE.md

2020-07-15 Thread GitBox
xiaoyuyao merged pull request #1184: URL: https://github.com/apache/hadoop-ozone/pull/1184 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop-ozone] arp7 commented on a change in pull request #1196: HDDS-3955. Unable to list intermediate paths on keys created using S3G.

2020-07-15 Thread GitBox
arp7 commented on a change in pull request #1196: URL: https://github.com/apache/hadoop-ozone/pull/1196#discussion_r455445455 ## File path: hadoop-hdds/common/src/main/resources/ozone-default.xml ## @@ -2478,4 +2478,18 @@ rules in Amazon S3's object key naming guide.

[GitHub] [hadoop-ozone] arp7 commented on a change in pull request #1129: HDDS-3741. Reload old OM state if Install Snapshot from Leader fails

2020-07-15 Thread GitBox
arp7 commented on a change in pull request #1129: URL: https://github.com/apache/hadoop-ozone/pull/1129#discussion_r455442847 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OzoneManager.java ## @@ -3041,58 +3047,74 @@ public TermIndex install

[GitHub] [hadoop-ozone] arp7 commented on a change in pull request #1129: HDDS-3741. Reload old OM state if Install Snapshot from Leader fails

2020-07-15 Thread GitBox
arp7 commented on a change in pull request #1129: URL: https://github.com/apache/hadoop-ozone/pull/1129#discussion_r455433582 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/OmMetadataManagerImpl.java ## @@ -249,6 +252,20 @@ public void start(

[GitHub] [hadoop-ozone] bharatviswa504 merged pull request #1205: HDDS-3968. LDB scan fails to read from transactionInfoTable.

2020-07-15 Thread GitBox
bharatviswa504 merged pull request #1205: URL: https://github.com/apache/hadoop-ozone/pull/1205 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[jira] [Comment Edited] (HDDS-3946) s3g multi-upload failed with partName check

2020-07-15 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17158785#comment-17158785 ] Bharat Viswanadham edited comment on HDDS-3946 at 7/15/20, 11:40 PM: ---

[jira] [Comment Edited] (HDDS-3946) s3g multi-upload failed with partName check

2020-07-15 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17158785#comment-17158785 ] Bharat Viswanadham edited comment on HDDS-3946 at 7/15/20, 11:40 PM: ---

[jira] [Commented] (HDDS-3946) s3g multi-upload failed with partName check

2020-07-15 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17158785#comment-17158785 ] Bharat Viswanadham commented on HDDS-3946: -- When a part is uploaded twice, in mul

[jira] [Commented] (HDDS-3967) Remove leftover debug setting

2020-07-15 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17158784#comment-17158784 ] Bharat Viswanadham commented on HDDS-3967: -- [~adoroszlai] Committed this to apach

[GitHub] [hadoop-ozone] bharatviswa504 edited a comment on pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-07-15 Thread GitBox
bharatviswa504 edited a comment on pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#issuecomment-659066783 @adoroszlai Any comments on left over 2 questions. One related to delete bucket and other multiple times of validation of bucket.

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-07-15 Thread GitBox
bharatviswa504 commented on pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#issuecomment-659066783 @adoroszlai Any comments on left over 2 questions. This is an automated message from the Apache Git

[jira] [Updated] (HDDS-3967) Remove leftover debug setting

2020-07-15 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-3967: - Fix Version/s: 0.7.0 Resolution: Fixed Status: Resolved (was: Patch Avai

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1202: HDDS-3967. Remove leftover debug setting

2020-07-15 Thread GitBox
bharatviswa504 commented on pull request #1202: URL: https://github.com/apache/hadoop-ozone/pull/1202#issuecomment-659066324 Thank You @adoroszlai for the contribution. This is an automated message from the Apache Git Service

[GitHub] [hadoop-ozone] bharatviswa504 merged pull request #1202: HDDS-3967. Remove leftover debug setting

2020-07-15 Thread GitBox
bharatviswa504 merged pull request #1202: URL: https://github.com/apache/hadoop-ozone/pull/1202 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1196: HDDS-3955. Unable to list intermediate paths on keys created using S3G.

2020-07-15 Thread GitBox
bharatviswa504 commented on a change in pull request #1196: URL: https://github.com/apache/hadoop-ozone/pull/1196#discussion_r455410736 ## File path: hadoop-ozone/ozone-manager/src/test/java/org/apache/hadoop/ozone/om/request/TestNormalizePaths.java ## @@ -0,0 +1,69 @@ +/* + *

[GitHub] [hadoop-ozone] bharatviswa504 opened a new pull request #1205: HDDS-3968. LDB scan fails to read from transactionInfoTable.

2020-07-15 Thread GitBox
bharatviswa504 opened a new pull request #1205: URL: https://github.com/apache/hadoop-ozone/pull/1205 ## What changes were proposed in this pull request? LDB Scan tool failing to read from transactionInfo table. ``` [root@bv-cml-1 ~]# ozone debug ldb --db=/var/lib/hadoop-ozo

[jira] [Updated] (HDDS-3968) LDB scan fails to read from transactionInfoTable

2020-07-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3968: - Labels: pull-request-available (was: ) > LDB scan fails to read from transactionInfoTable > -

[jira] [Updated] (HDDS-3968) LDB scan fails to read from transactionInfoTable

2020-07-15 Thread Bharat Viswanadham (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham updated HDDS-3968: - Target Version/s: 0.6.0 > LDB scan fails to read from transactionInfoTable > -

[jira] [Created] (HDDS-3968) LDB scan fails to read from transactionInfoTable

2020-07-15 Thread Bharat Viswanadham (Jira)
Bharat Viswanadham created HDDS-3968: Summary: LDB scan fails to read from transactionInfoTable Key: HDDS-3968 URL: https://issues.apache.org/jira/browse/HDDS-3968 Project: Hadoop Distributed Data

[jira] [Updated] (HDDS-3915) Simple trash emptier on OM

2020-07-15 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-3915: - Attachment: Trash Cleanup Designs v1.pdf > Simple trash emptier on OM > -- > >

[jira] [Commented] (HDDS-3965) SCM failed to start up for duplicated pipeline detected

2020-07-15 Thread Nanda kumar (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17158603#comment-17158603 ] Nanda kumar commented on HDDS-3965: --- [~Sammi], do we have the following log line in the 

[jira] [Assigned] (HDDS-3965) SCM failed to start up for duplicated pipeline detected

2020-07-15 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle reassigned HDDS-3965: - Assignee: Prashant Pogde (was: Aravindan Vijayan) > SCM failed to start up for duplicate

[jira] [Updated] (HDDS-3965) SCM failed to start up for duplicated pipeline detected

2020-07-15 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle updated HDDS-3965: -- Description: SCM LOG: {code} 2020-07-15 19:25:09,768 [main] ERROR org.apache.hadoop.hdds.scm.se

[jira] [Updated] (HDDS-3924) Move away from proto serialization for RocksDB keys in Ozone

2020-07-15 Thread Siddharth Wagle (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Wagle updated HDDS-3924: -- Labels: (was: upgrade-p0) > Move away from proto serialization for RocksDB keys in Ozone > ---

[jira] [Updated] (HDDS-3765) Fluentd writing to secure Ozone S3 API fails with 500 Error.

2020-07-15 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-3765: Resolution: Fixed Status: Resolved (was: Patch Available) PR merged. > Fluentd wri

[GitHub] [hadoop-ozone] avijayanhwx merged pull request #1179: HDDS-3765. Fluentd writing to secure Ozone S3 API fails with 500 Error.

2020-07-15 Thread GitBox
avijayanhwx merged pull request #1179: URL: https://github.com/apache/hadoop-ozone/pull/1179 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Updated] (HDDS-3765) Fluentd writing to secure Ozone S3 API fails with 500 Error.

2020-07-15 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-3765: Fix Version/s: 0.6.0 > Fluentd writing to secure Ozone S3 API fails with 500 Error. > --

[jira] [Updated] (HDDS-3925) SCM Pipeline DB should directly use UUID bytes for key rather than rely on proto serialization for key.

2020-07-15 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-3925: Fix Version/s: 0.6.0 > SCM Pipeline DB should directly use UUID bytes for key rather than re

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1196: HDDS-3955. Unable to list intermediate paths on keys created using S3G.

2020-07-15 Thread GitBox
bharatviswa504 commented on a change in pull request #1196: URL: https://github.com/apache/hadoop-ozone/pull/1196#discussion_r455236059 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/OMClientRequest.java ## @@ -265,4 +272,24 @@ public

[GitHub] [hadoop-ozone] adoroszlai closed pull request #1203: HDDS-3964. Ratis config key mismatch

2020-07-15 Thread GitBox
adoroszlai closed pull request #1203: URL: https://github.com/apache/hadoop-ozone/pull/1203 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[GitHub] [hadoop-ozone] avijayanhwx commented on pull request #1179: HDDS-3765. Fluentd writing to secure Ozone S3 API fails with 500 Error.

2020-07-15 Thread GitBox
avijayanhwx commented on pull request #1179: URL: https://github.com/apache/hadoop-ozone/pull/1179#issuecomment-658913179 Thanks for the review @bharatviswa504. This is an automated message from the Apache Git Service. To res

[GitHub] [hadoop-ozone] adoroszlai opened a new pull request #1204: HDDS-3964. Ratis config key mismatch

2020-07-15 Thread GitBox
adoroszlai opened a new pull request #1204: URL: https://github.com/apache/hadoop-ozone/pull/1204 ## What changes were proposed in this pull request? 1. Fix config key mismatch: * `raft.client.rpc.watch.request.timeout` vs. `raft.client.watch.request.timeout` * `raft.server.n

[jira] [Updated] (HDDS-3955) Unable to list intermediate paths on keys created using S3G.

2020-07-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3955: - Labels: pull-request-available (was: ) > Unable to list intermediate paths on keys created using

[GitHub] [hadoop-ozone] avijayanhwx commented on a change in pull request #1196: HDDS-3955. Unable to list intermediate paths on keys created using S3G.

2020-07-15 Thread GitBox
avijayanhwx commented on a change in pull request #1196: URL: https://github.com/apache/hadoop-ozone/pull/1196#discussion_r455231005 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/OMClientRequest.java ## @@ -265,4 +272,24 @@ public Au

[GitHub] [hadoop-ozone] adoroszlai closed pull request #1203: HDDS-3964. Ratis config key mismatch

2020-07-15 Thread GitBox
adoroszlai closed pull request #1203: URL: https://github.com/apache/hadoop-ozone/pull/1203 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[GitHub] [hadoop-ozone] avijayanhwx commented on pull request #1179: HDDS-3765. Fluentd writing to secure Ozone S3 API fails with 500 Error.

2020-07-15 Thread GitBox
avijayanhwx commented on pull request #1179: URL: https://github.com/apache/hadoop-ozone/pull/1179#issuecomment-658905716 In HDDS-3955 we are adding new logic that "normalizes" the key when intermediate directories need to be created on createKey API. This fix is good to go now.

[GitHub] [hadoop-ozone] bharatviswa504 edited a comment on pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-07-15 Thread GitBox
bharatviswa504 edited a comment on pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#issuecomment-658904714 Overall LGTM. Few minor comments/questions, once those are addressed good to go. This is a

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-07-15 Thread GitBox
bharatviswa504 commented on pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#issuecomment-658904714 Overall LGTM. Few minor comments, once those are addressed good to go. This is an automated messa

[jira] [Comment Edited] (HDDS-3966) Intermittent crash in TestOMRatisSnapshots

2020-07-15 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17158544#comment-17158544 ] Attila Doroszlai edited comment on HDDS-3966 at 7/15/20, 5:13 PM: --

[jira] [Commented] (HDDS-3966) Intermittent crash in TestOMRatisSnapshots

2020-07-15 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17158544#comment-17158544 ] Attila Doroszlai commented on HDDS-3966: CC [~bharat], [~hanishakoneru] > Intermi

[jira] [Assigned] (HDDS-3966) Intermittent crash in TestOMRatisSnapshots

2020-07-15 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai reassigned HDDS-3966: -- Assignee: (was: Attila Doroszlai) > Intermittent crash in TestOMRatisSnapshots > --

[GitHub] [hadoop-ozone] avijayanhwx commented on pull request #1182: HDDS-3926. OM Token Identifier table should use in-house serialization.

2020-07-15 Thread GitBox
avijayanhwx commented on pull request #1182: URL: https://github.com/apache/hadoop-ozone/pull/1182#issuecomment-658886217 Please don't merge this since we are testing out upgrade paths. This is an automated message from the A

[GitHub] [hadoop-ozone] avijayanhwx commented on pull request #1182: HDDS-3926. OM Token Identifier table should use in-house serialization.

2020-07-15 Thread GitBox
avijayanhwx commented on pull request #1182: URL: https://github.com/apache/hadoop-ozone/pull/1182#issuecomment-658886283 /pending This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-07-15 Thread GitBox
bharatviswa504 commented on a change in pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#discussion_r455199679 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMAllocateBlockRequest.java ## @@ -172,6 +172,1

[GitHub] [hadoop-ozone] bharatviswa504 edited a comment on pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-07-15 Thread GitBox
bharatviswa504 edited a comment on pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#issuecomment-658868821 > Thanks @bharatviswa504 for the review. I have updated the patch based on your comments. > > > When deleting a bucket, we check bucket is empty or not.

[GitHub] [hadoop-ozone] bharatviswa504 commented on pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-07-15 Thread GitBox
bharatviswa504 commented on pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#issuecomment-658868821 > Thanks @bharatviswa504 for the review. I have updated the patch based on your comments. > > > When deleting a bucket, we check bucket is empty or not. Do we

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-07-15 Thread GitBox
bharatviswa504 commented on a change in pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#discussion_r455147202 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyDeleteRequest.java ## @@ -111,6 +110,10 @@

[jira] [Updated] (HDDS-3964) Ratis config key mismatch

2020-07-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3964: - Labels: pull-request-available (was: ) > Ratis config key mismatch > - >

[GitHub] [hadoop-ozone] adoroszlai opened a new pull request #1203: HDDS-3964. Ratis config key mismatch

2020-07-15 Thread GitBox
adoroszlai opened a new pull request #1203: URL: https://github.com/apache/hadoop-ozone/pull/1203 ## What changes were proposed in this pull request? 1. Fix config key mismatch: * `raft.client.rpc.watch.request.timeout` vs. `raft.client.watch.request.timeout` * `raft.server.n

[GitHub] [hadoop-ozone] bharatviswa504 commented on a change in pull request #1104: HDDS-3612. Allow mounting bucket under other volume

2020-07-15 Thread GitBox
bharatviswa504 commented on a change in pull request #1104: URL: https://github.com/apache/hadoop-ozone/pull/1104#discussion_r455147202 ## File path: hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/request/key/OMKeyDeleteRequest.java ## @@ -111,6 +110,10 @@

[jira] [Assigned] (HDDS-3965) SCM failed to start up for duplicated pipeline detected

2020-07-15 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan reassigned HDDS-3965: --- Assignee: Aravindan Vijayan > SCM failed to start up for duplicated pipeline detected

[jira] [Comment Edited] (HDDS-3965) SCM failed to start up for duplicated pipeline detected

2020-07-15 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17158479#comment-17158479 ] Aravindan Vijayan edited comment on HDDS-3965 at 7/15/20, 3:32 PM: -

[jira] [Commented] (HDDS-3965) SCM failed to start up for duplicated pipeline detected

2020-07-15 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17158479#comment-17158479 ] Aravindan Vijayan commented on HDDS-3965: - [~pifta] may be out. I will take a look

[jira] [Updated] (HDDS-3964) Ratis config key mismatch

2020-07-15 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3964: --- Description: Some of the Ratis configurations in integration tests are not applied due to mis

[GitHub] [hadoop-ozone] adoroszlai merged pull request #1201: HDDS-3798. Display more accurate timestamp in recon Web

2020-07-15 Thread GitBox
adoroszlai merged pull request #1201: URL: https://github.com/apache/hadoop-ozone/pull/1201 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #1201: HDDS-3798. Display more accurate timestamp in recon Web

2020-07-15 Thread GitBox
adoroszlai commented on pull request #1201: URL: https://github.com/apache/hadoop-ozone/pull/1201#issuecomment-658833229 Thanks @runitao for the improvement and @vivekratnavel for the review. This is an automated message from

[jira] [Updated] (HDDS-3960) Display more accurate timestamp in recon Web

2020-07-15 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3960: --- Labels: (was: pull-request-available) > Display more accurate timestamp in recon Web > -

[jira] [Resolved] (HDDS-3960) Display more accurate timestamp in recon Web

2020-07-15 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai resolved HDDS-3960. Fix Version/s: 0.7.0 Target Version/s: (was: 0.7.0) Resolution: Done > Di

[jira] [Updated] (HDDS-3965) SCM failed to start up for duplicated pipeline detected

2020-07-15 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-3965: Labels: upgrade-p0 (was: ) > SCM failed to start up for duplicated pipeline detected >

[jira] [Updated] (HDDS-3965) SCM failed to start up for duplicated pipeline detected

2020-07-15 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-3965: Priority: Blocker (was: Critical) > SCM failed to start up for duplicated pipeline detected

[jira] [Updated] (HDDS-3967) Remove leftover debug setting

2020-07-15 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3967: --- Status: Patch Available (was: In Progress) > Remove leftover debug setting >

[GitHub] [hadoop-ozone] ChenSammi commented on a change in pull request #1190: HDDS-2770. security/SecurityAcls.md

2020-07-15 Thread GitBox
ChenSammi commented on a change in pull request #1190: URL: https://github.com/apache/hadoop-ozone/pull/1190#discussion_r455041823 ## File path: hadoop-hdds/docs/content/security/SecurityAcls.zh.md ## @@ -0,0 +1,66 @@ +--- +title: "Ozone 访问控制列表" +date: "2019-April-03" +weight:

[jira] [Updated] (HDDS-3967) Remove leftover debug setting

2020-07-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3967: - Labels: pull-request-available (was: ) > Remove leftover debug setting >

[GitHub] [hadoop-ozone] adoroszlai opened a new pull request #1202: HDDS-3967. Remove leftover debug setting

2020-07-15 Thread GitBox
adoroszlai opened a new pull request #1202: URL: https://github.com/apache/hadoop-ozone/pull/1202 ## What changes were proposed in this pull request? Remove accidentally added DEBUG log levels. https://issues.apache.org/jira/browse/HDDS-3967 ## How was this patch tested?

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #1101: HDDS-3821. Disable Ozone SPNEGO should not fall back to hadoop.http.a…

2020-07-15 Thread GitBox
adoroszlai commented on pull request #1101: URL: https://github.com/apache/hadoop-ozone/pull/1101#issuecomment-658755342 > This should be removed. Thanks for the confirmation. Created HDDS-3967 for this. Will submit PR soon. ---

[jira] [Created] (HDDS-3967) Remove leftover debug setting

2020-07-15 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-3967: -- Summary: Remove leftover debug setting Key: HDDS-3967 URL: https://issues.apache.org/jira/browse/HDDS-3967 Project: Hadoop Distributed Data Store Issue T

[jira] [Commented] (HDDS-3965) SCM failed to start up for duplicated pipeline detected

2020-07-15 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17158136#comment-17158136 ] Sammi Chen commented on HDDS-3965: -- cc [~pifta], could you take a look at this issue.

[GitHub] [hadoop-ozone] xiaoyuyao commented on pull request #1101: HDDS-3821. Disable Ozone SPNEGO should not fall back to hadoop.http.a…

2020-07-15 Thread GitBox
xiaoyuyao commented on pull request #1101: URL: https://github.com/apache/hadoop-ozone/pull/1101#issuecomment-658750232 This should be removed. Thanks @adoroszlai On Wed, Jul 15, 2020 at 5:40 AM Doroszlai, Attila wrote: > *@adoroszlai* commented on this pull request. > -

  1   2   >