[jira] [Resolved] (HDDS-4037) Incorrect container numberOfKeys and usedBytes in SCM after key deletetion

2020-08-12 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen resolved HDDS-4037. -- Fix Version/s: 0.7.0 Resolution: Fixed > Incorrect container numberOfKeys and usedBytes in SCM af

[GitHub] [hadoop-ozone] rakeshadr removed a comment on pull request #1315: HDDS-4102. Normalize Keypath for lookupKey.

2020-08-12 Thread GitBox
rakeshadr removed a comment on pull request #1315: URL: https://github.com/apache/hadoop-ozone/pull/1315#issuecomment-673281343 Thanks @bharatviswa504 for the contribution. TestOzoneFileSystem#testDeleteCreatesFakeParentDir test is failing with this fix. Please take care this. --

[jira] [Updated] (HDDS-4102) Normalize Keypath for lookupKey

2020-08-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4102: - Labels: pull-request-available (was: ) > Normalize Keypath for lookupKey > --

[GitHub] [hadoop-ozone] rakeshadr commented on pull request #1315: HDDS-4102. Normalize Keypath for lookupKey.

2020-08-12 Thread GitBox
rakeshadr commented on pull request #1315: URL: https://github.com/apache/hadoop-ozone/pull/1315#issuecomment-673281343 Thanks @bharatviswa504 for the contribution. TestOzoneFileSystem#testDeleteCreatesFakeParentDir test is failing with this fix. Please take care this. --

[jira] [Comment Edited] (HDDS-4107) replace scmID with clusterID for container and volume at Datanode side

2020-08-12 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17176745#comment-17176745 ] Glen Geng edited comment on HDDS-4107 at 8/13/20, 3:48 AM: --- Than

[jira] [Commented] (HDDS-4107) replace scmID with clusterID for container and volume at Datanode side

2020-08-12 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17176745#comment-17176745 ] Glen Geng commented on HDDS-4107: - Thanks for looking at this Jira  [~msingh], [~elek] [~

[jira] [Updated] (HDDS-4107) replace scmID with clusterID for container and volume at Datanode side

2020-08-12 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng updated HDDS-4107: Description: The disk layout per volume is as follows: {code:java} ../hdds/VERSION ../hdds/<>/current/<>/<>/

[GitHub] [hadoop-ozone] GlenGeng commented on pull request #1319: HDDS-4107: replace scmID with clusterID for container and volume at Datanode side

2020-08-12 Thread GitBox
GlenGeng commented on pull request #1319: URL: https://github.com/apache/hadoop-ozone/pull/1319#issuecomment-673229696 Thanks for looking at this PR @elek No, this is not a backward-compatible change. We need solve these compatibllity issues before merging 2823 back to master. @nand

[jira] [Commented] (HDDS-3804) Recon start fails with SQL exception with MySQL DB.

2020-08-12 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17176734#comment-17176734 ] Aravindan Vijayan commented on HDDS-3804: - Discovered while working on HDDS-3610.

[jira] [Assigned] (HDDS-3804) Recon start fails with SQL exception with MySQL DB.

2020-08-12 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan reassigned HDDS-3804: --- Assignee: Zheng Huang-Mu (was: Prashant Pogde) > Recon start fails with SQL exceptio

[GitHub] [hadoop-ozone] avijayanhwx edited a comment on pull request #1313: Revert HDDS-3989 & HDDS-3960 from 0.6.0.

2020-08-12 Thread GitBox
avijayanhwx edited a comment on pull request #1313: URL: https://github.com/apache/hadoop-ozone/pull/1313#issuecomment-671627256 > So, these changes need to be brought in with a corresponding MLV (Metadata Layout Version) change? In HDDS-3989, to show more information on Recon, a few

[jira] [Commented] (HDDS-3190) SCM needs to replay RaftLog for recovery

2020-08-12 Thread Li Cheng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17176716#comment-17176716 ] Li Cheng commented on HDDS-3190: [~amaliujia] Hey Rui, Welcome to join ozone community! L

[GitHub] [hadoop-ozone] maobaolong closed pull request #984: HDDS-3654. Let backgroundCreator create pipeline for the support replication factors alternately

2020-08-12 Thread GitBox
maobaolong closed pull request #984: URL: https://github.com/apache/hadoop-ozone/pull/984 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop-ozone] maobaolong commented on pull request #1320: HDDS-4111. Keep the CSI.zh.md consistent with CSI.md

2020-08-12 Thread GitBox
maobaolong commented on pull request #1320: URL: https://github.com/apache/hadoop-ozone/pull/1320#issuecomment-673162434 @runitao @cxorm Thanks for the previous review at https://github.com/apache/hadoop-ozone/pull/1299 , These day, I found that the CSI.md has been updated, so I keep consi

[jira] [Updated] (HDDS-4068) Client should not retry same OM on network connection failure

2020-08-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4068: - Labels: pull-request-available (was: ) > Client should not retry same OM on network connection fa

[GitHub] [hadoop-ozone] hanishakoneru opened a new pull request #1324: HDDS-4068. Client should not retry same OM on network connection failure

2020-08-12 Thread GitBox
hanishakoneru opened a new pull request #1324: URL: https://github.com/apache/hadoop-ozone/pull/1324 ## What changes were proposed in this pull request? On connection failure to an OM, client retries 10 times on same OM before failing over to the next OM. This is not optimal. Client

[GitHub] [hadoop-ozone] fapifta edited a comment on pull request #1291: HDDS-4062. Non rack aware pipelines should not be created if multiple racks are alive

2020-08-12 Thread GitBox
fapifta edited a comment on pull request #1291: URL: https://github.com/apache/hadoop-ozone/pull/1291#issuecomment-673155132 Hi @sodonnel, the changeset looks good to me, I am +1 on committing it, though it is non-binding :) There is one thing I would change, but as this imple

[GitHub] [hadoop-ozone] fapifta commented on pull request #1291: HDDS-4062. Non rack aware pipelines should not be created if multiple racks are alive

2020-08-12 Thread GitBox
fapifta commented on pull request #1291: URL: https://github.com/apache/hadoop-ozone/pull/1291#issuecomment-673155132 Hi @sodonnel, the changeset looks good to me, I am +1 on committing it, though it is non-binding :) There is one thing I would change, but as this implementati

[GitHub] [hadoop-ozone] fapifta commented on a change in pull request #1291: HDDS-4062. Non rack aware pipelines should not be created if multiple racks are alive

2020-08-12 Thread GitBox
fapifta commented on a change in pull request #1291: URL: https://github.com/apache/hadoop-ozone/pull/1291#discussion_r469591762 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/PipelinePlacementPolicy.java ## @@ -163,9 +163,42 @@ int curr

[GitHub] [hadoop-ozone] fapifta commented on a change in pull request #1291: HDDS-4062. Non rack aware pipelines should not be created if multiple racks are alive

2020-08-12 Thread GitBox
fapifta commented on a change in pull request #1291: URL: https://github.com/apache/hadoop-ozone/pull/1291#discussion_r469591762 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/PipelinePlacementPolicy.java ## @@ -163,9 +163,42 @@ int curr

[GitHub] [hadoop-ozone] maobaolong closed pull request #984: HDDS-3654. Let backgroundCreator create pipeline for the support replication factors alternately

2020-08-12 Thread GitBox
maobaolong closed pull request #984: URL: https://github.com/apache/hadoop-ozone/pull/984 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop-ozone] maobaolong opened a new pull request #984: HDDS-3654. Let backgroundCreator create pipeline for the support replication factors alternately

2020-08-12 Thread GitBox
maobaolong opened a new pull request #984: URL: https://github.com/apache/hadoop-ozone/pull/984 ## What changes were proposed in this pull request? https://docs.google.com/document/d/1YfN5IOckveREuwFWJvWJNHnySo2qSqsQ0e_sxE7XatY/edit?usp=sharing ## What is the link to the Apach

[jira] [Updated] (HDDS-4068) Client should not retry same OM on network connection failure

2020-08-12 Thread Hanisha Koneru (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDDS-4068: - Summary: Client should not retry same OM on network connection failure (was: Client Retry for ipc

[jira] [Created] (HDDS-4113) Intermittent failure in TestSCMSafeModeManager#testPipelinesNotCreatedUntilPreCheckPasses

2020-08-12 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-4113: -- Summary: Intermittent failure in TestSCMSafeModeManager#testPipelinesNotCreatedUntilPreCheckPasses Key: HDDS-4113 URL: https://issues.apache.org/jira/browse/HDDS-4113

[jira] [Assigned] (HDDS-4068) Client Retry for ipc.client.connect.max.retries when first OM is down

2020-08-12 Thread Hanisha Koneru (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru reassigned HDDS-4068: Assignee: Hanisha Koneru > Client Retry for ipc.client.connect.max.retries when first OM is

[GitHub] [hadoop-ozone] nandakumar131 commented on a change in pull request #1291: HDDS-4062. Non rack aware pipelines should not be created if multiple racks are alive

2020-08-12 Thread GitBox
nandakumar131 commented on a change in pull request #1291: URL: https://github.com/apache/hadoop-ozone/pull/1291#discussion_r469468744 ## File path: hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/pipeline/PipelinePlacementPolicy.java ## @@ -163,9 +163,42 @@ in

[jira] [Resolved] (HDDS-4099) No Log4j 2 configuration file found error appears in CLI

2020-08-12 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai resolved HDDS-4099. Fix Version/s: 0.7.0 Resolution: Fixed > No Log4j 2 configuration file found error ap

[jira] [Updated] (HDDS-4099) No Log4j 2 configuration file found error appears in CLI

2020-08-12 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-4099: --- Labels: (was: pull-request-available) > No Log4j 2 configuration file found error appears in

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #1318: HDDS-4099. No Log4j 2 configuration file found error appears in CLI

2020-08-12 Thread GitBox
adoroszlai commented on pull request #1318: URL: https://github.com/apache/hadoop-ozone/pull/1318#issuecomment-673022486 Thanks @avijayanhwx for the review. This is an automated message from the Apache Git Service. To respond

[GitHub] [hadoop-ozone] adoroszlai merged pull request #1318: HDDS-4099. No Log4j 2 configuration file found error appears in CLI

2020-08-12 Thread GitBox
adoroszlai merged pull request #1318: URL: https://github.com/apache/hadoop-ozone/pull/1318 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[GitHub] [hadoop-ozone] amaliujia commented on a change in pull request #1304: HDDS-1745. Add integration test for createDirectory for OM HA

2020-08-12 Thread GitBox
amaliujia commented on a change in pull request #1304: URL: https://github.com/apache/hadoop-ozone/pull/1304#discussion_r469430046 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/om/TestOzoneManagerHAMetadataOnly.java ## @@ -348,6 +362,57 @@ p

[GitHub] [hadoop-ozone] errose28 commented on a change in pull request #1298: HDDS-3869. Use different column families for datanode block and metadata

2020-08-12 Thread GitBox
errose28 commented on a change in pull request #1298: URL: https://github.com/apache/hadoop-ozone/pull/1298#discussion_r469432044 ## File path: hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/keyvalue/helpers/KeyValueContainerUtil.java ## @@ -91,8

[GitHub] [hadoop-ozone] amaliujia commented on a change in pull request #1304: HDDS-1745. Add integration test for createDirectory for OM HA

2020-08-12 Thread GitBox
amaliujia commented on a change in pull request #1304: URL: https://github.com/apache/hadoop-ozone/pull/1304#discussion_r469430046 ## File path: hadoop-ozone/integration-test/src/test/java/org/apache/hadoop/ozone/om/TestOzoneManagerHAMetadataOnly.java ## @@ -348,6 +362,57 @@ p

[GitHub] [hadoop-ozone] errose28 commented on a change in pull request #1298: HDDS-3869. Use different column families for datanode block and metadata

2020-08-12 Thread GitBox
errose28 commented on a change in pull request #1298: URL: https://github.com/apache/hadoop-ozone/pull/1298#discussion_r469425566 ## File path: hadoop-hdds/container-service/src/main/java/org/apache/hadoop/ozone/container/keyvalue/helpers/KeyValueContainerUtil.java ## @@ -91,8

[GitHub] [hadoop-ozone] adoroszlai merged pull request #1317: HDDS-4108. ozone debug ldb scan without arguments results in core dump

2020-08-12 Thread GitBox
adoroszlai merged pull request #1317: URL: https://github.com/apache/hadoop-ozone/pull/1317 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[jira] [Updated] (HDDS-4108) ozone debug ldb scan without arguments results in core dump

2020-08-12 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-4108: --- Fix Version/s: 0.7.0 Resolution: Fixed Status: Resolved (was: Patch Availabl

[jira] [Updated] (HDDS-4108) ozone debug ldb scan without arguments results in core dump

2020-08-12 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-4108: --- Labels: (was: pull-request-available) > ozone debug ldb scan without arguments results in co

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #1317: HDDS-4108. ozone debug ldb scan without arguments results in core dump

2020-08-12 Thread GitBox
adoroszlai commented on pull request #1317: URL: https://github.com/apache/hadoop-ozone/pull/1317#issuecomment-673008558 Thanks @bshashikant for the review. This is an automated message from the Apache Git Service. To respond

[jira] [Commented] (HDDS-4107) replace scmID with clusterID for container and volume at Datanode side

2020-08-12 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17176441#comment-17176441 ] Mukul Kumar Singh commented on HDDS-4107: - [~glengeng], this change will be backwa

[GitHub] [hadoop-ozone] maobaolong commented on pull request #1323: HDDS-4112. Improve SCM webui page performance

2020-08-12 Thread GitBox
maobaolong commented on pull request #1323: URL: https://github.com/apache/hadoop-ozone/pull/1323#issuecomment-672928782 @elek Please take a look at this PR, thank you. This is an automated message from the Apache Git Service

[jira] [Updated] (HDDS-4112) Improve SCM webui page performance

2020-08-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4112: - Labels: pull-request-available (was: ) > Improve SCM webui page performance > ---

[GitHub] [hadoop-ozone] maobaolong opened a new pull request #1323: HDDS-4112. Improve SCM webui page performance

2020-08-12 Thread GitBox
maobaolong opened a new pull request #1323: URL: https://github.com/apache/hadoop-ozone/pull/1323 ## What changes were proposed in this pull request? Improve SCM webui page performance ## What is the link to the Apache JIRA HDDS-4112 ## How was this patch tested?

[jira] [Updated] (HDDS-4112) Improve SCM webui page performance

2020-08-12 Thread maobaolong (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] maobaolong updated HDDS-4112: - Description: The current scm page now send two jmx request, get the same result. One is jmx?qry=Hadoop:ser

[jira] [Created] (HDDS-4112) Improve SCM webui page performance

2020-08-12 Thread maobaolong (Jira)
maobaolong created HDDS-4112: Summary: Improve SCM webui page performance Key: HDDS-4112 URL: https://issues.apache.org/jira/browse/HDDS-4112 Project: Hadoop Distributed Data Store Issue Type: Im

[jira] [Updated] (HDDS-3829) Introduce Layout Feature interface in Ozone.

2020-08-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3829: - Labels: pull-request-available (was: ) > Introduce Layout Feature interface in Ozone. > -

[GitHub] [hadoop-ozone] avijayanhwx opened a new pull request #1322: HDDS-3829. Introduce Layout Feature interface in Ozone.

2020-08-12 Thread GitBox
avijayanhwx opened a new pull request #1322: URL: https://github.com/apache/hadoop-ozone/pull/1322 ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## What is the link to the Apache JIRA (Please create an issue in ASF JIRA

[jira] [Updated] (HDDS-4009) Recon Overview page: The volume, bucket and key counts are not accurate

2020-08-12 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-4009: Fix Version/s: 0.7.0 > Recon Overview page: The volume, bucket and key counts are not accura

[jira] [Updated] (HDDS-4009) Recon Overview page: The volume, bucket and key counts are not accurate

2020-08-12 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-4009: Resolution: Fixed Status: Resolved (was: Patch Available) Github PR merged. > Reco

[jira] [Updated] (HDDS-3960) Display more accurate timestamp in recon Web

2020-08-12 Thread Aravindan Vijayan (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravindan Vijayan updated HDDS-3960: Fix Version/s: (was: 0.6.0) 0.7.0 > Display more accurate timestamp i

[GitHub] [hadoop-ozone] avijayanhwx merged pull request #1305: HDDS-4009. Recon Overview page: The volume, bucket and key counts are not accurate

2020-08-12 Thread GitBox
avijayanhwx merged pull request #1305: URL: https://github.com/apache/hadoop-ozone/pull/1305 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hadoop-ozone] avijayanhwx merged pull request #1313: Revert HDDS-3989 & HDDS-3960 from 0.6.0.

2020-08-12 Thread GitBox
avijayanhwx merged pull request #1313: URL: https://github.com/apache/hadoop-ozone/pull/1313 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [hadoop-ozone] avijayanhwx commented on pull request #1313: Revert HDDS-3798 & HDDS-3960 from 0.6.0.

2020-08-12 Thread GitBox
avijayanhwx commented on pull request #1313: URL: https://github.com/apache/hadoop-ozone/pull/1313#issuecomment-672899704 > Hi @avijayanhwx , I'm OK with the revert. Just need to confirm with you that, the reverted commits are [HDDS-3989](https://issues.apache.org/jira/browse/HDDS-3989) an

[GitHub] [hadoop-ozone] ChenSammi opened a new pull request #1321: Ozone 0.6.0 trigger new CI check

2020-08-12 Thread GitBox
ChenSammi opened a new pull request #1321: URL: https://github.com/apache/hadoop-ozone/pull/1321 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

[GitHub] [hadoop-ozone] github-actions[bot] commented on pull request #1295: HDDS-4037. Incorrect container numberOfKeys and usedBytes in SCM after key deletion

2020-08-12 Thread GitBox
github-actions[bot] commented on pull request #1295: URL: https://github.com/apache/hadoop-ozone/pull/1295#issuecomment-672894915 To re-run CI checks, please follow these steps with the source branch checked out: ``` git commit --allow-empty -m 'trigger new CI check' git push ``

[GitHub] [hadoop-ozone] ChenSammi commented on pull request #1295: HDDS-4037. Incorrect container numberOfKeys and usedBytes in SCM after key deletion

2020-08-12 Thread GitBox
ChenSammi commented on pull request #1295: URL: https://github.com/apache/hadoop-ozone/pull/1295#issuecomment-672894409 /retest This is an automated message from the Apache Git Service. To respond to the message, please log o

[jira] [Resolved] (HDDS-698) Support Topology Awareness for Ozone

2020-08-12 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen resolved HDDS-698. - Resolution: Fixed > Support Topology Awareness for Ozone > > >

[jira] [Commented] (HDDS-698) Support Topology Awareness for Ozone

2020-08-12 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17176354#comment-17176354 ] Sammi Chen commented on HDDS-698: - [~sodonnell] thanks for the reminder. I will close this

[jira] [Updated] (HDDS-4040) [OFS] BasicRootedOzoneFileSystem to support batchDelete

2020-08-12 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-4040: - Fix Version/s: (was: 0.7.0) 0.6.0 > [OFS] BasicRootedOzoneFileSystem to support bat

[jira] [Updated] (HDDS-4040) [OFS] BasicRootedOzoneFileSystem to support batchDelete

2020-08-12 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-4040: - Resolution: Fixed Status: Resolved (was: Patch Available) > [OFS] BasicRootedOzoneFileSystem to s

[jira] [Updated] (HDDS-4111) Keep the CSI.zh.md consistent with CSI.md

2020-08-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4111: - Labels: pull-request-available (was: ) > Keep the CSI.zh.md consistent with CSI.md > ---

[GitHub] [hadoop-ozone] maobaolong opened a new pull request #1320: HDDS-4111. Keep the CSI.zh.md consistent with CSI.md

2020-08-12 Thread GitBox
maobaolong opened a new pull request #1320: URL: https://github.com/apache/hadoop-ozone/pull/1320 ## What changes were proposed in this pull request? Keep the CSI.zh.md consistent with CSI.md ## What is the link to the Apache JIRA HDDS-4111 ## How was this patch t

[jira] [Created] (HDDS-4111) Keep the CSI.zh.md consistent with CSI.md

2020-08-12 Thread maobaolong (Jira)
maobaolong created HDDS-4111: Summary: Keep the CSI.zh.md consistent with CSI.md Key: HDDS-4111 URL: https://issues.apache.org/jira/browse/HDDS-4111 Project: Hadoop Distributed Data Store Issue

[GitHub] [hadoop-ozone] ChenSammi merged pull request #1295: HDDS-4037. Incorrect container numberOfKeys and usedBytes in SCM after key deletion

2020-08-12 Thread GitBox
ChenSammi merged pull request #1295: URL: https://github.com/apache/hadoop-ozone/pull/1295 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hadoop-ozone] ChenSammi commented on pull request #1295: HDDS-4037. Incorrect container numberOfKeys and usedBytes in SCM after key deletion

2020-08-12 Thread GitBox
ChenSammi commented on pull request #1295: URL: https://github.com/apache/hadoop-ozone/pull/1295#issuecomment-672834932 Thanks @adoroszlai for review the code. This is an automated message from the Apache Git Service. To res

[GitHub] [hadoop-ozone] elek commented on pull request #1319: HDDS-4107: replace scmID with clusterID for container and volume at Datanode side

2020-08-12 Thread GitBox
elek commented on pull request #1319: URL: https://github.com/apache/hadoop-ozone/pull/1319#issuecomment-672833492 Thanks the patch @GlenGeng I don't follow SCM-HA development very closely, but is it a backward-compatible change? ---

[jira] [Resolved] (HDDS-3834) We need a edge(master) docs website updated by nightly build

2020-08-12 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek resolved HDDS-3834. --- Fix Version/s: 0.7.0 Resolution: Fixed > We need a edge(master) docs website updated by nightly

[jira] [Assigned] (HDDS-3834) We need a edge(master) docs website updated by nightly build

2020-08-12 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek reassigned HDDS-3834: - Assignee: maobaolong (was: Marton Elek) > We need a edge(master) docs website updated by nightly

[jira] [Assigned] (HDDS-3834) We need a edge(master) docs website updated by nightly build

2020-08-12 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek reassigned HDDS-3834: - Assignee: Marton Elek > We need a edge(master) docs website updated by nightly build > --

[jira] [Commented] (HDDS-3834) We need a edge(master) docs website updated by nightly build

2020-08-12 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17176298#comment-17176298 ] Marton Elek commented on HDDS-3834: --- Merged. Thanks the contribution. Let me close this

[jira] [Updated] (HDDS-3834) We need a edge(master) docs website updated by nightly build

2020-08-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3834: - Labels: pull-request-available (was: ) > We need a edge(master) docs website updated by nightly b

[GitHub] [hadoop-ozone] ChenSammi commented on pull request #1313: Revert HDDS-3798 & HDDS-3960 from 0.6.0.

2020-08-12 Thread GitBox
ChenSammi commented on pull request #1313: URL: https://github.com/apache/hadoop-ozone/pull/1313#issuecomment-672828578 Hi @avijayanhwx , I'm OK with the revert. Just need to confirm with you that, the reverted commits are HDDS-3989 and HDDS-3960, not the HDDS-3798, or the HDDS-3978, rig

[jira] [Updated] (HDDS-4108) ozone debug ldb scan without arguments results in core dump

2020-08-12 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-4108: --- Status: Patch Available (was: In Progress) > ozone debug ldb scan without arguments results i

[jira] [Updated] (HDDS-4107) replace scmID with clusterID for container and volume at Datanode side

2020-08-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4107: - Labels: pull-request-available (was: ) > replace scmID with clusterID for container and volume at

[GitHub] [hadoop-ozone] GlenGeng opened a new pull request #1319: HDDS-4107: replace scmID with clusterID for container and volume at Datanode side

2020-08-12 Thread GitBox
GlenGeng opened a new pull request #1319: URL: https://github.com/apache/hadoop-ozone/pull/1319 ## What changes were proposed in this pull request? The disk layout per volume is as follows: ``` ../hdds/VERSION ../hdds/<>/current/<>/<>/metadata ../hdds/<>/current/<>/<>/<>

[GitHub] [hadoop-ozone] adoroszlai commented on a change in pull request #1290: HDDS-4064. Show container verbose info with verbose option

2020-08-12 Thread GitBox
adoroszlai commented on a change in pull request #1290: URL: https://github.com/apache/hadoop-ozone/pull/1290#discussion_r469183542 ## File path: hadoop-hdds/tools/src/main/java/org/apache/hadoop/hdds/scm/cli/container/InfoSubcommand.java ## @@ -52,6 +53,10 @@ @Parameters(d

[jira] [Updated] (HDDS-3232) Include the byteman scripts in the distribution tar file

2020-08-12 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-3232: --- Labels: (was: pull-request-available) > Include the byteman scripts in the distribution tar

[jira] [Resolved] (HDDS-3232) Include the byteman scripts in the distribution tar file

2020-08-12 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai resolved HDDS-3232. Fix Version/s: 0.7.0 Resolution: Implemented > Include the byteman scripts in the dis

[GitHub] [hadoop-ozone] adoroszlai merged pull request #1309: HDDS-3232. Include the byteman scripts in the distribution tar file

2020-08-12 Thread GitBox
adoroszlai merged pull request #1309: URL: https://github.com/apache/hadoop-ozone/pull/1309 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[jira] [Resolved] (HDDS-4095) Byteman script to debug HCFS performance

2020-08-12 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai resolved HDDS-4095. Fix Version/s: 0.7.0 Resolution: Implemented > Byteman script to debug HCFS performan

[jira] [Updated] (HDDS-4095) Byteman script to debug HCFS performance

2020-08-12 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-4095: --- Labels: (was: pull-request-available) > Byteman script to debug HCFS performance > -

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #1311: HDDS-4095. Byteman script to debug HCFS performance

2020-08-12 Thread GitBox
adoroszlai commented on pull request #1311: URL: https://github.com/apache/hadoop-ozone/pull/1311#issuecomment-672789261 Thanks @elek for the contribution. This is an automated message from the Apache Git Service. To respond

[GitHub] [hadoop-ozone] adoroszlai merged pull request #1311: HDDS-4095. Byteman script to debug HCFS performance

2020-08-12 Thread GitBox
adoroszlai merged pull request #1311: URL: https://github.com/apache/hadoop-ozone/pull/1311 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #1283: HDDS-4057. Failed acceptance test missing from bundle

2020-08-12 Thread GitBox
adoroszlai commented on pull request #1283: URL: https://github.com/apache/hadoop-ozone/pull/1283#issuecomment-672787744 Thanks @elek for reviewing and committing it. This is an automated message from the Apache Git Service.

[jira] [Updated] (HDDS-4057) Failed acceptance test missing from bundle

2020-08-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4057: - Labels: pull-request-available (was: ) > Failed acceptance test missing from bundle > ---

[jira] [Updated] (HDDS-4057) Failed acceptance test missing from bundle

2020-08-12 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-4057: --- Labels: (was: pull-request-available) > Failed acceptance test missing from bundle > ---

[jira] [Updated] (HDDS-4057) Failed acceptance test missing from bundle

2020-08-12 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-4057: --- Fix Version/s: 0.7.0 Resolution: Fixed Status: Resolved (was: Patch Availabl

[jira] [Updated] (HDDS-4100) Reorganize compose environments

2020-08-12 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-4100: --- Fix Version/s: (was: 0.7.0) > Reorganize compose environments > --

[jira] [Reopened] (HDDS-4100) Reorganize compose environments

2020-08-12 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai reopened HDDS-4100: > Reorganize compose environments > --- > > Key: HDD

[jira] [Updated] (HDDS-4099) No Log4j 2 configuration file found error appears in CLI

2020-08-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4099: - Labels: pull-request-available (was: ) > No Log4j 2 configuration file found error appears in CLI

[GitHub] [hadoop-ozone] adoroszlai opened a new pull request #1318: HDDS-4099. No Log4j 2 configuration file found error appears in CLI

2020-08-12 Thread GitBox
adoroszlai opened a new pull request #1318: URL: https://github.com/apache/hadoop-ozone/pull/1318 ## What changes were proposed in this pull request? e219aae7c added Recon as a dependency for Ozone Tools. Recon's Spring dependency initializes Log4J 2 logging. But Ozone Tools does

[jira] [Resolved] (HDDS-4100) Reorganize compose environments

2020-08-12 Thread Marton Elek (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marton Elek resolved HDDS-4100. --- Fix Version/s: 0.7.0 Resolution: Fixed > Reorganize compose environments >

[GitHub] [hadoop-ozone] elek merged pull request #1283: HDDS-4057. Failed acceptance test missing from bundle

2020-08-12 Thread GitBox
elek merged pull request #1283: URL: https://github.com/apache/hadoop-ozone/pull/1283 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [hadoop-ozone] elek commented on pull request #1283: HDDS-4057. Failed acceptance test missing from bundle

2020-08-12 Thread GitBox
elek commented on pull request #1283: URL: https://github.com/apache/hadoop-ozone/pull/1283#issuecomment-672782797 > test.sh execution also needs to "ignore" errors, otherwise we may not reach rebot. Yes, that's a good question. The scripts of `hadoop-ozone/dev-support/checks/*.sh`

[GitHub] [hadoop-ozone] bshashikant commented on pull request #1154: HDDS-3867. Extend the chunkinfo tool to display information from all nodes in the pipeline.

2020-08-12 Thread GitBox
bshashikant commented on pull request #1154: URL: https://github.com/apache/hadoop-ozone/pull/1154#issuecomment-672774125 > > @elek , I feel if we can go ahead with this change and then try to remove XceiverClient interface altogether in a separte jira. Your thoughts?? > > We need so

[jira] [Updated] (HDDS-4108) ozone debug ldb scan without arguments results in core dump

2020-08-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-4108: - Labels: pull-request-available (was: ) > ozone debug ldb scan without arguments results in core d

[GitHub] [hadoop-ozone] adoroszlai opened a new pull request #1317: HDDS-4108. ozone debug ldb scan without arguments results in core dump

2020-08-12 Thread GitBox
adoroszlai opened a new pull request #1317: URL: https://github.com/apache/hadoop-ozone/pull/1317 ## What changes were proposed in this pull request? Make `--db` mandatory for `ozone debug ldb` command to avoid segmentation fault in RocksDB call. Also make `--column_family` ma

[jira] [Created] (HDDS-4110) Intermittent failure in TestEndpoints#testGetDatanodes

2020-08-12 Thread Attila Doroszlai (Jira)
Attila Doroszlai created HDDS-4110: -- Summary: Intermittent failure in TestEndpoints#testGetDatanodes Key: HDDS-4110 URL: https://issues.apache.org/jira/browse/HDDS-4110 Project: Hadoop Distributed Dat

[GitHub] [hadoop-ozone] smengcl commented on pull request #1316: HDDS-4109. Tests in TestOzoneFileSystem should use the existing MiniOzoneCluster

2020-08-12 Thread GitBox
smengcl commented on pull request #1316: URL: https://github.com/apache/hadoop-ozone/pull/1316#issuecomment-672748710 > > 4 new tests have been added since [HDDS-2883](https://issues.apache.org/jira/browse/HDDS-2883) and are not sharing that MiniOzoneCluster. > > I think it's [HDDS-

[GitHub] [hadoop-ozone] adoroszlai commented on pull request #1316: HDDS-4109. Tests in TestOzoneFileSystem should use the existing MiniOzoneCluster

2020-08-12 Thread GitBox
adoroszlai commented on pull request #1316: URL: https://github.com/apache/hadoop-ozone/pull/1316#issuecomment-672728306 > 4 new tests have been added since [HDDS-2883](https://issues.apache.org/jira/browse/HDDS-2883) and are not sharing that MiniOzoneCluster. I think it's HDDS-2833

[jira] [Updated] (HDDS-4109) Tests in TestOzoneFileSystem should use the existing MiniOzoneCluster

2020-08-12 Thread Attila Doroszlai (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Attila Doroszlai updated HDDS-4109: --- Description: In HDDS-2833, [~adoroszlai] made a change that greatly reduces the run time of t

  1   2   >