[GitHub] [hadoop-ozone] mukul1987 merged pull request #1160: HDDS-3900: Update default value of 'ozone.om.ratis.segment.size' and …

2020-07-04 Thread GitBox
mukul1987 merged pull request #1160: URL: https://github.com/apache/hadoop-ozone/pull/1160 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Resolved] (HDDS-3900) Update default value of 'ozone.om.ratis.segment.size' and 'preallocated.size' to improve OM write perf

2020-07-04 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh resolved HDDS-3900. - Fix Version/s: 0.6.0 Resolution: Fixed > Update default value of 'ozone.om.ratis.se

[jira] [Commented] (HDDS-3900) Update default value of 'ozone.om.ratis.segment.size' and 'preallocated.size' to improve OM write perf

2020-07-04 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17151389#comment-17151389 ] Mukul Kumar Singh commented on HDDS-3900: - Thanks for the contribution [~rakeshr],

[GitHub] [hadoop-ozone] esahekmat commented on a change in pull request #1023: HDDS-3718: Improve OmKeyLocationInfoGroup internal data structure

2020-07-04 Thread GitBox
esahekmat commented on a change in pull request #1023: URL: https://github.com/apache/hadoop-ozone/pull/1023#discussion_r449776213 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/helpers/OmKeyLocationInfoGroup.java ## @@ -30,12 +30,23 @@ */ public

[GitHub] [hadoop-ozone] esahekmat commented on a change in pull request #1023: HDDS-3718: Improve OmKeyLocationInfoGroup internal data structure

2020-07-04 Thread GitBox
esahekmat commented on a change in pull request #1023: URL: https://github.com/apache/hadoop-ozone/pull/1023#discussion_r449776133 ## File path: hadoop-ozone/common/src/main/java/org/apache/hadoop/ozone/om/helpers/OmKeyLocationInfoGroup.java ## @@ -30,12 +30,23 @@ */ public

[jira] [Updated] (HDDS-3920) Too many redudant replications due to fail to get node's ancestor in ReplicationManager

2020-07-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3920: - Labels: pull-request-available (was: ) > Too many redudant replications due to fail to get node's

[GitHub] [hadoop-ozone] ChenSammi opened a new pull request #1163: HDDS-3920. Too many redudant replications due to fail to get node's a…

2020-07-04 Thread GitBox
ChenSammi opened a new pull request #1163: URL: https://github.com/apache/hadoop-ozone/pull/1163 https://issues.apache.org/jira/browse/HDDS-3920 With the patch, over-replicated replicas are deleted by ReplicationManager. The total containers on each datanode drops from 80K~ to 8K~

[jira] [Updated] (HDDS-3921) IllegalArgumentException triggered in SCMContainerPlacementRackAware.chooseDatanodes

2020-07-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-3921: - Labels: pull-request-available (was: ) > IllegalArgumentException triggered in > SCMContainerPla

[GitHub] [hadoop-ozone] ChenSammi opened a new pull request #1162: HDDS-3921. IllegalArgumentException triggered in SCMContainerPlacemen…

2020-07-04 Thread GitBox
ChenSammi opened a new pull request #1162: URL: https://github.com/apache/hadoop-ozone/pull/1162 https://issues.apache.org/jira/browse/HDDS-3921 This is an automated message from the Apache Git Service. To respond to the mess

[jira] [Updated] (HDDS-3921) IllegalArgumentException triggered in SCMContainerPlacementRackAware.chooseDatanodes

2020-07-04 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3921: - Target Version/s: 0.7.0 > IllegalArgumentException triggered in > SCMContainerPlacementRackAware.chooseDa

[jira] [Updated] (HDDS-3921) IllegalArgumentException triggered in SCMContainerPlacementRackAware.chooseDatanodes

2020-07-04 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3921: - Description: The root cause is existing replicas plus replicas in replicationInFlight meet the crossing r

[jira] [Created] (HDDS-3921) IllegalArgumentException triggered in SCMContainerPlacementRackAware.chooseDatanodes

2020-07-04 Thread Sammi Chen (Jira)
Sammi Chen created HDDS-3921: Summary: IllegalArgumentException triggered in SCMContainerPlacementRackAware.chooseDatanodes Key: HDDS-3921 URL: https://issues.apache.org/jira/browse/HDDS-3921 Project: Had

[jira] [Assigned] (HDDS-3921) IllegalArgumentException triggered in SCMContainerPlacementRackAware.chooseDatanodes

2020-07-04 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen reassigned HDDS-3921: Assignee: Sammi Chen > IllegalArgumentException triggered in > SCMContainerPlacementRackAware.choo

[jira] [Assigned] (HDDS-3920) Too many redudant replications due to fail to get node's ancestor in ReplicationManager

2020-07-04 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen reassigned HDDS-3920: Assignee: Sammi Chen > Too many redudant replications due to fail to get node's ancestor in > Repl

[jira] [Updated] (HDDS-3920) Too many redudant replications due to fail to get node's ancestor in ReplicationManager

2020-07-04 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3920: - Description: In our production cluster, we turn on the network topology configuraiton. Due to fail to ge

[jira] [Updated] (HDDS-3920) Too many redudant replications due to fail to get node's ancestor in ReplicationManager

2020-07-04 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3920: - Description: In our production cluster, we turn on the network topology configuraiton. Due to fail to ge

[jira] [Updated] (HDDS-3920) Too many redudant replications due to fail to get node's ancestor in ReplicationManager

2020-07-04 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3920: - Attachment: over-replicated-container-list.txt > Too many redudant replications due to fail to get node's

[jira] [Updated] (HDDS-3920) Too many redudant replications due to fail to get node's ancestor in ReplicationManager

2020-07-04 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3920: - Description: 2020-07-03 16:26:45,200 [ReplicationMonitor] INFO org.apache.hadoop.hdds.scm.container.Repli

[jira] [Updated] (HDDS-3920) Too many redudant replications due to fail to get node's ancestor in ReplicationManager

2020-07-04 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3920: - Summary: Too many redudant replications due to fail to get node's ancestor in ReplicationManager (was: Re

[jira] [Updated] (HDDS-3920) Redudant replications due to fail to get node's ancestor in ReplicationManager

2020-07-04 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-3920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-3920: - Description: 2020-07-03 16:26:45,200 [ReplicationMonitor] INFO org.apache.hadoop.hdds.scm.container.Repli