[GitHub] [hadoop-ozone] sodonnel commented on pull request #1339: HDDS-4131. Container report should update container key count and bytes used if they differ in SCM

2020-08-21 Thread GitBox
sodonnel commented on pull request #1339: URL: https://github.com/apache/hadoop-ozone/pull/1339#issuecomment-678312913 > Basically AbstractContainerReportHandler is not the perfect place to handle this because it doesn't have a global view while Replication Manager has.

[jira] [Updated] (HDDS-4023) Delete closed container after all blocks have been deleted

2020-08-21 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-4023: - Description: One of our use case is customers delete old objects and files regularly. Once the old

[jira] [Updated] (HDDS-4023) Delete closed container after all blocks have been deleted

2020-08-21 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-4023: - Description: One of our use case is customers delete old objects and files regularly. Once the old

[jira] [Updated] (HDDS-4023) Delete closed container after all blocks have been deleted

2020-08-21 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-4023: - Description: One of our use case is customers delete old objects and files regularly. Once the old

[jira] [Updated] (HDDS-4023) Delete closed container after all blocks have been deleted

2020-08-21 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-4023: - Description: One of our use case is customers delete old objects and files regularly. Once the old

[jira] [Updated] (HDDS-4023) Delete closed container after all blocks have been deleted

2020-08-21 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-4023: - Description: One of our use case is customers delete old objects and files regularly. Once the old

[jira] [Updated] (HDDS-4023) Delete closed container after all blocks have been deleted

2020-08-21 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-4023: - Description: One of our use case is customers delete old objects and files regularly. Once the old

[jira] [Updated] (HDDS-4023) Delete closed container after all blocks have been deleted

2020-08-21 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-4023: - Description: One of our use case is customers delete old objects and files regularly. Once the old

[jira] [Updated] (HDDS-4023) Delete closed container after all blocks have been deleted

2020-08-21 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-4023: - Description: One of our use case is customers delete old objects and files regularly. Once the old

[jira] [Updated] (HDDS-4023) Delete closed container after all blocks have been deleted

2020-08-21 Thread Sammi Chen (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sammi Chen updated HDDS-4023: - Description: One of our use case is customers delete old objects and files regularly. Once the old

[GitHub] [hadoop-ozone] ChenSammi edited a comment on pull request #1338: HDDS-4023. Delete closed container after all blocks have been deleted.

2020-08-21 Thread GitBox
ChenSammi edited a comment on pull request #1338: URL: https://github.com/apache/hadoop-ozone/pull/1338#issuecomment-678126933 Hi @sodonnel thanks for review the code and initiate the discussion. > I wonder if it would be simpler to remove empty containers as part of Container

[GitHub] [hadoop-ozone] ChenSammi commented on pull request #1338: HDDS-4023. Delete closed container after all blocks have been deleted.

2020-08-21 Thread GitBox
ChenSammi commented on pull request #1338: URL: https://github.com/apache/hadoop-ozone/pull/1338#issuecomment-678126933 Hi @sodonnel thanks for review the code and raise the discussion. > I wonder if it would be simpler to remove empty containers as part of Container Report

[GitHub] [hadoop-ozone] ChenSammi commented on pull request #1339: HDDS-4131. Container report should update container key count and bytes used if they differ in SCM

2020-08-21 Thread GitBox
ChenSammi commented on pull request #1339: URL: https://github.com/apache/hadoop-ozone/pull/1339#issuecomment-678118383 Hi @sodonnel, since a typical container has 3 replicas and container report are asynchronously, we need a consensus on what's the container size is in SCM. Basically

[jira] [Resolved] (HDDS-4125) Pipeline is not removed when a datanode goes stale

2020-08-21 Thread Glen Geng (Jira)
[ https://issues.apache.org/jira/browse/HDDS-4125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Glen Geng resolved HDDS-4125. - Resolution: Fixed > Pipeline is not removed when a datanode goes stale >