[jira] [Updated] (HDDS-8599) [Snapshot] Performance impact for key & directory deleting service
[ https://issues.apache.org/jira/browse/HDDS-8599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDDS-8599: -- Parent: HDDS-15130 (was: HDDS-13747) > [Snapshot] Performance impact for key & directory deleting service > -- > > Key: HDDS-8599 > URL: https://issues.apache.org/jira/browse/HDDS-8599 > Project: Apache Ozone > Issue Type: Sub-task >Reporter: Sumit Agrawal >Priority: Critical > > Scenario: > # Huge number of keys and directories are created in bucket (FSO) > # Snapshot is taken for the bucket > # Recursive delete of keys and directory > # keys and directories are added to deletedTable and deletedDirectoryTable > KeyDeletingService: > * iterator all keys in deleted Table > ** if keys are present in snapshot, its skipped > ** else added for blockGroupList for deletion > DirectoryDeletingService: > * iterator all directory in deleted directory table > ** if directory is present in snapshot, its skipped > ** else perform further action for deletion > So if number of keys and directory are huge, it will keep iterating always to > get candidate keys/directory for deletion. > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
[jira] [Updated] (HDDS-8599) [Snapshot] Performance impact for key & directory deleting service
[ https://issues.apache.org/jira/browse/HDDS-8599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDDS-8599: -- Parent: HDDS-13747 (was: HDDS-12940) > [Snapshot] Performance impact for key & directory deleting service > -- > > Key: HDDS-8599 > URL: https://issues.apache.org/jira/browse/HDDS-8599 > Project: Apache Ozone > Issue Type: Sub-task >Reporter: Sumit Agrawal >Priority: Critical > > Scenario: > # Huge number of keys and directories are created in bucket (FSO) > # Snapshot is taken for the bucket > # Recursive delete of keys and directory > # keys and directories are added to deletedTable and deletedDirectoryTable > KeyDeletingService: > * iterator all keys in deleted Table > ** if keys are present in snapshot, its skipped > ** else added for blockGroupList for deletion > DirectoryDeletingService: > * iterator all directory in deleted directory table > ** if directory is present in snapshot, its skipped > ** else perform further action for deletion > So if number of keys and directory are huge, it will keep iterating always to > get candidate keys/directory for deletion. > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
[jira] [Updated] (HDDS-8599) [Snapshot] Performance impact for key & directory deleting service
[ https://issues.apache.org/jira/browse/HDDS-8599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDDS-8599: -- Parent: HDDS-12940 (was: HDDS-8544) > [Snapshot] Performance impact for key & directory deleting service > -- > > Key: HDDS-8599 > URL: https://issues.apache.org/jira/browse/HDDS-8599 > Project: Apache Ozone > Issue Type: Sub-task >Reporter: Sumit Agrawal >Priority: Critical > > Scenario: > # Huge number of keys and directories are created in bucket (FSO) > # Snapshot is taken for the bucket > # Recursive delete of keys and directory > # keys and directories are added to deletedTable and deletedDirectoryTable > KeyDeletingService: > * iterator all keys in deleted Table > ** if keys are present in snapshot, its skipped > ** else added for blockGroupList for deletion > DirectoryDeletingService: > * iterator all directory in deleted directory table > ** if directory is present in snapshot, its skipped > ** else perform further action for deletion > So if number of keys and directory are huge, it will keep iterating always to > get candidate keys/directory for deletion. > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
[jira] [Updated] (HDDS-8599) [Snapshot] Performance impact for key & directory deleting service
[ https://issues.apache.org/jira/browse/HDDS-8599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Pogde updated HDDS-8599: - Priority: Critical (was: Minor) > [Snapshot] Performance impact for key & directory deleting service > -- > > Key: HDDS-8599 > URL: https://issues.apache.org/jira/browse/HDDS-8599 > Project: Apache Ozone > Issue Type: Sub-task >Reporter: Sumit Agrawal >Priority: Critical > > Scenario: > # Huge number of keys and directories are created in bucket (FSO) > # Snapshot is taken for the bucket > # Recursive delete of keys and directory > # keys and directories are added to deletedTable and deletedDirectoryTable > KeyDeletingService: > * iterator all keys in deleted Table > ** if keys are present in snapshot, its skipped > ** else added for blockGroupList for deletion > DirectoryDeletingService: > * iterator all directory in deleted directory table > ** if directory is present in snapshot, its skipped > ** else perform further action for deletion > So if number of keys and directory are huge, it will keep iterating always to > get candidate keys/directory for deletion. > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
[jira] [Updated] (HDDS-8599) [Snapshot] Performance impact for key & directory deleting service
[ https://issues.apache.org/jira/browse/HDDS-8599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prashant Pogde updated HDDS-8599: - Parent: HDDS-8544 (was: HDDS-7730) > [Snapshot] Performance impact for key & directory deleting service > -- > > Key: HDDS-8599 > URL: https://issues.apache.org/jira/browse/HDDS-8599 > Project: Apache Ozone > Issue Type: Sub-task >Reporter: Sumit Agrawal >Priority: Minor > > Scenario: > # Huge number of keys and directories are created in bucket (FSO) > # Snapshot is taken for the bucket > # Recursive delete of keys and directory > # keys and directories are added to deletedTable and deletedDirectoryTable > KeyDeletingService: > * iterator all keys in deleted Table > ** if keys are present in snapshot, its skipped > ** else added for blockGroupList for deletion > DirectoryDeletingService: > * iterator all directory in deleted directory table > ** if directory is present in snapshot, its skipped > ** else perform further action for deletion > So if number of keys and directory are huge, it will keep iterating always to > get candidate keys/directory for deletion. > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
[jira] [Updated] (HDDS-8599) [Snapshot] Performance impact for key & directory deleting service
[ https://issues.apache.org/jira/browse/HDDS-8599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDDS-8599: - Summary: [Snapshot] Performance impact for key & directory deleting service (was: [snapshot] performance impact for key & directory deleting service) > [Snapshot] Performance impact for key & directory deleting service > -- > > Key: HDDS-8599 > URL: https://issues.apache.org/jira/browse/HDDS-8599 > Project: Apache Ozone > Issue Type: Sub-task >Reporter: Sumit Agrawal >Priority: Minor > > Scenario: > # Huge number of keys and directories are created in bucket (FSO) > # Snapshot is taken for the bucket > # Recursive delete of keys and directory > # keys and directories are added to deletedTable and deletedDirectoryTable > KeyDeletingService: > * iterator all keys in deleted Table > ** if keys are present in snapshot, its skipped > ** else added for blockGroupList for deletion > DirectoryDeletingService: > * iterator all directory in deleted directory table > ** if directory is present in snapshot, its skipped > ** else perform further action for deletion > So if number of keys and directory are huge, it will keep iterating always to > get candidate keys/directory for deletion. > > -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
