[jira] [Updated] (HDDS-13874) Get rid of SnapshotCompactionDag
[ https://issues.apache.org/jira/browse/HDDS-13874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDDS-13874: --- Parent: HDDS-15130 (was: HDDS-13747) > Get rid of SnapshotCompactionDag > > > Key: HDDS-13874 > URL: https://issues.apache.org/jira/browse/HDDS-13874 > Project: Apache Ozone > Issue Type: Sub-task >Reporter: Swaminathan Balachandran >Assignee: Chia-Chuan Ho >Priority: Major > Labels: pull-request-available > > Currently rocksdb compactions are tracked for getting the intermediate > SstFiles and forming a complex DAG. Instead of tracking the compactions > simple SstFlushes can be tracked to get all the L0 sstFiles b/w 2 snapshots > which could be just implemented as a simple linked list of sst files. We can > even compact the sst files between 2 consecutive snapshots which would make > the snapshot diff even more optimized and also simplify the design. > https://github.com/facebook/rocksdb/blob/36ce2e2a0a4d229d1805766b0e9534b1f708929f/java/src/test/java/org/rocksdb/EventListenerTest.java#L46-L58 -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
[jira] [Updated] (HDDS-13874) Get rid of SnapshotCompactionDag
[ https://issues.apache.org/jira/browse/HDDS-13874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDDS-13874: -- Labels: pull-request-available (was: ) > Get rid of SnapshotCompactionDag > > > Key: HDDS-13874 > URL: https://issues.apache.org/jira/browse/HDDS-13874 > Project: Apache Ozone > Issue Type: Sub-task >Reporter: Swaminathan Balachandran >Priority: Major > Labels: pull-request-available > > Currently rocksdb compactions are tracked for getting the intermediate > SstFiles and forming a complex DAG. Instead of tracking the compactions > simple SstFlushes can be tracked to get all the L0 sstFiles b/w 2 snapshots > which could be just implemented as a simple linked list of sst files. We can > even compact the sst files between 2 consecutive snapshots which would make > the snapshot diff even more optimized and also simplify the design. > https://github.com/facebook/rocksdb/blob/36ce2e2a0a4d229d1805766b0e9534b1f708929f/java/src/test/java/org/rocksdb/EventListenerTest.java#L46-L58 -- This message was sent by Atlassian Jira (v8.20.10#820010) - To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
