[ https://issues.apache.org/jira/browse/CASSANDRA-11348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15993091#comment-15993091 ]
Romain Hardouin commented on CASSANDRA-11348: --------------------------------------------- I have already needed this feature, this is interesting and useful. The concern when purging data (I mean physically delete) is repair (read repair or maintenance repair), we must use tombstones to avoid data resurrection. One of my use case is to purge counters that are older than a specific timestamp. I also imagined a filter that put tombstones on data and produce backup sstables corresponding to tombstone'd data. This would allow easy restore in case of problems. Another use case would be to plug a small filter that just logs keys when a key is greater than a specific size but less than {{compaction_large_partition_warning_threshold_mb}}. It would allow to easily find outliers. > Compaction Filter in Cassandra > ------------------------------ > > Key: CASSANDRA-11348 > URL: https://issues.apache.org/jira/browse/CASSANDRA-11348 > Project: Cassandra > Issue Type: New Feature > Components: Compaction > Reporter: Dikang Gu > Assignee: Dikang Gu > Priority: Minor > Fix For: 4.x > > > RocksDB has the feature called "Compaction Filter" to allow application to > modify/delete a key-value during the background compaction. > https://github.com/facebook/rocksdb/blob/v4.1/include/rocksdb/options.h#L201-L226 > It could be valuable to implement this feature in C* as well. -- This message was sent by Atlassian JIRA (v6.3.15#6346) --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@cassandra.apache.org For additional commands, e-mail: commits-h...@cassandra.apache.org