Jay Kreps created KAFKA-555:
-------------------------------
Summary: Add a key-based log retention strategy
Key: KAFKA-555
URL: https://issues.apache.org/jira/browse/KAFKA-555
Project: Kafka
Issue Type: New Feature
Reporter: Jay Kreps
Currently we have two log retention strategies: one based on time and one based
on log size. These work well for "event" type data--i.e. data that consists
only of appends. However if the events model changes to an underlying keyed
data set, a more convenient retention strategy would delete keys that had been
overwritten rather than retaining whole segments.
The proposed implementation would be a background process that scanned log
segments and recopied only keys that hadn't been overwritten. Some more details
are in this wiki:
https://cwiki.apache.org/confluence/display/KAFKA/Keyed+Messages+Proposal
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
