I think you can mark a tombstone (null value) for the keys explicitly, that will eventually delete those messages from the log.
Thanks, Mayuresh On Wed, Nov 11, 2015 at 6:18 AM, Morgan Kenyon <mor...@lymba.com> wrote: > I came across an interesting question on StackOverflow dealing with the > difference between compaction and retention. To sum up the question and my > incorrect answer, I was unaware that retention and compaction were mutually > exclusive (based on grokbase link below) > > Is it true that when setting a log to be compacted there is no way to > delete old messages if they're not deleted through compaction? I imagine a > use case where the user has a limited hard drive capacity and would like to > compact a log up till a certain size, then delete old messages. While using > compaction are unique kryed messages guaranteed to remain in log > indefinitely? Or is there any other way to delete them? > > > http://stackoverflow.com/questions/33632362/how-clean-old-segments-from-compacted-log-in-kafka-0-8-2/ > http://grokbase.com/t/kafka/users/14bv6gaz0t/kafka-0-8-2-log-cleaner > > -- > > *Morgan Kenyon* > Software Engineer > Lymba Corporation > Phone: 972-680-0800 > Email: mor...@lymba.com > > [image: Logo] > -- -Regards, Mayuresh R. Gharat (862) 250-7125
