I think currently you can issue delete markers (tombstones) for the keys. That will delete the data associated with the respective keys during compaction. But the keys still will exist in the log.
Thanks, Mayuresh On Sun, Mar 1, 2015 at 8:07 AM, Ivan Balashov <ibalas...@gmail.com> wrote: > 2015-03-01 18:41 GMT+03:00 Jay Kreps <jay.kr...@gmail.com>: > > They are mutually exclusive. Can you expand on the motivation/use for > > combining them? > > Thanks, Jay > > Let's say we need to build key-value storage semantically connected to > the data that also stored in kafka. > Once the particular pieces of data are gone due to retention > expiration there might be no need to keep relevant pieces in the > kv-storage. > On the other hand, kv-storage most likely will benefit from > compaction, since its keys receive multiple updates. > > If this is not available oob, looks like the same can now be achieved > by manually scanning compacted topic and issuing "delete" markers. > -- -Regards, Mayuresh R. Gharat (862) 250-7125
