Hi all, I am trying to set up a minimal example understanding log compaction behaviour using kafka-clients-0.10.0.0.jar. I got the compaction behaviour working fine, however, when trying to delete a message explicitly by writing a null value, the message seems to not be deleted.
These are my settings for my topic for compaction and deletion kicking in as soon as possible: Configs:min.cleanable.dirty.ratio=0.01, delete.retention.ms=100,retention.ms=100,segment.ms =100,cleanup.policy=compact The offending consumer record looks like this: [ConsumerRecord(topic = compation-test, partition = 0, offset = 33, CreateTime = 1470812816735, checksum = 3859648886, serialized key size = 16, serialized value size = -1, key = 9c9bde71-29ec-4687-ab24-9459f5fc0d34, value = null)] I can see the cleaner threads running fine, producing output like this: [2016-08-10 08:24:51,601] INFO Cleaner 0: Cleaning segment 37 in log tns_ticket-0 (last modified Wed Aug 10 07:52:26 UTC 2016) into 0, retaining deletes. (kafka.log.LogCleaner) (retaining deletes?) I am running out of ideas of settings to try - are there any ideas about what I might have missed or misunderstood? Any hint greatly appreciated :) Best, Christiane
