Matthias J. Sax created KAFKA-13345:
---------------------------------------
Summary: WindowStore should use "delete" policy when duplicates
are enabled
Key: KAFKA-13345
URL: https://issues.apache.org/jira/browse/KAFKA-13345
Project: Kafka
Issue Type: Improvement
Components: streams
Reporter: Matthias J. Sax
For stream-stream join, windowed stores are configures to retain duplicates.
For this case, each key written into the store is unique.
At the same time, windowed store changelog topics are configured with cleanup
policy "delete,compact" by default. However, with retained duplicates, and thus
effectively unique keys, log compaction does not make sense.
To avoid keeping the broker log compaction thread busy without doing actual
useful work for those topics, we should change the topic config to "delete" if
duplicates are retained.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)