Jun Rao created KAFKA-4072:
------------------------------
Summary: improving memory usage in LogCleaner
Key: KAFKA-4072
URL: https://issues.apache.org/jira/browse/KAFKA-4072
Project: Kafka
Issue Type: Improvement
Reporter: Jun Rao
This is a followup jira from KAFKA-3894.
We can potentially make the allocation of the dedup buffer more dynamic. We can
start with something small like 100MB. If needed, we can grow the dedup buffer
up to the configured size. This will allow us to set a larger default dedup
buffer size (say 1GB). If there are not lots of keys, the broker won't be using
that much memory. This will allow the default configuration to accommodate more
keys.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)