[
https://issues.apache.org/jira/browse/KAFKA-3065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rajini Sivaram updated KAFKA-3065:
----------------------------------
Status: Patch Available (was: Open)
PR deletes unused entries from RecordAccumulator#batches. To avoid additional
locking, batches has been made a ConcurrentHashMap instead of CopyOnWriteMap.
Producer performance tests on our cluster dont show any noticeable difference
with the changes.
> Prevent unbounded growth of RecordAccumulator#batches in Kafka producer
> -----------------------------------------------------------------------
>
> Key: KAFKA-3065
> URL: https://issues.apache.org/jira/browse/KAFKA-3065
> Project: Kafka
> Issue Type: Bug
> Components: producer
> Affects Versions: 0.9.0.0
> Reporter: Rajini Sivaram
> Assignee: Rajini Sivaram
>
> Topic partitions added to RecordAccumulator#batches are never removed from
> the map. In a dynamic environment where topics are created and deleted
> frequently, this can result in unbounded growth of the map with unused
> entries. This is a particularly an issue for the Kafka REST service where a
> producer object is used for the lifetime of the service, and the service
> itself does not control the topics to which clients publish messages.
> This is a follow-on defect from KAFKA-2948.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
