Nicholas Telford created KAFKA-20491:
----------------------------------------
Summary: Enforce transaction buffer memory
limitstatestore.uncommitted.max.bytes
Key: KAFKA-20491
URL: https://issues.apache.org/jira/browse/KAFKA-20491
Project: Kafka
Issue Type: Sub-task
Reporter: Nicholas Telford
Assignee: Nicholas Telford
We will introduce a new {{statestore.uncommitted.max.bytes}} config, which
controls the total memory permitted for buffering uncommitted writes in store
transaction buffers.
When {{enable.transactional.statestore}} is {{{}true{}}}, this memory limit
will be divided between all {{{}StreamThread{}}}s (and the
{{{}GlobalStreamThread{}}}, if the topology has global state) and enforced
per-thread: whenever the limit is likely to be exceeded, the thread will
trigger a premature commit of all its Tasks.
This limit will be dynamic, since it must adjust if new {{{}StreamThread{}}}s
are added/removed from the instance.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
