Vahid Hashemian created KAFKA-9731:
--------------------------------------
Summary: Increased fetch request rate with leader selector due to
HW propagation
Key: KAFKA-9731
URL: https://issues.apache.org/jira/browse/KAFKA-9731
Project: Kafka
Issue Type: Improvement
Components: core
Affects Versions: 2.4.1, 2.4.0
Reporter: Vahid Hashemian
Attachments: image-2020-03-17-10-19-08-987.png
KIP-392 adds high watermark propagation to followers as a means to better sync
up followers HW with leader. The issue we have noticed after trying out 2.4.0
and 2.4.1 is a spike in fetch request rate in the default selector case
(leader), that does not really require this high watermark propagation:
!image-2020-03-17-10-19-08-987.png|width=811,height=354!
This spike causes an increase in resource allocation (CPU) on the brokers.
An easy solution would be to disable this propagation (at least) for the
default leader selector case to improve the backward compatibility.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)