[
https://issues.apache.org/jira/browse/KAFKA-6028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Damian Guy updated KAFKA-6028:
------------------------------
Fix Version/s: (was: 1.1.0)
1.2.0
> Improve the quota throttle communication.
> -----------------------------------------
>
> Key: KAFKA-6028
> URL: https://issues.apache.org/jira/browse/KAFKA-6028
> Project: Kafka
> Issue Type: Improvement
> Components: clients, core
> Affects Versions: 1.0.0
> Reporter: Jiangjie Qin
> Assignee: Jiangjie Qin
> Priority: Major
> Fix For: 1.2.0
>
>
> Currently if a client is throttled duet to quota violation, the broker will
> only send back a response to the clients after the throttle time has passed.
> In this case, the clients don't know how long the response will be throttled
> and might hit request timeout before the response is returned. As a result
> the clients will retry sending a request and results a even longer throttle
> time.
> The above scenario could happen when a large clients group sending records to
> the brokers. We saw this when a MapReduce job pushes data to the Kafka
> cluster.
> To improve this, the broker can return the response with throttle time
> immediately after processing the requests. After that, the broker will mute
> the channel for this client. A correct client implementation should back off
> for that long before sending the next request. If the client ignored the
> throttle time and send the next request immediately, the channel will be
> muted and the request won't be processed until the throttle time has passed.
> A KIP will follow with more details.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
