[ 
https://issues.apache.org/jira/browse/KAFKA-8179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16928781#comment-16928781
 ] 

Guozhang Wang commented on KAFKA-8179:
--------------------------------------

[~ableegoldman] Let's use this umbrella ticket to track our benchmarking 
investigations on how the cooperative protocol would impact the consumer 
throughput / pausing gaps.

> Incremental Rebalance Protocol for Kafka Consumer
> -------------------------------------------------
>
>                 Key: KAFKA-8179
>                 URL: https://issues.apache.org/jira/browse/KAFKA-8179
>             Project: Kafka
>          Issue Type: Improvement
>          Components: consumer
>            Reporter: Guozhang Wang
>            Assignee: Guozhang Wang
>            Priority: Major
>
> Recently Kafka community is promoting cooperative rebalancing to mitigate the 
> pain points in the stop-the-world rebalancing protocol. This ticket is 
> created to initiate that idea at the Kafka consumer client, which will be 
> beneficial for heavy-stateful consumers such as Kafka Streams applications.
> In short, the scope of this ticket includes reducing unnecessary rebalance 
> latency due to heavy partition migration: i.e. partitions being revoked and 
> re-assigned. This would make the built-in consumer assignors (range, 
> round-robin etc) to be aware of previously assigned partitions and be sticky 
> in best-effort.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

Reply via email to