[ 
https://issues.apache.org/jira/browse/KAFKA-8495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17460099#comment-17460099
 ] 

Pierre-Yves Bigourdan edited comment on KAFKA-8495 at 12/15/21, 4:58 PM:
-------------------------------------------------------------------------

[~ableegoldman] could you please clarify "round-robin/range assignors will 
deliberately not support cooperative rebalancing", or point to some relevant 
discussions providing more context?

I'm currently working on a project that would benefit from moving to a 
cooperative protocol to reduce the performance hit incurred by rebalances, but 
unfortunately the way the sticky algorithm assigns partitions to consumers 
isn't suitable for my use case.


was (Author: pyves):
[~ableegoldman] could you please clarify "round-robin/range assignors will 
deliberately not support cooperative rebalancing", or point to some relevant 
discussions providing more context?

I'm currently working on a project that would benefit from moving to a 
cooperative protocol to reduce the performance hit incurred from rebalances, 
but unfortunately the way the sticky algorithm assigns partitions to consumers 
isn't suitable for my use case.

> Make Round-robin / RangeAssignor to be "sticky" (part 5)
> --------------------------------------------------------
>
>                 Key: KAFKA-8495
>                 URL: https://issues.apache.org/jira/browse/KAFKA-8495
>             Project: Kafka
>          Issue Type: Sub-task
>          Components: consumer
>            Reporter: Guozhang Wang
>            Priority: Major
>
> For this new algorithm to be effective in reducing rebalance costs, it is 
> really expecting the plug-in assignor to be "sticky" in some way, such that 
> the diff of the newly-assigned-partitions and the 
> existing-assigned-partitions can be small, and hence only a few subset of the 
> total number of partitions need to be revoked / migrated at each rebalance in 
> practice – otherwise, we are just paying more rebalance for little benefits.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to