Guozhang Wang created KAFKA-8179: ------------------------------------ Summary: Incremental Rebalance Protocol for Kafka Consumer Key: KAFKA-8179 URL: https://issues.apache.org/jira/browse/KAFKA-8179 Project: Kafka Issue Type: Improvement Components: consumer Reporter: Guozhang Wang Assignee: Guozhang Wang
Recently Kafka community is promoting cooperative rebalancing to mitigate the pain points in the stop-the-world rebalancing protocol. This ticket is created to initiate that idea at the Kafka consumer client, which will be beneficial for heavy-stateful consumers such as Kafka Streams applications. In short, the scope of this ticket includes reducing unnecessary rebalance latency due to heavy partition migration: i.e. partitions being revoked and re-assigned. This would make the built-in consumer assignors (range, round-robin etc) to be aware of previously assigned partitions and be sticky in best-effort. -- This message was sent by Atlassian JIRA (v7.6.3#76005)