[jira] [Updated] (KAFKA-15680) Partition-Count is not getting updated Correctly in the Incremental Co-operative Rebalancing(ICR) Mode of Rebalancing
[ https://issues.apache.org/jira/browse/KAFKA-15680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris updated KAFKA-15680: Component/s: KafkaConnect (was: connect) > Partition-Count is not getting updated Correctly in the Incremental > Co-operative Rebalancing(ICR) Mode of Rebalancing > - > > Key: KAFKA-15680 > URL: https://issues.apache.org/jira/browse/KAFKA-15680 > Project: Kafka > Issue Type: Bug > Components: KafkaConnect >Affects Versions: 3.0.1 >Reporter: Pritam Kumar >Assignee: Pritam Kumar >Priority: Minor > Fix For: 3.7.0, 3.6.1 > > > * In ICR(Incremental Cooperative Rebalancing) mode, whenever a new worker, > say Worker 3 joins, a new global assignment is computed by the leader, say > Worker1, that results in the revocation of some tasks from each existing > worker i.e Worker1 and Worker2. > * Once the new member join is completed, > *ConsumerCoordinator.OnJoinComplete()* method is called which primarily > computes all the new partitions assigned and the partitions which are revoked > and updates the subscription Object. > * If it was the case of revocation which we check by checking the > “partitonsRevoked” list, we call the method {*}“invoke{*}PartitionRevoked()” > which internally calls “updatePartitionCount()” which fetches partition from > the *assignment* object which is yet not updated by the new assignment. > * It is only just before calling the “{*}invokePartitionsAssigned{*}()” > method that we update the *assignment* by invoking the following → > *subscriptions.assignFromSubscribed(assignedPartitions);* -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (KAFKA-15680) Partition-Count is not getting updated Correctly in the Incremental Co-operative Rebalancing(ICR) Mode of Rebalancing
[ https://issues.apache.org/jira/browse/KAFKA-15680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Egerton updated KAFKA-15680: -- Fix Version/s: 3.6.1 > Partition-Count is not getting updated Correctly in the Incremental > Co-operative Rebalancing(ICR) Mode of Rebalancing > - > > Key: KAFKA-15680 > URL: https://issues.apache.org/jira/browse/KAFKA-15680 > Project: Kafka > Issue Type: Bug > Components: connect >Affects Versions: 3.0.1 >Reporter: Pritam Kumar >Assignee: Pritam Kumar >Priority: Minor > Fix For: 3.7.0, 3.6.1 > > > * In ICR(Incremental Cooperative Rebalancing) mode, whenever a new worker, > say Worker 3 joins, a new global assignment is computed by the leader, say > Worker1, that results in the revocation of some tasks from each existing > worker i.e Worker1 and Worker2. > * Once the new member join is completed, > *ConsumerCoordinator.OnJoinComplete()* method is called which primarily > computes all the new partitions assigned and the partitions which are revoked > and updates the subscription Object. > * If it was the case of revocation which we check by checking the > “partitonsRevoked” list, we call the method {*}“invoke{*}PartitionRevoked()” > which internally calls “updatePartitionCount()” which fetches partition from > the *assignment* object which is yet not updated by the new assignment. > * It is only just before calling the “{*}invokePartitionsAssigned{*}()” > method that we update the *assignment* by invoking the following → > *subscriptions.assignFromSubscribed(assignedPartitions);* -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (KAFKA-15680) Partition-Count is not getting updated Correctly in the Incremental Co-operative Rebalancing(ICR) Mode of Rebalancing
[ https://issues.apache.org/jira/browse/KAFKA-15680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pritam Kumar updated KAFKA-15680: - Fix Version/s: 3.6.1 > Partition-Count is not getting updated Correctly in the Incremental > Co-operative Rebalancing(ICR) Mode of Rebalancing > - > > Key: KAFKA-15680 > URL: https://issues.apache.org/jira/browse/KAFKA-15680 > Project: Kafka > Issue Type: Bug > Components: connect >Affects Versions: 3.0.1 >Reporter: Pritam Kumar >Assignee: Pritam Kumar >Priority: Minor > Fix For: 3.6.1 > > > * In ICR(Incremental Cooperative Rebalancing) mode, whenever a new worker, > say Worker 3 joins, a new global assignment is computed by the leader, say > Worker1, that results in the revocation of some tasks from each existing > worker i.e Worker1 and Worker2. > * Once the new member join is completed, > *ConsumerCoordinator.OnJoinComplete()* method is called which primarily > computes all the new partitions assigned and the partitions which are revoked > and updates the subscription Object. > * If it was the case of revocation which we check by checking the > “partitonsRevoked” list, we call the method {*}“invoke{*}PartitionRevoked()” > which internally calls “updatePartitionCount()” which fetches partition from > the *assignment* object which is yet not updated by the new assignment. > * It is only just before calling the “{*}invokePartitionsAssigned{*}()” > method that we update the *assignment* by invoking the following → > *subscriptions.assignFromSubscribed(assignedPartitions);* -- This message was sent by Atlassian Jira (v8.20.10#820010)