[ https://issues.apache.org/jira/browse/KAFKA-12639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17553315#comment-17553315 ]
Ismael Juma commented on KAFKA-12639: ------------------------------------- Is this related to [https://github.com/apache/kafka/commit/f8f57960c69fe677b9192b841fb7a0361ef2cc83] ? > AbstractCoordinator ignores backoff timeout when joining the consumer group > --------------------------------------------------------------------------- > > Key: KAFKA-12639 > URL: https://issues.apache.org/jira/browse/KAFKA-12639 > Project: Kafka > Issue Type: Bug > Components: clients, consumer > Affects Versions: 2.7.0 > Reporter: Matiss Gutmanis > Assignee: Philip Nee > Priority: Major > > We observed heavy logging while trying to join consumer group during partial > unavailability of Kafka cluster (it's part of our testing process). Seems > that {{rebalanceConfig.retryBackoffMs}} used in {{ > org.apache.kafka.clients.consumer.internals.AbstractCoordinator#joinGroupIfNeeded}} > is not respected. Debugging revealed that {{Timer}} instance technically is > expired thus using sleep of 0 milliseconds which defeats the purpose of > backoff timeout. > Minimal backoff timeout should be respected. > > {code:java} > 2021-03-30 08:30:24,488 INFO > [fs2-kafka-consumer-41][o.a.k.c.c.i.AbstractCoordinator] [Consumer > clientId=app_clientid, groupId=consumer-group] JoinGroup failed: Coordinator > 127.0.0.1:9092 (id: 2147483634 rack: null) is loading the group. > 2021-03-30 08:30:24,488 INFO > [fs2-kafka-consumer-41][o.a.k.c.c.i.AbstractCoordinator] [Consumer > clientId=app_clientid, groupId=consumer-group] Rebalance failed. > org.apache.kafka.common.errors.CoordinatorLoadInProgressException: The > coordinator is loading and hence can't process requests. > 2021-03-30 08:30:24,488 INFO > [fs2-kafka-consumer-41][o.a.k.c.c.i.AbstractCoordinator] [Consumer > clientId=app_clientid, groupId=consumer-group] (Re-)joining group > 2021-03-30 08:30:24,489 INFO > [fs2-kafka-consumer-41][o.a.k.c.c.i.AbstractCoordinator] [Consumer > clientId=app_clientid, groupId=consumer-group] JoinGroup failed: Coordinator > 127.0.0.1:9092 (id: 2147483634 rack: null) is loading the group. > 2021-03-30 08:30:24,489 INFO > [fs2-kafka-consumer-41][o.a.k.c.c.i.AbstractCoordinator] [Consumer > clientId=app_clientid, groupId=consumer-group] Rebalance failed. > org.apache.kafka.common.errors.CoordinatorLoadInProgressException: The > coordinator is loading and hence can't process requests. > 2021-03-30 08:30:24,489 INFO > [fs2-kafka-consumer-41][o.a.k.c.c.i.AbstractCoordinator] [Consumer > clientId=app_clientid, groupId=consumer-group] (Re-)joining group > 2021-03-30 08:30:24,490 INFO > [fs2-kafka-consumer-41][o.a.k.c.c.i.AbstractCoordinator] [Consumer > clientId=app_clientid, groupId=consumer-group] JoinGroup failed: Coordinator > 127.0.0.1:9092 (id: 2147483634 rack: null) is loading the group. > 2021-03-30 08:30:24,490 INFO > [fs2-kafka-consumer-41][o.a.k.c.c.i.AbstractCoordinator] [Consumer > clientId=app_clientid, groupId=consumer-group] Rebalance failed. > org.apache.kafka.common.errors.CoordinatorLoadInProgressException: The > coordinator is loading and hence can't process requests. > 2021-03-30 08:30:24,490 INFO > [fs2-kafka-consumer-41][o.a.k.c.c.i.AbstractCoordinator] [Consumer > clientId=app_clientid, groupId=consumer-group] (Re-)joining group > 2021-03-30 08:30:24,491 INFO > [fs2-kafka-consumer-41][o.a.k.c.c.i.AbstractCoordinator] [Consumer > clientId=app_clientid, groupId=consumer-group] JoinGroup failed: Coordinator > 127.0.0.1:9092 (id: 2147483634 rack: null) is loading the group. > 2021-03-30 08:30:24,491 INFO > [fs2-kafka-consumer-41][o.a.k.c.c.i.AbstractCoordinator] [Consumer > clientId=app_clientid, groupId=consumer-group] Rebalance failed. > org.apache.kafka.common.errors.CoordinatorLoadInProgressException: The > coordinator is loading and hence can't process requests. > 2021-03-30 08:30:24,491 INFO > [fs2-kafka-consumer-41][o.a.k.c.c.i.AbstractCoordinator] [Consumer > clientId=app_clientid, groupId=consumer-group] (Re-)joining group > 2021-03-30 08:30:24,492 INFO > [fs2-kafka-consumer-41][o.a.k.c.c.i.AbstractCoordinator] [Consumer > clientId=app_clientid, groupId=consumer-group] JoinGroup failed: Coordinator > 127.0.0.1:9092 (id: 2147483634 rack: null) is loading the group. > 2021-03-30 08:30:24,492 INFO > [fs2-kafka-consumer-41][o.a.k.c.c.i.AbstractCoordinator] [Consumer > clientId=app_clientid, groupId=consumer-group] Rebalance failed. > org.apache.kafka.common.errors.CoordinatorLoadInProgressException: The > coordinator is loading and hence can't process requests. > 2021-03-30 08:30:24,492 INFO > [fs2-kafka-consumer-41][o.a.k.c.c.i.AbstractCoordinator] [Consumer > clientId=app_clientid, groupId=consumer-group] (Re-)joining group > {code} -- This message was sent by Atlassian Jira (v8.20.7#820007)