Hi
We are chrooting each Kafka cluster to a unique namespace in the Kafka
brokers of each our clusters. We can produce the message fine and we can
write to broker. But our consumers are not able to consume anything from
their respective brokers. We are seeing the following error messages after
enabling DEBUG logs on consumer. Any help is greatly appreciated.
ERROR type
*Group coordinator lookup for group ConsumerGroup05 failed: The group
coordinator is not available.*
DEBUG logs
17/08/11 19:26:24 DEBUG clients.Metadata:241 Updated cluster metadata
version 246 to Cluster(id = Ko9chqW7Qcath3WY94MDWw, nodes = [1.1.1.64:9092
(id: 1 rack: null)], partitions = [Partition(topic = topic05, partition =
5, leader = 1, replicas = [1,], isr = [1,]), Partition(topic = topic05,
partition = 4, leader = 1, replicas = [1,], isr = [1,]), Partition(topic =
topic05, partition = 3, leader = 1, replicas = [1,], isr = [1,]),
Partition(topic = topic05, partition = 2, leader = 1, replicas = [1,], isr
= [1,]), Partition(topic = topic05, partition = 1, leader = 1, replicas =
[1,], isr = [1,]), Partition(topic = topic05, partition = 0, leader = 1,
replicas = [1,], isr = [1,]), Partition(topic = topic05, partition = 13,
leader = 1, replicas = [1,], isr = [1,]), Partition(topic = topic05,
partition = 12, leader = 1, replicas = [1,], isr = [1,]), Partition(topic =
topic05, partition = 11, leader = 1, replicas = [1,], isr = [1,]),
Partition(topic = topic05, partition = 10, leader = 1, replicas = [1,], isr
= [1,]), Partition(topic = topic05, partition = 9, leader = 1, replicas =
[1,], isr = [1,]), Partition(topic = topic05, partition = 8, leader = 1,
replicas = [1,], isr = [1,]), Partition(topic = topic05, partition = 7,
leader = 1, replicas = [1,], isr = [1,]), Partition(topic = topic05,
partition = 6, leader = 1, replicas = [1,], isr = [1,]), Partition(topic =
topic05, partition = 15, leader = 1, replicas = [1,], isr = [1,]),
Partition(topic = topic05, partition = 14, leader = 1, replicas = [1,], isr
= [1,])])
17/08/11 19:26:24 DEBUG internals.AbstractCoordinator:531 Sending
coordinator request for group ConsumerGroup05 to broker 1.1.1.64:9092 (id:
1 rack: null)
17/08/11 19:26:24 DEBUG internals.AbstractCoordinator:541 Received group
coordinator response ClientResponse(receivedTimeMs=1502479584675,
disconnected=false, request=ClientRequest(expectResponse=true,
callback=org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler@63eea2a4,
request=RequestSend(header={api_key=10,api_version=0,correlation_id=489,client_id=consumer-1},
body={group_id=ConsumerGroup05}), createdTimeMs=1502479584657,
sendTimeMs=1502479584657),
responseBody={error_code=15,coordinator={node_id=-1,host=,port=-1}})
17/08/11 19:26:24 DEBUG internals.AbstractCoordinator:563 Group coordinator
lookup for group ConsumerGroup05 failed: The group coordinator is not
available.
17/08/11 19:26:24 DEBUG clients.NetworkClient:640 Sending metadata request
{topics=[topic05]} to node 1
17/08/11 19:26:24 DEBUG clients.Metadata:241 Updated cluster metadata
version 247 to Cluster(id = Ko9chqW7Qcath3WY94MDWw, nodes = [1.1.1.64:9092
(id: 1 rack: null)], partitions = [Partition(topic = topic05, partition =
5, leader = 1, replicas = [1,], isr = [1,]), Partition(topic = topic05,
partition = 4, leader = 1, replicas = [1,], isr = [1,]), Partition(topic =
topic05, partition = 3, leader = 1, replicas = [1,], isr = [1,]),
Partition(topic = topic05, partition = 2, leader = 1, replicas = [1,], isr
= [1,]), Partition(topic = topic05, partition = 1, leader = 1, replicas =
[1,], isr = [1,]), Partition(topic = topic05, partition = 0, leader = 1,
replicas = [1,], isr = [1,]), Partition(topic = topic05, partition = 13,
leader = 1, replicas = [1,], isr = [1,]), Partition(topic = topic05,
partition = 12, leader = 1, replicas = [1,], isr = [1,]), Partition(topic =
topic05, partition = 11, leader = 1, replicas = [1,], isr = [1,]),
Partition(topic = topic05, partition = 10, leader = 1, replicas = [1,], isr
= [1,]), Partition(topic = topic05, partition = 9, leader = 1, replicas =
[1,], isr = [1,]), Partition(topic = topic05, partition = 8, leader = 1,
replicas = [1,], isr = [1,]), Partition(topic = topic05, partition = 7,
leader = 1, replicas = [1,], isr = [1,]), Partition(topic = topic05,
partition = 6, leader = 1, replicas = [1,], isr = [1,]), Partition(topic =
topic05, partition = 15, leader = 1, replicas = [1,], isr = [1,]),
Partition(topic = topic05, partition = 14, leader = 1, replicas = [1,], isr
= [1,])])
17/08/11 19:26:24 DEBUG internals.AbstractCoordinator:531 Sending
coordinator request for group ConsumerGroup05 to broker 1.1.1.64:9092 (id:
1 rack: null)
17/08/11 19:26:24 DEBUG internals.AbstractCoordinator:541 Received group
coordinator response ClientResponse(receivedTimeMs=1502479584765,
disconnected=false, request=ClientRequest(expectResponse=true,
callback=org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler@477a35c0,
request=RequestSend(header={api_key=10,api_version=0,correlation_id=491,client_id=consumer-1},
body={group_id=ConsumerGroup05}), createdTimeMs=1502479584759,
sendTimeMs=1502479584759),
responseBody={error_code=15,coordinator={node_id=-1,host=,port=-1}})
17/08/11 19:26:24 DEBUG internals.AbstractCoordinator:563 Group coordinator
lookup for group ConsumerGroup05 failed: The group coordinator is not
available.
17/08/11 19:26:24 DEBUG clients.NetworkClient:640 Sending metadata request
{topics=[topic05]} to node 1
17/08/11 19:26:24 DEBUG clients.Metadata:241 Updated cluster metadata
version 248 to Cluster(id = Ko9chqW7Qcath3WY94MDWw, nodes = [1.1.1.64:9092
(id: 1 rack: null)], partitions = [Partition(topic = topic05, partition =
5, leader = 1, replicas = [1,], isr = [1,]), Partition(topic = topic05,
partition = 4, leader = 1, replicas = [1,], isr = [1,]), Partition(topic =
topic05, partition = 3, leader = 1, replicas = [1,], isr = [1,]),
Partition(topic = topic05, partition = 2, leader = 1, replicas = [1,], isr
= [1,]), Partition(topic = topic05, partition = 1, leader = 1, replicas =
[1,], isr = [1,]), Partition(topic = topic05, partition = 0, leader = 1,
replicas = [1,], isr = [1,]), Partition(topic = topic05, partition = 13,
leader = 1, replicas = [1,], isr = [1,]), Partition(topic = topic05,
partition = 12, leader = 1, replicas = [1,], isr = [1,]), Partition(topic =
topic05, partition = 11, leader = 1, replicas = [1,], isr = [1,]),
Partition(topic = topic05, partition = 10, leader = 1, replicas = [1,], isr
= [1,]), Partition(topic = topic05, partition = 9, leader = 1, replicas =
[1,], isr = [1,]), Partition(topic = topic05, partition = 8, leader = 1,
replicas = [1,], isr = [1,]), Partition(topic = topic05, partition = 7,
leader = 1, replicas = [1,], isr = [1,]), Partition(topic = topic05,
partition = 6, leader = 1, replicas = [1,], isr = [1,]), Partition(topic =
topic05, partition = 15, leader = 1, replicas = [1,], isr = [1,]),
Partition(topic = topic05, partition = 14, leader = 1, replicas = [1,], isr
= [1,])])
17/08/11 19:26:24 DEBUG internals.AbstractCoordinator:531 Sending
coordinator request for group ConsumerGroup05 to broker 1.1.1.64:9092 (id:
1 rack: null)
17/08/11 19:26:24 DEBUG internals.AbstractCoordinator:541 Received group
coordinator response ClientResponse(receivedTimeMs=1502479584887,
disconnected=false, request=ClientRequest(expectResponse=true,
callback=org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler@34e591df,
request=RequestSend(header={api_key=10,api_version=0,correlation_id=493,client_id=consumer-1},
body={group_id=ConsumerGroup05}), createdTimeMs=1502479584860,
sendTimeMs=1502479584860),
responseBody={error_code=15,coordinator={node_id=-1,host=,port=-1}})
17/08/11 19:26:24 DEBUG internals.AbstractCoordinator:563 Group coordinator
lookup for group ConsumerGroup05 failed: The group coordinator is not
available.
17/08/11 19:26:24 DEBUG clients.NetworkClient:640 Sending metadata request
{topics=[topic05]} to node 1
17/08/11 19:26:24 DEBUG clients.Metadata:241 Updated cluster metadata
version 249 to Cluster(id = Ko9chqW7Qcath3WY94MDWw, nodes = [1.1.1.64:9092
(id: 1 rack: null)], partitions = [Partition(topic = topic05, partition =
5, leader = 1, replicas = [1,], isr = [1,]), Partition(topic = topic05,
partition = 4, leader = 1, replicas = [1,], isr = [1,]), Partition(topic =
topic05, partition = 3, leader = 1, replicas = [1,], isr = [1,]),
Partition(topic = topic05, partition = 2, leader = 1, replicas = [1,], isr
= [1,]), Partition(topic = topic05, partition = 1, leader = 1, replicas =
[1,], isr = [1,]), Partition(topic = topic05, partition = 0, leader = 1,
replicas = [1,], isr = [1,]), Partition(topic = topic05, partition = 13,
leader = 1, replicas = [1,], isr = [1,]), Partition(topic = topic05,
partition = 12, leader = 1, replicas = [1,], isr = [1,]), Partition(topic =
topic05, partition = 11, leader = 1, replicas = [1,], isr = [1,]),
Partition(topic = topic05, partition = 10, leader = 1, replicas = [1,], isr
= [1,]), Partition(topic = topic05, partition = 9, leader = 1, replicas =
[1,], isr = [1,]), Partition(topic = topic05, partition = 8, leader = 1,
replicas = [1,], isr = [1,]), Partition(topic = topic05, partition = 7,
leader = 1, replicas = [1,], isr = [1,]), Partition(topic = topic05,
partition = 6, leader = 1, replicas = [1,], isr = [1,]), Partition(topic =
topic05, partition = 15, leader = 1, replicas = [1,], isr = [1,]),
Partition(topic = topic05, partition = 14, leader = 1, replicas = [1,], isr
= [1,])])
17/08/11 19:26:24 DEBUG internals.AbstractCoordinator:531 Sending
coordinator request for group ConsumerGroup05 to broker 1.1.1.64:9092 (id:
1 rack: null)
17/08/11 19:26:24 DEBUG internals.AbstractCoordinator:541 Received group
coordinator response ClientResponse(receivedTimeMs=1502479584968,
disconnected=false, request=ClientRequest(expectResponse=true,
callback=org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler@662022ab,
request=RequestSend(header={api_key=10,api_version=0,correlation_id=495,client_id=consumer-1},
body={group_id=ConsumerGroup05}), createdTimeMs=1502479584961,
sendTimeMs=1502479584961),
responseBody={error_code=15,coordinator={node_id=-1,host=,port=-1}})
17/08/11 19:26:24 DEBUG internals.AbstractCoordinator:563 Group coordinator
lookup for group ConsumerGroup05 failed: The group coordinator is not
available.
Thanks.
--
Raghav
