[
https://issues.apache.org/jira/browse/KAFKA-7141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16538861#comment-16538861
]
Bohdana Panchenko edited comment on KAFKA-7141 at 7/10/18 4:06 PM:
-------------------------------------------------------------------
[~vahid], i have updates from my side.
First: i checked setting {color:#d04437}enable.auto.commit = true. {color}
{color:#333333}{color:#d04437}After that change, +even with the empty topic
partition, I got the desired output for the describe command.+
I{color}{color}s that so by design?
*$* *kafka-consumer-groups --describe --bootstrap-server 127.0.0.1:9092
--group myakkastreamkafka-1*
_Note: This will not show information about old Zookeeper-based consumers._
_TOPIC PARTITION CURRENT-OFFSET LOG-END-OFFSET LAG CONSUMER-ID HOST CLIENT-ID_
_STREAM-TEST 0 0 0 0 consumer-1-7f68330a-9c2f-4694-9978-0378368e6000
/172.19.0.8 consumer-1_
Second _:_ That made me thinking I am doing something wrong while using
consumer's commit API for manual offset management.
I set the enable.auto.commit = false.
I have double-checked and verified that i was not committing __ offsets
properly. I fixed that and the result is:
+before manually committing offsets - no output+
Is that by design?
*$ kafka-consumer-groups --describe --bootstrap-server 127.0.0.1:9092 --group
myakkastreamkafka-1*
_Note: This will not show information about old Zookeeper-based consumers._
_TOPIC PARTITION CURRENT-OFFSET LOG-END-OFFSET LAG CONSUMER-ID HOST CLIENT-ID_
+after correctly manually committing offsets - desired output+ __
*$ kafka-consumer-groups --describe --bootstrap-server 127.0.0.1:9092 --group
myakkastreamkafka-1*
_Note: This will not show information about old Zookeeper-based consumers._
_TOPIC PARTITION CURRENT-OFFSET LOG-END-OFFSET LAG CONSUMER-ID HOST CLIENT-ID_
_STREAM-TEST 0 5 5 0 consumer-1-868599a6-272a-4929-9b28-b67de153fab4
/172.17.0.1 consumer-1_
+So to summarize: is it so, that for the group to be properly described, it is
required either: using automatic offset management or wait for the first offset
commit from the consumer for that group?+
+Thank you in advance.+ __
was (Author: kioria):
[~vahid], i have updates from my side.
First: i checked setting {color:#d04437}enable.auto.commit = true. {color}
{color:#d04437}{color:#333333}After that change, +even with the empty topic
partition, I got the desired output for the describe command.+
I{color}{color}{color:#d04437}{color:#333333}s that so by
design?{color}{color}
*$* *kafka-consumer-groups --describe --bootstrap-server 127.0.0.1:9092 --group
myakkastreamkafka-1*
_Note: This will not show information about old Zookeeper-based consumers._
_TOPIC PARTITION CURRENT-OFFSET LOG-END-OFFSET LAG CONSUMER-ID HOST CLIENT-ID_
_STREAM-TEST 0 0 0 0 consumer-1-7f68330a-9c2f-4694-9978-0378368e6000
/172.19.0.8 consumer-1_
Second _:_ That made me thinking I am doing something wrong while using
consumer's commit API for manual offset management.
I set the {color:#d04437}enable.auto.commit = false.{color}
I have double-checked and verified that i was not committing __ offsets
properly. I fixed that and the result is:
+before manually committing offsets - no output+
Is that by design?
*$ kafka-consumer-groups --describe --bootstrap-server 127.0.0.1:9092 --group
myakkastreamkafka-1*
_Note: This will not show information about old Zookeeper-based consumers._
_TOPIC PARTITION CURRENT-OFFSET LOG-END-OFFSET LAG CONSUMER-ID HOST CLIENT-ID_
+after correctly manually committing offsets - desired output+ __
*$ kafka-consumer-groups --describe --bootstrap-server 127.0.0.1:9092 --group
myakkastreamkafka-1*
_Note: This will not show information about old Zookeeper-based consumers._
_TOPIC PARTITION CURRENT-OFFSET LOG-END-OFFSET LAG CONSUMER-ID HOST CLIENT-ID_
_STREAM-TEST 0 5 5 0 consumer-1-868599a6-272a-4929-9b28-b67de153fab4
/172.17.0.1 consumer-1_
+So to summarize: is it so, that for the group to be properly described, it is
required either: using automatic offset management or wait for the first offset
commit from the consumer for that group?+
+Thank you in advance.+ __
> kafka-consumer-group doesn't describe existing group
> ----------------------------------------------------
>
> Key: KAFKA-7141
> URL: https://issues.apache.org/jira/browse/KAFKA-7141
> Project: Kafka
> Issue Type: Bug
> Components: admin
> Affects Versions: 0.11.0.0, 1.0.1
> Reporter: Bohdana Panchenko
> Priority: Major
>
> I am running two consumers: akka-stream-kafka consumer with standard config
> section as described in the
> [https://doc.akka.io/docs/akka-stream-kafka/current/consumer.html] and
> kafka-console-consumer.
> akka-stream-kafka consumer configuration looks like this
> {color:#333333}_akka.kafka.consumer{_{color}
> {color:#333333} _kafka-clients{_{color}
> {color:#333333} _group.id = "myakkastreamkafka-1"_{color}
> {color:#333333} _enable.auto.commit = false_{color}
> }
> {color:#333333} }{color}
>
> I am able to see the both groups with the command
>
> *kafka-consumer-groups --bootstrap-server 127.0.0.1:9092 --list*
> _Note: This will not show information about old Zookeeper-based consumers._
>
> _myakkastreamkafka-1_
> _console-consumer-57171_
> {color:#333333}I am able to view details about the console consumer
> group{color}
> *kafka-consumer-groups --describe --bootstrap-server 127.0.0.1:9092 --group
> console-consumer-57171*
> _{color:#205081}Note: This will not show information about old
> Zookeeper-based consumers.{color}_
> _{color:#205081}TOPIC PARTITION CURRENT-OFFSET LOG-END-OFFSET LAG CONSUMER-ID
> HOST CLIENT-ID{color}_
> _{color:#205081}STREAM-TEST 0 0 0 0
> consumer-1-6b928e07-196a-4322-9928-068681617878 /172.19.0.4 consumer-1{color}_
> {color:#333333}But the command to describe my akka stream consumer gives me
> empty output:{color}
> *kafka-consumer-groups --describe --bootstrap-server 127.0.0.1:9092 --group
> myakkastreamkafka-1*
> {color:#205081}_Note: This will not show information about old
> Zookeeper-based consumers._{color}
> {color:#205081}_TOPIC PARTITION CURRENT-OFFSET LOG-END-OFFSET LAG CONSUMER-ID
> HOST CLIENT-ID_{color}
>
> {color:#333333}That is strange. Can you please check the issue?{color}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
