[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15184255#comment-15184255 ] ASF GitHub Bot commented on KAFKA-1476: --- Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/945 > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: Onur Karaman > Labels: newbie > Fix For: 0.9.0.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch, > KAFKA-1476.patch, KAFKA-1476.patch, KAFKA-1476.patch, > KAFKA-1476_2014-11-10_11:58:26.patch, KAFKA-1476_2014-11-10_12:04:01.patch, > KAFKA-1476_2014-11-10_12:06:35.patch, KAFKA-1476_2014-12-05_12:00:12.patch, > KAFKA-1476_2015-01-12_16:22:26.patch, KAFKA-1476_2015-01-12_16:31:20.patch, > KAFKA-1476_2015-01-13_10:36:18.patch, KAFKA-1476_2015-01-15_14:30:04.patch, > KAFKA-1476_2015-01-22_02:32:52.patch, KAFKA-1476_2015-01-30_11:09:59.patch, > KAFKA-1476_2015-02-04_15:41:50.patch, KAFKA-1476_2015-02-04_18:03:15.patch, > KAFKA-1476_2015-02-05_03:01:09.patch, KAFKA-1476_2015-02-09_14:37:30.patch, > sample-kafka-consumer-groups-sh-output-1-23-2015.txt, > sample-kafka-consumer-groups-sh-output-2-5-2015.txt, > sample-kafka-consumer-groups-sh-output-2-9-2015.txt, > sample-kafka-consumer-groups-sh-output.txt > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15157349#comment-15157349 ] ASF GitHub Bot commented on KAFKA-1476: --- GitHub user christian-posta opened a pull request: https://github.com/apache/kafka/pull/945 tidy up spacing for ConsumerGroupCommand related to KAFKA-1476 … https://issues.apache.org/jira/browse/KAFKA-1476 Let me know if these kind of contributions should have their own requisite JIRA opened in advance. Cheers.. You can merge this pull request into a Git repository by running: $ git pull https://github.com/christian-posta/kafka ceposta-tidy-up-consumer-groups-describe Alternatively you can review and apply these changes as the patch at: https://github.com/apache/kafka/pull/945.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #945 commit dd9ab774dbe4105666de012212d565c0a0ec2ffa Author: Christian Posta Date: 2016-02-22T17:29:46Z tidy up spacing for ConsumerGroupCommand related to https://issues.apache.org/jira/browse/KAFKA-1476 > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: Onur Karaman > Labels: newbie > Fix For: 0.9.0.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch, > KAFKA-1476.patch, KAFKA-1476.patch, KAFKA-1476.patch, > KAFKA-1476_2014-11-10_11:58:26.patch, KAFKA-1476_2014-11-10_12:04:01.patch, > KAFKA-1476_2014-11-10_12:06:35.patch, KAFKA-1476_2014-12-05_12:00:12.patch, > KAFKA-1476_2015-01-12_16:22:26.patch, KAFKA-1476_2015-01-12_16:31:20.patch, > KAFKA-1476_2015-01-13_10:36:18.patch, KAFKA-1476_2015-01-15_14:30:04.patch, > KAFKA-1476_2015-01-22_02:32:52.patch, KAFKA-1476_2015-01-30_11:09:59.patch, > KAFKA-1476_2015-02-04_15:41:50.patch, KAFKA-1476_2015-02-04_18:03:15.patch, > KAFKA-1476_2015-02-05_03:01:09.patch, KAFKA-1476_2015-02-09_14:37:30.patch, > sample-kafka-consumer-groups-sh-output-1-23-2015.txt, > sample-kafka-consumer-groups-sh-output-2-5-2015.txt, > sample-kafka-consumer-groups-sh-output-2-9-2015.txt, > sample-kafka-consumer-groups-sh-output.txt > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14335283#comment-14335283 ] Neha Narkhede commented on KAFKA-1476: -- Good catch, [~ashishujjain]. Fixed it. > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: Onur Karaman > Labels: newbie > Fix For: 0.8.3 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch, > KAFKA-1476.patch, KAFKA-1476.patch, KAFKA-1476.patch, > KAFKA-1476_2014-11-10_11:58:26.patch, KAFKA-1476_2014-11-10_12:04:01.patch, > KAFKA-1476_2014-11-10_12:06:35.patch, KAFKA-1476_2014-12-05_12:00:12.patch, > KAFKA-1476_2015-01-12_16:22:26.patch, KAFKA-1476_2015-01-12_16:31:20.patch, > KAFKA-1476_2015-01-13_10:36:18.patch, KAFKA-1476_2015-01-15_14:30:04.patch, > KAFKA-1476_2015-01-22_02:32:52.patch, KAFKA-1476_2015-01-30_11:09:59.patch, > KAFKA-1476_2015-02-04_15:41:50.patch, KAFKA-1476_2015-02-04_18:03:15.patch, > KAFKA-1476_2015-02-05_03:01:09.patch, KAFKA-1476_2015-02-09_14:37:30.patch, > sample-kafka-consumer-groups-sh-output-1-23-2015.txt, > sample-kafka-consumer-groups-sh-output-2-5-2015.txt, > sample-kafka-consumer-groups-sh-output-2-9-2015.txt, > sample-kafka-consumer-groups-sh-output.txt > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[
https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14334110#comment-14334110
]
Ashish Kumar Singh commented on KAFKA-1476:
---
[~nehanarkhede] I guess you missed out {{bin/kafka-consumer-groups.sh}} while
committing the patch.
> Get a list of consumer groups
> -
>
> Key: KAFKA-1476
> URL: https://issues.apache.org/jira/browse/KAFKA-1476
> Project: Kafka
> Issue Type: Wish
> Components: tools
>Affects Versions: 0.8.1.1
>Reporter: Ryan Williams
>Assignee: Onur Karaman
> Labels: newbie
> Fix For: 0.8.3
>
> Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch,
> KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch,
> KAFKA-1476.patch, KAFKA-1476.patch, KAFKA-1476.patch,
> KAFKA-1476_2014-11-10_11:58:26.patch, KAFKA-1476_2014-11-10_12:04:01.patch,
> KAFKA-1476_2014-11-10_12:06:35.patch, KAFKA-1476_2014-12-05_12:00:12.patch,
> KAFKA-1476_2015-01-12_16:22:26.patch, KAFKA-1476_2015-01-12_16:31:20.patch,
> KAFKA-1476_2015-01-13_10:36:18.patch, KAFKA-1476_2015-01-15_14:30:04.patch,
> KAFKA-1476_2015-01-22_02:32:52.patch, KAFKA-1476_2015-01-30_11:09:59.patch,
> KAFKA-1476_2015-02-04_15:41:50.patch, KAFKA-1476_2015-02-04_18:03:15.patch,
> KAFKA-1476_2015-02-05_03:01:09.patch, KAFKA-1476_2015-02-09_14:37:30.patch,
> sample-kafka-consumer-groups-sh-output-1-23-2015.txt,
> sample-kafka-consumer-groups-sh-output-2-5-2015.txt,
> sample-kafka-consumer-groups-sh-output-2-9-2015.txt,
> sample-kafka-consumer-groups-sh-output.txt
>
>
> It would be useful to have a way to get a list of consumer groups currently
> active via some tool/script that ships with kafka. This would be helpful so
> that the system tools can be explored more easily.
> For example, when running the ConsumerOffsetChecker, it requires a group
> option
> bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group
> ?
> But, when just getting started with kafka, using the console producer and
> consumer, it is not clear what value to use for the group option. If a list
> of consumer groups could be listed, then it would be clear what value to use.
> Background:
> http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313035#comment-14313035 ] Onur Karaman commented on KAFKA-1476: - Updated reviewboard https://reviews.apache.org/r/29831/diff/ against branch origin/trunk > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: Balaji Seshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch, > KAFKA-1476.patch, KAFKA-1476.patch, KAFKA-1476.patch, > KAFKA-1476_2014-11-10_11:58:26.patch, KAFKA-1476_2014-11-10_12:04:01.patch, > KAFKA-1476_2014-11-10_12:06:35.patch, KAFKA-1476_2014-12-05_12:00:12.patch, > KAFKA-1476_2015-01-12_16:22:26.patch, KAFKA-1476_2015-01-12_16:31:20.patch, > KAFKA-1476_2015-01-13_10:36:18.patch, KAFKA-1476_2015-01-15_14:30:04.patch, > KAFKA-1476_2015-01-22_02:32:52.patch, KAFKA-1476_2015-01-30_11:09:59.patch, > KAFKA-1476_2015-02-04_15:41:50.patch, KAFKA-1476_2015-02-04_18:03:15.patch, > KAFKA-1476_2015-02-05_03:01:09.patch, KAFKA-1476_2015-02-09_14:37:30.patch, > sample-kafka-consumer-groups-sh-output-1-23-2015.txt, > sample-kafka-consumer-groups-sh-output-2-5-2015.txt, > sample-kafka-consumer-groups-sh-output.txt > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309529#comment-14309529 ] Neha Narkhede commented on KAFKA-1476: -- [~onurkaraman] To answer your questions below - bq. If we were to follow through with these suggestions, should they be applied in a later patch? Let's do that separately, since this patch is already large. bq. As for kafka offset storage: I think that's out of the scope of this patch. I made a separate jira for that: https://issues.apache.org/jira/browse/KAFKA-1921 Sounds good. I agree it will be easier to address separately. Will review and checkin the new patch this weekend. Thanks for your patience! > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: Balaji Seshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch, > KAFKA-1476.patch, KAFKA-1476.patch, KAFKA-1476.patch, > KAFKA-1476_2014-11-10_11:58:26.patch, KAFKA-1476_2014-11-10_12:04:01.patch, > KAFKA-1476_2014-11-10_12:06:35.patch, KAFKA-1476_2014-12-05_12:00:12.patch, > KAFKA-1476_2015-01-12_16:22:26.patch, KAFKA-1476_2015-01-12_16:31:20.patch, > KAFKA-1476_2015-01-13_10:36:18.patch, KAFKA-1476_2015-01-15_14:30:04.patch, > KAFKA-1476_2015-01-22_02:32:52.patch, KAFKA-1476_2015-01-30_11:09:59.patch, > KAFKA-1476_2015-02-04_15:41:50.patch, KAFKA-1476_2015-02-04_18:03:15.patch, > KAFKA-1476_2015-02-05_03:01:09.patch, > sample-kafka-consumer-groups-sh-output-1-23-2015.txt, > sample-kafka-consumer-groups-sh-output-2-5-2015.txt, > sample-kafka-consumer-groups-sh-output.txt > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14307057#comment-14307057 ] Onur Karaman commented on KAFKA-1476: - Updated reviewboard https://reviews.apache.org/r/29831/diff/ against branch origin/trunk > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: Balaji Seshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch, > KAFKA-1476.patch, KAFKA-1476.patch, KAFKA-1476.patch, > KAFKA-1476_2014-11-10_11:58:26.patch, KAFKA-1476_2014-11-10_12:04:01.patch, > KAFKA-1476_2014-11-10_12:06:35.patch, KAFKA-1476_2014-12-05_12:00:12.patch, > KAFKA-1476_2015-01-12_16:22:26.patch, KAFKA-1476_2015-01-12_16:31:20.patch, > KAFKA-1476_2015-01-13_10:36:18.patch, KAFKA-1476_2015-01-15_14:30:04.patch, > KAFKA-1476_2015-01-22_02:32:52.patch, KAFKA-1476_2015-01-30_11:09:59.patch, > KAFKA-1476_2015-02-04_15:41:50.patch, KAFKA-1476_2015-02-04_18:03:15.patch, > KAFKA-1476_2015-02-05_03:01:09.patch, > sample-kafka-consumer-groups-sh-output-1-23-2015.txt, > sample-kafka-consumer-groups-sh-output.txt > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306485#comment-14306485 ] Onur Karaman commented on KAFKA-1476: - Updated reviewboard https://reviews.apache.org/r/29831/diff/ against branch origin/trunk > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: Balaji Seshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch, > KAFKA-1476.patch, KAFKA-1476.patch, KAFKA-1476.patch, > KAFKA-1476_2014-11-10_11:58:26.patch, KAFKA-1476_2014-11-10_12:04:01.patch, > KAFKA-1476_2014-11-10_12:06:35.patch, KAFKA-1476_2014-12-05_12:00:12.patch, > KAFKA-1476_2015-01-12_16:22:26.patch, KAFKA-1476_2015-01-12_16:31:20.patch, > KAFKA-1476_2015-01-13_10:36:18.patch, KAFKA-1476_2015-01-15_14:30:04.patch, > KAFKA-1476_2015-01-22_02:32:52.patch, KAFKA-1476_2015-01-30_11:09:59.patch, > KAFKA-1476_2015-02-04_15:41:50.patch, KAFKA-1476_2015-02-04_18:03:15.patch, > sample-kafka-consumer-groups-sh-output-1-23-2015.txt, > sample-kafka-consumer-groups-sh-output.txt > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306232#comment-14306232 ] Onur Karaman commented on KAFKA-1476: - Updated reviewboard https://reviews.apache.org/r/29831/diff/ against branch origin/trunk > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: Balaji Seshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch, > KAFKA-1476.patch, KAFKA-1476.patch, KAFKA-1476.patch, > KAFKA-1476_2014-11-10_11:58:26.patch, KAFKA-1476_2014-11-10_12:04:01.patch, > KAFKA-1476_2014-11-10_12:06:35.patch, KAFKA-1476_2014-12-05_12:00:12.patch, > KAFKA-1476_2015-01-12_16:22:26.patch, KAFKA-1476_2015-01-12_16:31:20.patch, > KAFKA-1476_2015-01-13_10:36:18.patch, KAFKA-1476_2015-01-15_14:30:04.patch, > KAFKA-1476_2015-01-22_02:32:52.patch, KAFKA-1476_2015-01-30_11:09:59.patch, > KAFKA-1476_2015-02-04_15:41:50.patch, > sample-kafka-consumer-groups-sh-output-1-23-2015.txt, > sample-kafka-consumer-groups-sh-output.txt > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14299071#comment-14299071 ] Onur Karaman commented on KAFKA-1476: - Updated reviewboard https://reviews.apache.org/r/29831/diff/ against branch origin/trunk > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: Balaji Seshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch, > KAFKA-1476.patch, KAFKA-1476.patch, KAFKA-1476.patch, > KAFKA-1476_2014-11-10_11:58:26.patch, KAFKA-1476_2014-11-10_12:04:01.patch, > KAFKA-1476_2014-11-10_12:06:35.patch, KAFKA-1476_2014-12-05_12:00:12.patch, > KAFKA-1476_2015-01-12_16:22:26.patch, KAFKA-1476_2015-01-12_16:31:20.patch, > KAFKA-1476_2015-01-13_10:36:18.patch, KAFKA-1476_2015-01-15_14:30:04.patch, > KAFKA-1476_2015-01-22_02:32:52.patch, KAFKA-1476_2015-01-30_11:09:59.patch, > sample-kafka-consumer-groups-sh-output-1-23-2015.txt, > sample-kafka-consumer-groups-sh-output.txt > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14287215#comment-14287215 ] Onur Karaman commented on KAFKA-1476: - Updated reviewboard https://reviews.apache.org/r/29831/diff/ against branch origin/trunk > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: Balaji Seshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch, > KAFKA-1476.patch, KAFKA-1476.patch, KAFKA-1476.patch, > KAFKA-1476_2014-11-10_11:58:26.patch, KAFKA-1476_2014-11-10_12:04:01.patch, > KAFKA-1476_2014-11-10_12:06:35.patch, KAFKA-1476_2014-12-05_12:00:12.patch, > KAFKA-1476_2015-01-12_16:22:26.patch, KAFKA-1476_2015-01-12_16:31:20.patch, > KAFKA-1476_2015-01-13_10:36:18.patch, KAFKA-1476_2015-01-15_14:30:04.patch, > KAFKA-1476_2015-01-22_02:32:52.patch, > sample-kafka-consumer-groups-sh-output.txt > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[
https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14279715#comment-14279715
]
Neha Narkhede commented on KAFKA-1476:
--
Thanks for attaching the output, [~onurkaraman]. Here are some review comments-
1. The error stack trace for describing groups that don't exist is pretty ugly,
so let's remove that and output a message that states the group doesn't exist
{code}
vagrant@worker1:/opt/kafka$ bin/kafka-consumer-groups.sh --zookeeper
192.168.50.11:2181 --describe --group g3
Error while executing consumer group command
org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode
for /consumers/g3/owners
org.I0Itec.zkclient.exception.ZkNoNodeException:
org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode
for /consumers/g3/owners
at org.I0Itec.zkclient.exception.ZkException.create(ZkException.java:47)
at org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:685)
at org.I0Itec.zkclient.ZkClient.getChildren(ZkClient.java:413)
at org.I0Itec.zkclient.ZkClient.getChildren(ZkClient.java:409)
at kafka.utils.ZkUtils$.getTopicsByConsumerGroup(ZkUtils.scala:758)
at
kafka.admin.ConsumerGroupCommand$.describe(ConsumerGroupCommand.scala:81)
at kafka.admin.ConsumerGroupCommand$.main(ConsumerGroupCommand.scala:56)
at kafka.admin.ConsumerGroupCommand.main(ConsumerGroupCommand.scala)
Caused by: org.apache.zookeeper.KeeperException$NoNodeException:
KeeperErrorCode = NoNode for /consumers/g3/owners
at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1500)
at org.I0Itec.zkclient.ZkConnection.getChildren(ZkConnection.java:99)
at org.I0Itec.zkclient.ZkClient$2.call(ZkClient.java:416)
at org.I0Itec.zkclient.ZkClient$2.call(ZkClient.java:413)
at org.I0Itec.zkclient.ZkClient.retryUntilConnected(ZkClient.java:675)
... 6 more
{code}
2. I'm not sure why the header fields are not comma separated but the data is.
It will be best to stick to one separator only. So if you pick , as the
separator, then the output should change to
{code}
GROUP, TOPIC, PID, CURRENT, OFFSET, LOG SIZE, LAG, OWNER
g2, t2, 0, 1, 1, 0, none
{code}
3. For deleting only a specific topic's information, it is sufficient to rely
on the user specifying the --topic along with --delete. The --delete-with-topic
option seems unnecessary.
> Get a list of consumer groups
> -
>
> Key: KAFKA-1476
> URL: https://issues.apache.org/jira/browse/KAFKA-1476
> Project: Kafka
> Issue Type: Wish
> Components: tools
>Affects Versions: 0.8.1.1
>Reporter: Ryan Williams
>Assignee: Balaji Seshadri
> Labels: newbie
> Fix For: 0.9.0
>
> Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch,
> KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch,
> KAFKA-1476.patch, KAFKA-1476.patch, KAFKA-1476.patch,
> KAFKA-1476_2014-11-10_11:58:26.patch, KAFKA-1476_2014-11-10_12:04:01.patch,
> KAFKA-1476_2014-11-10_12:06:35.patch, KAFKA-1476_2014-12-05_12:00:12.patch,
> KAFKA-1476_2015-01-12_16:22:26.patch, KAFKA-1476_2015-01-12_16:31:20.patch,
> KAFKA-1476_2015-01-13_10:36:18.patch, KAFKA-1476_2015-01-15_14:30:04.patch,
> sample-kafka-consumer-groups-sh-output.txt
>
>
> It would be useful to have a way to get a list of consumer groups currently
> active via some tool/script that ships with kafka. This would be helpful so
> that the system tools can be explored more easily.
> For example, when running the ConsumerOffsetChecker, it requires a group
> option
> bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group
> ?
> But, when just getting started with kafka, using the console producer and
> consumer, it is not clear what value to use for the group option. If a list
> of consumer groups could be listed, then it would be clear what value to use.
> Background:
> http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14279407#comment-14279407 ] Onur Karaman commented on KAFKA-1476: - Updated reviewboard https://reviews.apache.org/r/29831/diff/ against branch origin/trunk > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: Balaji Seshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch, > KAFKA-1476.patch, KAFKA-1476.patch, KAFKA-1476.patch, > KAFKA-1476_2014-11-10_11:58:26.patch, KAFKA-1476_2014-11-10_12:04:01.patch, > KAFKA-1476_2014-11-10_12:06:35.patch, KAFKA-1476_2014-12-05_12:00:12.patch, > KAFKA-1476_2015-01-12_16:22:26.patch, KAFKA-1476_2015-01-12_16:31:20.patch, > KAFKA-1476_2015-01-13_10:36:18.patch, KAFKA-1476_2015-01-15_14:30:04.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14275714#comment-14275714 ] Mayuresh Gharat commented on KAFKA-1476: Was just thinking if this can be exposed as an API which can be used by the ImportExport tool and ConsumerOffsetChecker as well. > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: Balaji Seshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch, > KAFKA-1476.patch, KAFKA-1476.patch, KAFKA-1476.patch, > KAFKA-1476_2014-11-10_11:58:26.patch, KAFKA-1476_2014-11-10_12:04:01.patch, > KAFKA-1476_2014-11-10_12:06:35.patch, KAFKA-1476_2014-12-05_12:00:12.patch, > KAFKA-1476_2015-01-12_16:22:26.patch, KAFKA-1476_2015-01-12_16:31:20.patch, > KAFKA-1476_2015-01-13_10:36:18.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14275676#comment-14275676 ] Onur Karaman commented on KAFKA-1476: - Updated reviewboard https://reviews.apache.org/r/29831/diff/ against branch origin/trunk > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: Balaji Seshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch, > KAFKA-1476.patch, KAFKA-1476.patch, KAFKA-1476.patch, > KAFKA-1476_2014-11-10_11:58:26.patch, KAFKA-1476_2014-11-10_12:04:01.patch, > KAFKA-1476_2014-11-10_12:06:35.patch, KAFKA-1476_2014-12-05_12:00:12.patch, > KAFKA-1476_2015-01-12_16:22:26.patch, KAFKA-1476_2015-01-12_16:31:20.patch, > KAFKA-1476_2015-01-13_10:36:18.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14274481#comment-14274481 ] Onur Karaman commented on KAFKA-1476: - Updated reviewboard https://reviews.apache.org/r/29831/diff/ against branch origin/trunk > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: Balaji Seshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch, > KAFKA-1476.patch, KAFKA-1476.patch, KAFKA-1476.patch, > KAFKA-1476_2014-11-10_11:58:26.patch, KAFKA-1476_2014-11-10_12:04:01.patch, > KAFKA-1476_2014-11-10_12:06:35.patch, KAFKA-1476_2014-12-05_12:00:12.patch, > KAFKA-1476_2015-01-12_16:22:26.patch, KAFKA-1476_2015-01-12_16:31:20.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14274473#comment-14274473 ] Onur Karaman commented on KAFKA-1476: - Updated reviewboard https://reviews.apache.org/r/29831/diff/ against branch origin/trunk > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: Balaji Seshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch, > KAFKA-1476.patch, KAFKA-1476.patch, KAFKA-1476.patch, > KAFKA-1476_2014-11-10_11:58:26.patch, KAFKA-1476_2014-11-10_12:04:01.patch, > KAFKA-1476_2014-11-10_12:06:35.patch, KAFKA-1476_2014-12-05_12:00:12.patch, > KAFKA-1476_2015-01-12_16:22:26.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14274460#comment-14274460 ] Onur Karaman commented on KAFKA-1476: - Created reviewboard https://reviews.apache.org/r/29831/diff/ against branch origin/trunk > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: Balaji Seshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch, > KAFKA-1476.patch, KAFKA-1476.patch, KAFKA-1476.patch, > KAFKA-1476_2014-11-10_11:58:26.patch, KAFKA-1476_2014-11-10_12:04:01.patch, > KAFKA-1476_2014-11-10_12:06:35.patch, KAFKA-1476_2014-12-05_12:00:12.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14274455#comment-14274455 ] Neha Narkhede commented on KAFKA-1476: -- [~balaji.sesha...@dish.com], [~onurkaraman] Thanks for incorporating review suggestions. I also think that [~onurkaraman]'s approach is good since it is easier to review a tool rewrite if it has all the functionality. That way we can ensure that we end up with something that is immediately usable and complete. > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: Balaji Seshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch, > KAFKA-1476.patch, KAFKA-1476.patch, KAFKA-1476_2014-11-10_11:58:26.patch, > KAFKA-1476_2014-11-10_12:04:01.patch, KAFKA-1476_2014-11-10_12:06:35.patch, > KAFKA-1476_2014-12-05_12:00:12.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14274451#comment-14274451 ] Onur Karaman commented on KAFKA-1476: - I have some stuff for sub-task KAFKA-1826 that I'd like to check in. Since the patch for KAFKA-1476 looked almost ready, I went ahead and tried incorporating some of the suggestions from the reviewboard and merged in the command to delete all consumer group information for a given topic in zookeeper. I hope to have the reviewboard up shortly. > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: Balaji Seshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch, > KAFKA-1476.patch, KAFKA-1476.patch, KAFKA-1476_2014-11-10_11:58:26.patch, > KAFKA-1476_2014-11-10_12:04:01.patch, KAFKA-1476_2014-11-10_12:06:35.patch, > KAFKA-1476_2014-12-05_12:00:12.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14235908#comment-14235908 ] BalajiSeshadri commented on KAFKA-1476: --- Updated reviewboard https://reviews.apache.org/r/27693/diff/ against branch origin/trunk > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: Balaji Seshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch, > KAFKA-1476.patch, KAFKA-1476.patch, KAFKA-1476_2014-11-10_11:58:26.patch, > KAFKA-1476_2014-11-10_12:04:01.patch, KAFKA-1476_2014-11-10_12:06:35.patch, > KAFKA-1476_2014-12-05_12:00:12.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14234757#comment-14234757 ] Neha Narkhede commented on KAFKA-1476: -- [~techybalaji] KAFKA-1694 is designing the command line tools but it is ways away from being completed. You maybe able to get this done before that, is my guess. > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: Balaji Seshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch, > KAFKA-1476.patch, KAFKA-1476.patch, KAFKA-1476_2014-11-10_11:58:26.patch, > KAFKA-1476_2014-11-10_12:04:01.patch, KAFKA-1476_2014-11-10_12:06:35.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14234415#comment-14234415 ] BalajiSeshadri commented on KAFKA-1476: --- [~nehanarkhede] or [~junrao] or [~jkreps] Please assign the ticket to [~techybalaji]. Dish is not supporting my contribution in work hours so i would like continue as personal work. Please reassign ticket to techybalaji in future. > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: BalajiSeshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch, > KAFKA-1476.patch, KAFKA-1476.patch, KAFKA-1476_2014-11-10_11:58:26.patch, > KAFKA-1476_2014-11-10_12:04:01.patch, KAFKA-1476_2014-11-10_12:06:35.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14226947#comment-14226947 ] BalajiSeshadri commented on KAFKA-1476: --- [~nehanarkhede] I was requesting for comment regarding exposing as API.Are you guys planning for it ?. > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: BalajiSeshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch, > KAFKA-1476.patch, KAFKA-1476.patch, KAFKA-1476_2014-11-10_11:58:26.patch, > KAFKA-1476_2014-11-10_12:04:01.patch, KAFKA-1476_2014-11-10_12:06:35.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14226935#comment-14226935 ] Neha Narkhede commented on KAFKA-1476: -- [~balaji.sesha...@dish.com] I had already left my comments on the rb. > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: BalajiSeshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch, > KAFKA-1476.patch, KAFKA-1476.patch, KAFKA-1476_2014-11-10_11:58:26.patch, > KAFKA-1476_2014-11-10_12:04:01.patch, KAFKA-1476_2014-11-10_12:06:35.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14226186#comment-14226186 ] BalajiSeshadri commented on KAFKA-1476: --- [~nehanarkhede] Please let me know your comments. > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: BalajiSeshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch, > KAFKA-1476.patch, KAFKA-1476.patch, KAFKA-1476_2014-11-10_11:58:26.patch, > KAFKA-1476_2014-11-10_12:04:01.patch, KAFKA-1476_2014-11-10_12:06:35.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14219567#comment-14219567 ] Ashish Kumar Singh commented on KAFKA-1476: --- [~balaji.sesha...@dish.com] I do not see why we can not expose this as an API, but AFAIK there is some effort going on, KAFKA-1694, which may take care of this. I would wait for [~nehanarkhede] or some project veteran to respond. > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: BalajiSeshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch, > KAFKA-1476.patch, KAFKA-1476.patch, KAFKA-1476_2014-11-10_11:58:26.patch, > KAFKA-1476_2014-11-10_12:04:01.patch, KAFKA-1476_2014-11-10_12:06:35.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14218281#comment-14218281 ] BalajiSeshadri commented on KAFKA-1476: --- [~singhashish] or [~nehanarkhede] Can we expose this as an API that returns offset data instead of just command line tool. In DISH we have requirement to display lags in UI,it would be useful to everybody if we do it as API thats used by tool as wells as UI. Let me know your thoughts,i would fix the review comments after your response. Thanks, Balaji > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: BalajiSeshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch, > KAFKA-1476.patch, KAFKA-1476.patch, KAFKA-1476_2014-11-10_11:58:26.patch, > KAFKA-1476_2014-11-10_12:04:01.patch, KAFKA-1476_2014-11-10_12:06:35.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14215730#comment-14215730 ] Ashish Kumar Singh commented on KAFKA-1476: --- [~techybalaji] Left some comments on RB. > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: BalajiSeshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch, > KAFKA-1476.patch, KAFKA-1476.patch, KAFKA-1476_2014-11-10_11:58:26.patch, > KAFKA-1476_2014-11-10_12:04:01.patch, KAFKA-1476_2014-11-10_12:06:35.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14205175#comment-14205175 ] BalajiSeshadri commented on KAFKA-1476: --- [~nehanarkhede] Please find review comments implemented except one. https://reviews.apache.org/r/27693/ > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: BalajiSeshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch, > KAFKA-1476.patch, KAFKA-1476.patch, KAFKA-1476_2014-11-10_11:58:26.patch, > KAFKA-1476_2014-11-10_12:04:01.patch, KAFKA-1476_2014-11-10_12:06:35.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14205171#comment-14205171 ] BalajiSeshadri commented on KAFKA-1476: --- Updated reviewboard https://reviews.apache.org/r/27693/diff/ against branch origin/trunk > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: BalajiSeshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch, > KAFKA-1476.patch, KAFKA-1476.patch, KAFKA-1476_2014-11-10_11:58:26.patch, > KAFKA-1476_2014-11-10_12:04:01.patch, KAFKA-1476_2014-11-10_12:06:35.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14205166#comment-14205166 ] BalajiSeshadri commented on KAFKA-1476: --- Updated reviewboard https://reviews.apache.org/r/27693/diff/ against branch origin/trunk > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: BalajiSeshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch, > KAFKA-1476.patch, KAFKA-1476.patch, KAFKA-1476_2014-11-10_11:58:26.patch, > KAFKA-1476_2014-11-10_12:04:01.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14205160#comment-14205160 ] BalajiSeshadri commented on KAFKA-1476: --- Updated reviewboard https://reviews.apache.org/r/27693/diff/ against branch origin/trunk > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: BalajiSeshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch, > KAFKA-1476.patch, KAFKA-1476.patch, KAFKA-1476_2014-11-10_11:58:26.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14204308#comment-14204308 ] Neha Narkhede commented on KAFKA-1476: -- [~balaji.sesha...@dish.com] Sorry for the late review. I have a few suggestions on the review board. > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: BalajiSeshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch, > KAFKA-1476.patch, KAFKA-1476.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200575#comment-14200575 ] BalajiSeshadri commented on KAFKA-1476: --- Created review board for just this JIRA. [~nehanarkhede] or [~junrao] or [~jkreps] Please review. https://reviews.apache.org/r/27693/diff/ > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: BalajiSeshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch, > KAFKA-1476.patch, KAFKA-1476.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200570#comment-14200570 ] BalajiSeshadri commented on KAFKA-1476: --- Created reviewboard https://reviews.apache.org/r/27693/diff/ against branch origin/trunk > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: BalajiSeshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch, > KAFKA-1476.patch, KAFKA-1476.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200556#comment-14200556 ] BalajiSeshadri commented on KAFKA-1476: --- [~nehanarkhede] or [~junrao] or [~jkreps] Can anyone of you please review this ?.I created review board for both of my patches KAFKA-328 and KAFKA-1476. https://reviews.apache.org/r/27691/diff/ > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: BalajiSeshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch, > KAFKA-1476.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14200550#comment-14200550 ] BalajiSeshadri commented on KAFKA-1476: --- Created reviewboard https://reviews.apache.org/r/27691/diff/ against branch origin/trunk > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: BalajiSeshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch, > KAFKA-1476.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14198633#comment-14198633 ] BalajiSeshadri commented on KAFKA-1476: --- [~junrao] or [~jkreps] Can any of you review it,seems like neha is pretty busy. > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: BalajiSeshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14195419#comment-14195419 ] BalajiSeshadri commented on KAFKA-1476: --- [~nehanarkhede] can you please review my patch,this one has list and describeGroup functionality. > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: BalajiSeshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14192269#comment-14192269 ] BalajiSeshadri commented on KAFKA-1476: --- [~nehanarkhede] Can i get commiter access ?.It looks like i have to delete everything and clone everytime i submit a patch or i'm not doing right thing. This slows my contribution. > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: BalajiSeshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476-REVIEW-COMMENTS.patch, KAFKA-1476.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14175503#comment-14175503 ] BalajiSeshadri commented on KAFKA-1476: --- [~nehanarkhede] Please find the attached code. > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: BalajiSeshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: ConsumerCommand.scala, KAFKA-1476-LIST-GROUPS.patch, > KAFKA-1476-RENAME.patch, KAFKA-1476.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14175500#comment-14175500 ] BalajiSeshadri commented on KAFKA-1476: --- [~nehanarkhede] I tried to implement the describe group,but the cal is getting stuck in while loop of readFrom. Please see log below. io.EOFException: Received -1 when reading from channel, socket has likely been closed. at kafka.utils.Utils$.read(Utils.scala:381) at kafka.network.BoundedByteBufferReceive.readFrom(BoundedByteBufferReceive.scala:54) at kafka.network.Receive$class.readCompletely(Transmission.scala:56) at kafka.network.BoundedByteBufferReceive.readCompletely(BoundedByteBufferReceive.scala:29) at kafka.network.BlockingChannel.receive(BlockingChannel.scala:108) at kafka.client.ClientUtils$.channelToOffsetManager(ClientUtils.scala:154) at kafka.tools.ConsumerCommand$.getOffsetsByTopic(ConsumerCommand.scala:92) at kafka.tools.ConsumerCommand$.main(ConsumerCommand.scala:67) at kafka.tools.ConsumerCommand.main(ConsumerCommand.scala) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at com.intellij.rt.execution.application.AppMain.main(AppMain.java:134) java.io.EOFException: Received -1 when reading from channel, socket has likely been closed. at kafka.utils.Utils$.read(Utils.scala:381) at kafka.network.BoundedByteBufferReceive.readFrom(BoundedByteBufferReceive.scala:54) at kafka.network.Receive$class.readCompletely(Transmission.scala:56) at kafka.network.BoundedByteBufferReceive.readCompletely(BoundedByteBufferReceive.scala:29) at kafka.network.BlockingChannel.receive(BlockingChannel.scala:108) at kafka.client.ClientUtils$.channelToOffsetManager(ClientUtils.scala:154) at kafka.tools.ConsumerCommand$.getOffsetsByTopic(ConsumerCommand.scala:92) at kafka.tools.ConsumerCommand$.main(ConsumerCommand.scala:67) at kafka.tools.ConsumerCommand.main(ConsumerCommand.scala) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at com.intellij.rt.execution.application.AppMain.main(AppMain.java:134) java.io.EOFException: Received -1 when reading from channel, socket has likely been closed. at kafka.utils.Utils$.read(Utils.scala:381) at kafka.network.BoundedByteBufferReceive.readFrom(BoundedByteBufferReceive.scala:54) at kafka.network.Receive$class.readCompletely(Transmission.scala:56) at kafka.network.BoundedByteBufferReceive.readCompletely(BoundedByteBufferReceive.scala:29) at kafka.network.BlockingChannel.receive(BlockingChannel.scala:108) at kafka.client.ClientUtils$.channelToOffsetManager(ClientUtils.scala:154) at kafka.tools.ConsumerCommand$.getOffsetsByTopic(ConsumerCommand.scala:92) at kafka.tools.ConsumerCommand$.main(ConsumerCommand.scala:67) at kafka.tools.ConsumerCommand.main(ConsumerCommand.scala) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at com.intellij.rt.execution.application.AppMain.main(AppMain.java:134) Its just continously going through while loop of kafka.client.ClientUtils$.channelToOffsetManager(ClientUtils.scala:154). > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: BalajiSeshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: KAFKA-1476-LIST-GROUPS.patch, KAFKA-1476-RENAME.patch, > KAFKA-1476.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --top
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14174052#comment-14174052 ] Neha Narkhede commented on KAFKA-1476: -- [~balaji.sesha...@dish.com] Thanks for the patch. Few comments- 1. The "CONSUMER GROUPS *" format is inconsistent with the other tools. For example, kafka-topics --list. Can we please remove it? 2. Currently, your tool only supports the list option. So the topic option is not required. 3. The getConsumerGroups() API is better suited for ZkUtils. Would you mind addressing the other feature requirements as well? Alternately, we can limit this JIRA to list and describe. > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: BalajiSeshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: KAFKA-1476-LIST-GROUPS.patch, KAFKA-1476-RENAME.patch, > KAFKA-1476.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14165784#comment-14165784 ] BalajiSeshadri commented on KAFKA-1476: --- [~nehanarkhede] Please check list consumer groups functionality,will add the describe groups and lag after first review. > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: BalajiSeshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: KAFKA-1476-LIST-GROUPS.patch, KAFKA-1476-RENAME.patch, > KAFKA-1476.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14147200#comment-14147200 ] BalajiSeshadri commented on KAFKA-1476: --- Will do by this week end. > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: BalajiSeshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: KAFKA-1476-RENAME.patch, KAFKA-1476.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14147189#comment-14147189 ] Neha Narkhede commented on KAFKA-1476: -- [~balaji.sesha...@dish.com] Wondering if you are going to get a chance to work on this? > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: BalajiSeshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: KAFKA-1476-RENAME.patch, KAFKA-1476.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14142170#comment-14142170 ] Neha Narkhede commented on KAFKA-1476: -- [~balaji.sesha...@dish.com],for #1, #2, please read my previous comment. For #3, we need For reading offsets, --offsets --describe --group Let's file another JIRA for reset offset tool as that requires more thought and that tool doesn't even exist today. > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: Balaji Seshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: KAFKA-1476-RENAME.patch, KAFKA-1476.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14073374#comment-14073374 ] Balaji Seshadri commented on KAFKA-1476: Hi [~neha.narkh...@gmail.com], Looks like we are in design mode before going into implementation.Removing offset checker and making ConsumerCommand for handling all management related to consumers is definitely good idea. This would add below tasks 1) --list -> will list all consumer groups 2) --describeGroup -> describes about this group,who are all the consumers of the group whats the lag on it. 3) --resetOffset --group --groupName -> this might reset the offset. This would be good list to add as usage would be easy.Also it would be better expose these as management API's instead of just main program,so anybody can build UI on top it. I added the list all already for remaining ones i need more inputs on where can i get the data. Please advise. > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: BalajiSeshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: KAFKA-1476-RENAME.patch, KAFKA-1476.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14070630#comment-14070630 ] Neha Narkhede commented on KAFKA-1476: -- Thanks for the updated patch [~balaji.sesha...@dish.com]. I have the same review suggestions I had earlier - The tool should have 2 high level options --groups and --offsets. If the user specifies --groups, 2 more options should get activated 1) --list will list all groups and 2) --describe --group will describe the group members. Similarly, if the user specifies --offsets, 2 options should get activated 3) --describe --group will list the offsets for the group. 4) --reset which will change the offsets for the consumer group. However, this option is more relevant after we have the new consumer. For the purposes of this patch, it will be good to have #1, #2 and #3 as described above. The patch can also thus get rid of ConsumerOffsetChecker. What are your thoughts? Maybe there is another way to model this that I may be missing, my suggestions are mainly based on the topics tool which works pretty well. > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams >Assignee: BalajiSeshadri > Labels: newbie > Fix For: 0.9.0 > > Attachments: KAFKA-1476-RENAME.patch, KAFKA-1476.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066776#comment-14066776 ] BalajiSeshadri commented on KAFKA-1476: --- Please find patch attached after renaming the class. > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams > Labels: newbie > Fix For: 0.9.0 > > Attachments: KAFKA-1476-RENAME.patch, KAFKA-1476.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066720#comment-14066720 ] Balaji Seshadri commented on KAFKA-1476: Which shell script should i change,i wrote only the class which i can change ?. > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams > Labels: newbie > Fix For: 0.9.0 > > Attachments: KAFKA-1476.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066698#comment-14066698 ] Balaji Seshadri commented on KAFKA-1476: ~jay.kreps > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams > Labels: newbie > Fix For: 0.9.0 > > Attachments: KAFKA-1476.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066699#comment-14066699 ] Guozhang Wang commented on KAFKA-1476: -- You are already ahead of us, since the coordinator is still under development :) We just wanted to think in advance of what kind of consumer queries we would like tooling now and in the future, and they can be easily implemented with the proposed design. > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams > Labels: newbie > Fix For: 0.9.0 > > Attachments: KAFKA-1476.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066695#comment-14066695 ] Balaji Seshadri commented on KAFKA-1476: I have completed 1 and 2,will work on 3/4.Can you guys give me some pointers on how to query coordinator. May i should add print Usage for 1 and 2. > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams > Labels: newbie > Fix For: 0.9.0 > > Attachments: KAFKA-1476.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066613#comment-14066613 ] Guozhang Wang commented on KAFKA-1476: -- 1. List groups: return the list of group ids. 2. List groups (topic_name): return the list of group ids at least one member of which is consuming the topic. 3. Describe group (group_id): return the current generation id, members of the group (consumer_ids), subscribed topics or topic/partitions of each consumer, and their current offsets. 4. Set group consumption offset (consumer_id, generation_id, [partition, offset]): set the offsets of the consumed partitions for a given consumer, and the right generation id. 1) would work with ZK only, 2) requires ZK and the coordinator, 3) and 4) requires coordinator only. Also 3) would potentially replace the current ConsumerOffsetChecker. > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams > Labels: newbie > Fix For: 0.9.0 > > Attachments: KAFKA-1476.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066583#comment-14066583 ] Jay Kreps commented on KAFKA-1476: -- Cool, so [~balaji.seshadri] would you be willing to revamp this a bit? Two approaches: 1. Just change the class name to ConsumerCommand and shell script to kafka-consumers.sh even though it only implements the list groups functionality at the moment. We can file a follow-up bug to implement some of the additional features which anyone can pick up. 2. Implement some of the proposed features now on this ticket. Most of them should be pretty straight-forward... Either way is fine. > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams > Labels: newbie > Fix For: 0.9.0 > > Attachments: KAFKA-1476.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066488#comment-14066488 ] Todd Palino commented on KAFKA-1476: I tend to agree, ~jkreps. We currently have kafka-topics.sh that groups a number of topic-centric functions in a single command, and I think that's a good model to continue with. On the consumer side, I can think of the following things we should be able to do: List groups Describe group (should include the hosts in the group) List topics by group (for a given group, what topics does it consume) Describe topic by group (for a given group and topic, list partitions, host owning the partition, and the committed offset) Set offsets (for a given group and topic, explicitly set the offsets. Should allow setting to smallest, largest, and custom, which is explicitly setting the value for each partition) List groups by topic (given a topic name, what groups consume it) All of these functions have to work with both Zookeeper and group management within the brokers (once implemented). I want to know which one the data comes from as part of the results, but I don't want to have to specify it in advance. As far as the offset checker goes, I could go either way on that. Ultimately, it combines information from two different areas (consumer and broker), which means it doesn't fit cleanly in either one even if we all agree that it's really a consumer function. I think it's fine if it stays where it is for now. > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams > Labels: newbie > Fix For: 0.9.0 > > Attachments: KAFKA-1476.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066471#comment-14066471 ] Jay Kreps commented on KAFKA-1476: -- This looks good to me. One thing we should think about: does this make sense as a standalone command? We have something of a history of making a new command for every possible thing you could do. Often it is a little more usable if we group these together a bit into logically related items. For example, I could imagine having a command bin/kafka-consumers.sh --list-groups or something like that that also performed other consumer-related commands. This sort of the makes the tools a little more usable for users. [~guozhang], [~toddpalino], [~nehanarkhede] what do you guys think? As we do the consumer co-ordinator what admin operations are we going to want tooling for? How does this relate to the consumer offset checker, should that be combined? Let's think this through and then just name this thing appropriately even if it only has 10% of the functionality we envision at the moment. > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams > Labels: newbie > Fix For: 0.9.0 > > Attachments: KAFKA-1476.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14066467#comment-14066467 ] Neha Narkhede commented on KAFKA-1476: -- Thanks for the patch, [~balaji.sesha...@dish.com]. I think it may be worth trying to combine consumer related tooling into a single tool, much like the topics tool. I can imagine it having a --groups and --offsets option. So, --groups --list will list all groups and --groups --describe --group will describe the group. Similarly --offsets --group will list the offsets. > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams > Labels: newbie > Fix For: 0.9.0 > > Attachments: KAFKA-1476.patch > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14065534#comment-14065534 ] BalajiSeshadri commented on KAFKA-1476: --- I'm working on this JIRA ticket to create tool to list consumer groups based on topic provided. > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams > Labels: newbie > Fix For: 0.9.0 > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1476) Get a list of consumer groups
[ https://issues.apache.org/jira/browse/KAFKA-1476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14059209#comment-14059209 ] nicu marasoiu commented on KAFKA-1476: -- if you just browse zookeeper with some standard zkCli.sh and such, would you not be able to get the directory listing, according to the directory structure in zookeeper which should be documented somewhere for the kafka? > Get a list of consumer groups > - > > Key: KAFKA-1476 > URL: https://issues.apache.org/jira/browse/KAFKA-1476 > Project: Kafka > Issue Type: Wish > Components: tools >Affects Versions: 0.8.1.1 >Reporter: Ryan Williams > Labels: newbie > Fix For: 0.9.0 > > > It would be useful to have a way to get a list of consumer groups currently > active via some tool/script that ships with kafka. This would be helpful so > that the system tools can be explored more easily. > For example, when running the ConsumerOffsetChecker, it requires a group > option > bin/kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic test --group > ? > But, when just getting started with kafka, using the console producer and > consumer, it is not clear what value to use for the group option. If a list > of consumer groups could be listed, then it would be clear what value to use. > Background: > http://mail-archives.apache.org/mod_mbox/kafka-users/201405.mbox/%3cCAOq_b1w=slze5jrnakxvak0gu9ctdkpazak1g4dygvqzbsg...@mail.gmail.com%3e -- This message was sent by Atlassian JIRA (v6.2#6252)
