[
https://issues.apache.org/jira/browse/KAFKA-4723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15850173#comment-15850173
]
Jason Bew commented on KAFKA-4723:
----------------------------------
On further examination it does in deed look as though the brokers are caught in
a confused state. Some offsets are correctly stored in Kafka, but some are
still stored in Zookeeper despite doing a rolling restart to store in both
zookeeper and kafka, and then just to kafka.
Not sure if this is a bug or some other problem has arisen.
> offsets.storage=kafka - groups stuck in rebalancing with committed offsets
> --------------------------------------------------------------------------
>
> Key: KAFKA-4723
> URL: https://issues.apache.org/jira/browse/KAFKA-4723
> Project: Kafka
> Issue Type: Bug
> Affects Versions: 0.10.0.1
> Reporter: Jason Bew
> Priority: Minor
>
> Hi, I have moved offset store to kafka only, when I now run;
> bin/kafka-consumer-groups.sh --bootstrap-server localhost:9094 --describe
> --new-consumer --group my_consumer_group
> I get the message;
> Consumer group `my_consumer_group` does not exist or is rebalancing.
> I have found the issue KAFKA-3144 however this refers to consumer groups
> that have no committed offsets, the groups I am looking do and are constantly
> in use.
> using --list I get all my consumer groups returned. Although some are
> inactive I have around 6 very active ones (millions of messages a day
> constantly). looking at the mbean data and kafka tool etc I can see the lags
> and offsets changing every second. Therefore I would expect the
> kafka-consumer-groups.sh script to return the lags and offsets for all 6
> active consumer groups.
> I think what has happened is when I moved offset storage to kafka from
> zookeeper (and then disabled sending to both), something has got confused.
> Querying zookeeper I get the offsets for the alleged missing consumer groups
> - but they should be stored and committed to kafka.
> Many thanks.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
