Okay, I see. According to this document, we need to set a consumer id for each groupid and topic: https://cwiki.apache.org/confluence/display/KAFKA/Kafka+data+structures+in+Zookeeper
I created a JIRA for fixing this issue: https://issues.apache.org/jira/browse/FLINK-4822 On Wed, Oct 12, 2016 at 8:08 PM, Anchit Jatana <development.anc...@gmail.com > wrote: > Hi Robert, > > Thanks for your response. I just figured out what the issue is. > > The reason why- bin/kafka-consumer-groups.sh --zookeeper > <zookeeper-url:port> --describe --group <group-id> is not showing any > result > is because of the absence of the > > /consumers/<group-id>/owners/<topic> in the zookeeper. > > The flink application is creating and updating > /consumers/<group-id>/offsets/<topic>/<partition> but not creating > "owners" > Znode > > If I manually create the Znode using the following: > > create /consumers/<group-id>/owners “firstchildren” > > create /consumers/<group-id>/owners/<topic> null > > It works fine, bin/kafka-consumer-groups.sh --zookeeper > <zookeeper-url:port> > --describe --group <group-id> starts pulling offset results for me. > > I think this needs to be corrected in the application: to check and create > "/consumers/<group-id>/owners/<topic>" if it does not exist. > > Regards, > Anchit > > > > -- > View this message in context: http://apache-flink-user- > mailing-list-archive.2336050.n4.nabble.com/Flink-Kafka- > connector08-not-updating-the-offsets-with-the-zookeeper-tp9469p9498.html > Sent from the Apache Flink User Mailing List archive. mailing list archive > at Nabble.com. >
