> However it turns out to be difficult to know the existing consumer group > strings. Is the message format in __consumer_offsets "public"/stable in any > way or is there a better way of listing the existing group names?
Yes it is "stable" but not described in the user documentation since it is an internal implementation detail. You can take a look at the OffsetManager code and specifically the OffsetsMessageFormatter class. https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/server/OffsetManager.scala Joel > > > 2014-12-11 20:59 GMT+01:00 svante karlsson <s...@csi.se>: > > > > We're using 0.82 beta and a homegrown c++ async library based on boost > > asio that has support for the offset api. > > (apikeys OffsetCommitRequest = 8, OffsetFetchRequest = 9, > > ConsumerMetadataRequest = 10) > > > > If we use a java client and commit an offset then the consumer group shows > > up in the response from ConsumerMetadataRequest. However I cant figure out > > how to create a new one using the Kafka API. > > > > Also, my __consumer_offsets topic shows up with a replication factor of 1. > > Is that changeable? > > > > thanks, > > svante > >
