Re: Re: kafka-consumer-groups.sh delete group with new-consumer

2016-08-14 Thread Guozhang Wang
t; > Yuanjia Li > > From: Guozhang Wang > Date: 2016-08-13 03:05 > To: users@kafka.apache.org > Subject: Re: kafka-consumer-groups.sh delete group with new-consumer > Hi Yuanjia, > > New consumer's group registry information is stored on the Kafka brokers, > not ZK

Re: Re: kafka-consumer-groups.sh delete group with new-consumer

2016-08-14 Thread yuanjia8...@163.com
Hi Guozhang, Thanks for replies. And which is the expiration parameter? Can I config it on broker or on consumer? Thanks and Regards Yuanjia Li From: Guozhang Wang Date: 2016-08-13 03:05 To: users@kafka.apache.org Subject: Re: kafka-consumer-groups.sh delete group with new-consumer Hi

Re: kafka-consumer-groups.sh delete group with new-consumer

2016-08-13 Thread tao xiao
Shouldn't the default offset retention minutes be 1440? offsets.retention.minutes=1440 On Sat, 13 Aug 2016 at 03:05 Guozhang Wang wrote: > Hi Yuanjia, > > New consumer's group registry information is stored on the Kafka brokers, > not ZK any more, and the brokers use heartbeats to detect if the

Re: kafka-consumer-groups.sh delete group with new-consumer

2016-08-13 Thread R Krishna
Guozhang, don't we just need latest partition offsets per consumer? what is the idea behind keeping all offsets "default" to forever? On Fri, Aug 12, 2016 at 12:05 PM, Guozhang Wang wrote: > Hi Yuanjia, > > New consumer's group registry information is stored on the Kafka brokers, > not ZK any mo

Re: kafka-consumer-groups.sh delete group with new-consumer

2016-08-12 Thread Guozhang Wang
Hi Yuanjia, New consumer's group registry information is stored on the Kafka brokers, not ZK any more, and the brokers use heartbeats to detect if the consumer has been failed and hence can be removed from the group or not. In addition, the consumer's committed offsets (i.e. "positions" as you me

kafka-consumer-groups.sh delete group with new-consumer

2016-08-11 Thread yuanjia8...@163.com
Hi all, When I use kafka-consumer-groups.sh to delete new-consumer's group, the shell note that "Option [delete] is not valid with [new-consumer]. Note that there's no need to delete group metadata for the new consumer as it is automatically deleted when the last member leaves." How to u