Re: kafka-consumer-groups.sh delete group with new-consumer

2016-08-13 Thread tao xiao
Shouldn't the default offset retention minutes be 1440? offsets.retention.minutes=1440 On Sat, 13 Aug 2016 at 03:05 Guozhang Wang wrote: > Hi Yuanjia, > > New consumer's group registry information is stored on the Kafka brokers, > not ZK any more, and the brokers use heartbeats to detect if the

Re: Kafka topic-partition won't serve if prefered election fails for a partition.

2016-08-13 Thread R Krishna
Sorry, am a newbie myself, I was adding to the scenario where broker has gone down and not come up when replication is 1, and a new leader is elected, it will be the leader for this topic/partition, but if other broker is down, it might not have the offsets? On Sat, Aug 13, 2016 at 1:22 PM, Sudev

Re: Stream processing meetup at LinkedIn (Mountain View) on Tuesday, August 23 at 6pm

2016-08-13 Thread Felipe Santos
Hi, The event will be broadcast live? On 13 August 2016 at 08:21, Prabhjot Bharaj wrote: > Hi, > > Thanks for the response. Wishing you the best for making all the > arrangements. > > Looking forward to it > > Regards, > Prabhjot > > On Aug 12, 2016 5:58 PM, "Ed Yakabosky" > wrote: > > > Hello

Re: Kafka topic-partition won't serve if prefered election fails for a partition.

2016-08-13 Thread Sudev A C
No why wouldn't the partition come back ? Before preferred election there was leader serving the requests during election when it tries to elect the preferred leader and the preferred leader happens not to be in in ISR, fallback to leader leader happens. After this producing/consuming from this par

Re: kafka-consumer-groups.sh delete group with new-consumer

2016-08-13 Thread R Krishna
Guozhang, don't we just need latest partition offsets per consumer? what is the idea behind keeping all offsets "default" to forever? On Fri, Aug 12, 2016 at 12:05 PM, Guozhang Wang wrote: > Hi Yuanjia, > > New consumer's group registry information is stored on the Kafka brokers, > not ZK any mo

Re: Kafka topic-partition won't serve if prefered election fails for a partition.

2016-08-13 Thread R Krishna
But, isn't that assuming your topics are replicated to all brokers, in your case there are no offsets probably for this reason too. On Fri, Aug 12, 2016 at 2:23 PM, Zakee wrote: > Typically "preferred leader election” would fail if/when one or more > brokers still did not come back online after

Re: Stream processing meetup at LinkedIn (Mountain View) on Tuesday, August 23 at 6pm

2016-08-13 Thread Prabhjot Bharaj
Hi, Thanks for the response. Wishing you the best for making all the arrangements. Looking forward to it Regards, Prabhjot On Aug 12, 2016 5:58 PM, "Ed Yakabosky" wrote: > Hello, > > We will be sharing a live-stream as well as recording after the meetup. > Thanks for asking! > > Ed > > On Fri