New subscriber offset

2015-03-03 Thread Achanta Vamsi Subhash
Hi, We are using HighLevelConsumer and when a new subscription is added to the topic, the HighLevelConsumer for the same group starts from the start of the Kafka topic log. Is there anyway we could set the offset of the HighLevelConsumer to the end of the log instead? We don't want to move to

Re: New subscriber offset

2015-03-03 Thread tao xiao
You can set the consumer config auto.offset.reset=largest Ref: http://kafka.apache.org/documentation.html#consumerconfigs On Tue, Mar 3, 2015 at 8:30 PM, Achanta Vamsi Subhash achanta.va...@flipkart.com wrote: Hi, We are using HighLevelConsumer and when a new subscription is added to the

Re: New subscriber offset

2015-03-03 Thread Achanta Vamsi Subhash
Thanks a lot Xiao. Somehow missed reading about the config parameter. On Tue, Mar 3, 2015 at 6:51 PM, tao xiao xiaotao...@gmail.com wrote: You can set the consumer config auto.offset.reset=largest Ref: http://kafka.apache.org/documentation.html#consumerconfigs On Tue, Mar 3, 2015 at 8:30 PM,