This can happen for two reasons: 1) Your offsets are expired and removed. So your consumers don't know where to start from - earliest means "Start from the beginning" 2) You are actually starting as part of a totally new consumer group - in which case it's as designed too - start from the beginning.
I would check your offset retention policy by size/time - and tune that if necessary. On 1 June 2018 at 09:03, Dinesh Subramanian <dsubraman...@apptivo.co.in> wrote: > Hi, > > Facing duplication in below scenario > > Last commit is happened in 3 days back in the consumer, after that no > messages produced in the topic. so no commits.. > so after 3 days am stopping and restarting the consumer.. this time i > faced duplication issue in the consumer as i have this consumer > property "*auto.offset.reset > = earliest*", It is consumed again from the beginning.. any helps will be > appreciated. > > *Thanks & Regards,* > > *Dinesh S* >
