Re: How to start a stream from only new records?

2019-08-13 Thread Patrik Kleindl
iginal Message- > > From: Boyang Chen > > Sent: 09 August 2019 17:23 > > To: users@kafka.apache.org > > Subject: Re: How to start a stream from only new records? > > > > Hey Tim, > > > > if you are talking about avoid re-processing data and start consumption

Re: How to start a stream from only new records?

2019-08-13 Thread Matthias J. Sax
Original Message- > From: Boyang Chen > Sent: 09 August 2019 17:23 > To: users@kafka.apache.org > Subject: Re: How to start a stream from only new records? > > Hey Tim, > > if you are talking about avoid re-processing data and start consumption > from latest,

RE: How to start a stream from only new records?

2019-08-12 Thread Tim Ward
s of what offset it committed last time it ran. Tim Ward -Original Message- From: Boyang Chen Sent: 09 August 2019 17:23 To: users@kafka.apache.org Subject: Re: How to start a stream from only new records? Hey Tim, if you are talking about avoid re-processing data and start consumption

Re: How to start a stream from only new records?

2019-08-09 Thread Boyang Chen
Hey Tim, if you are talking about avoid re-processing data and start consumption from latest, you could set your `offset.reset.policy` to latest. Let me know if this answers your question. On Fri, Aug 9, 2019 at 7:09 AM Tim Ward wrote: > With a real time application, nobody is interested in ol