Re: What's the use of timestamp in ProducerRecord?

2018-01-19 Thread Dan Markhasin
It is also used for rewinding consumer offsets. On 19 January 2018 at 06:25, Matthias J. Sax wrote: > The timestamp has many different purposes. As mentioned already, it used > to expired data via retention time. It's also used for stream processing > via Streams API. All

Re: What's the use of timestamp in ProducerRecord?

2018-01-18 Thread Matthias J. Sax
The timestamp has many different purposes. As mentioned already, it used to expired data via retention time. It's also used for stream processing via Streams API. All processing is based on those timestamps for windowing and joining of streams. -Matthias On 1/18/18 7:57 PM, Stephen Powis wrote:

Re: What's the use of timestamp in ProducerRecord?

2018-01-18 Thread Stephen Powis
A common use case is for calculating a "processing lag time" comparing the record's timestamp (when it was published/persisted) against the current time that the consumer 'consumed' it. In theory, the delta is 'how far behind' the consumer is, tho you can come up with a variety of reasons why

Re: What's the use of timestamp in ProducerRecord?

2018-01-18 Thread 1095193...@qq.com
kafka does not delete message when message is consumed, it will purge message when this message is expired. I guess this timeStamp is for checking whether message is expired. 1095193...@qq.com From: Jake Yoon Date: 2018-01-19 11:46 To: users Subject: What's the use of timestamp in

What's the use of timestamp in ProducerRecord?

2018-01-18 Thread Jake Yoon
Hi, I am very new to Kafka. And I have a very basic question. Kafka doc says, *ProducerRecord * (String