Window stream using timestamp key for time

2016-01-28 Thread Emmanuel
Hello, I have used Flink to stream data and do analytics on the stream, using time windows... Now, this is assuming the data is effectively coming in real time. However I have a use case where the data is 'batched' upstream, and comes in bursts, but has a timestamp.It obviously messes up the

Re: Window stream using timestamp key for time

2016-01-28 Thread Fabian Hueske
Hi Emmanuel, the feature you are looking for is called event time processing in Flink. These blog posts should help you to become familiar with the concepts: 1) Event-Time concepts: http://data-artisans.com/how-apache-flink-enables-new-streaming-applications-part-1/ 2) Windows in Flink:

RE: Window stream using timestamp key for time

2016-01-28 Thread Emmanuel
Nice, you guys rock! From: fhue...@gmail.com Date: Thu, 28 Jan 2016 23:34:58 +0100 Subject: Re: Window stream using timestamp key for time To: user@flink.apache.org Hi Emmanuel, the feature you are looking for is called event time processing in Flink. These blog posts should help you to become