Re: Discard out-of-order events

2016-07-29 Thread Maximilian Michels
@Gyula: This is documented in the JavaDoc of the `allowedLateness(..)` method and in the docs: https://ci.apache.org/projects/flink/flink-docs-master/apis/streaming/windows.html#dealing-with-late-data @Kevin: Thanks for the explanation, I'll get back to you soon (sort of in a rush). Cheers, Max

Re: Discard out-of-order events

2016-07-29 Thread Kevin Jacobs
Goodmorning :-), Thank you for your answer. Let me explain my problem more thoroughly (maybe other options are possible here, not necessary with allowedLateness). The most compact description of my problem would be Stream Enrichment. More concrete, suppose I have two streams, where I want to

Re: Discard out-of-order events

2016-07-29 Thread Gyula Fóra
Hi Max, So if I understand correctly the window operators now, by default, discard late elements? Is this documented somewhere? Gyula Maximilian Michels ezt írta (időpont: 2016. júl. 29., P, 10:40): > Hi! > > I'm not sure whether I understand your question. The purpose of

Re: Discard out-of-order events

2016-07-29 Thread Maximilian Michels
Hi! I'm not sure whether I understand your question. The purpose of Event Time is to be able to process out-of-order events. Do you want to discard late elements? In the upcoming Flink 1.1.0 you can set the `allowedLateness` on a windowed stream. The default is 0, so late elements are discarded;

Discard out-of-order events

2016-07-28 Thread Kevin Jacobs
Is it possible to discard events that are out-of-order (in terms of event time)?