Hi, First of all, your question is more suited for the Flink user mailing list (this is the dev mailing list).
I think you can use a GlobalWindow [1] with a custom trigger. A global window assigns all elements with the same key to the same window, and will not perform any computation unless triggered. You may want to look into the "Connected Car Segments" Flink training exercise and its reference solution, which I think solves a similar problem: http://training.data-artisans.com/exercises/carSegments.html Best, Gary [1] https://ci.apache.org/projects/flink/flink-docs-release-1.4/dev/stream/operators/windows.html#global-windows On Mon, Jan 8, 2018 at 4:40 PM, miki haiat <miko5...@gmail.com> wrote: > Hi , > > i have this scenario of applications that streaming logs to kafka . > > I want to use flink in order to aggregate the stream and calculate some > data > i have a guid that i can correlate the stream to single event and i have > a field that i can use to understand if is the last stream of the event . > > lets say the stream is something like that , > > 92e8366c-8ddd-41ed-a297-f9c28bf38792 msg1 start > 92e8366c-8ddd-41ed-a297-f9c28bf38792 msg2 start > 92e8366c-8ddd-41ed-a297-f9c28bf38792 msg3 end > 92e8366c-8ddd-41ed-a297-f9c28bf3666 msg1 start > > I cant use window trigger because then i can lose some data ? > > the only thing i can think about is onElement trigger ? > > what is you suggestion for this use case ? >
