Different Window Sizes in keyed stream

2017-06-22 Thread Ahmad Hassan
Hi All, I want to know if flink allows to define sliding window size and slide time on the fly. For example I want to configure sliding window of size 2 min and slide 1 min for tenant A but size 10 min and slide min for tenant B in a keyed stream and so on for other tenants. My code is below.

Re: Different Window Sizes in keyed stream

2017-06-23 Thread Fabian Hueske
Hi Ahmad, that is not possible, at least not with Flink's built-in windows. You can probably implement something like that on top of the DataStream API but I think it would quite a bit of effort. IMO, the better approach would be to start a separate Flink job per tenant. This would also improve t

Re: Different Window Sizes in keyed stream

2017-06-23 Thread Ahmad Hassan
Thanks Fabian for the advice! Best Regards, Dr. Ahmad Hassan On 23 June 2017 at 09:05, Fabian Hueske wrote: > Hi Ahmad, > > that is not possible, at least not with Flink's built-in windows. > You can probably implement something like that on top of the DataStream > API but I think it would qui

Re: Different Window Sizes in keyed stream

2017-06-27 Thread Aljoscha Krettek
Hi Ahman, You could in fact do this by writing a custom WindowAssigner. Have a look at the assignWindows() method here: https://github.com/apache/flink/blob/12b4185c6c09101b64e12a84c33dc4d28f95cff9/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/windowing/assigners/SlidingProce