Re: Dynamin Windowing in with Pyflink

2023-05-17 Thread Dian Fu
Hi Nawaz, >> My concern is, as Flink does not support dynamic windows, is this approach going against Flink Architecture. Per my understanding, the session window could be seen as a kind of dynamic window. Besides, Flink also supports user-defined window with which users should also be able to

Dynamin Windowing in with Pyflink

2023-05-16 Thread Nawaz Nayeem via user
Hey, I’ve been trying to emulate the behavior of a dynamic window, as Flink does not support dynamic window sizes. My operator inherits from KeyedProcessFunction, and I’m only using KeyedStates to manipulate the window_size. I’m clearing the KeyedStates when my bucket(window) is complete, to reset