Re: Custom Processing per window

2018-03-19 Thread Dhruv Kumar
Is there a way I can leverage OperatorState (instead of KeyState) to solve my issue? > On Mar 19, 2018, at 09:00, Fabian Hueske wrote: > > Hi, > > Data is partitioned by key across machines and state is kept per key. It is > not possible to interact with two keys at the

Re: Custom Processing per window

2018-03-19 Thread Fabian Hueske
Hi, Data is partitioned by key across machines and state is kept per key. It is not possible to interact with two keys at the same time. Best, Fabian 2018-03-19 14:47 GMT+01:00 Dhruv Kumar : > In other words, while using the Flink streaming APIs, is it possible to > take

Re: Custom Processing per window

2018-03-19 Thread Dhruv Kumar
In other words, while using the Flink streaming APIs, is it possible to take a decision on emitting a particular key based on the state of some other key present in the same window? Thanks! -- Dhruv Kumar PhD Candidate Department of Computer

Re: Custom Processing per window

2018-03-19 Thread Dhruv Kumar
Task 1: I implemented it using a custom Trigger (see attached file). Looks like it is doing what I want it to. I copied the code from EventTimeTrigger.java and overwrote the onElement method. Task 2: I will need to maintain the state (this will be the LRU cache) for multiple keys in the same data

Re: Custom Processing per window

2018-03-19 Thread Jörn Franke
How would you start implementing it? Where are you stuck? Did you already try to implement this? > On 18. Mar 2018, at 04:10, Dhruv Kumar wrote: > > Hi > > I am a CS PhD student at UMN Twin Cities. I am trying to use Flink for > implementing some very specific

Custom Processing per window

2018-03-17 Thread Dhruv Kumar
Hi I am a CS PhD student at UMN Twin Cities. I am trying to use Flink for implementing some very specific use-cases: (They may not seem relevant but I need to implement them or I at least need to know if it is possible to implement them in Flink) Assumptions: 1. Data stream is of the form