Re: Process event with last 1 hour, 1week and 1 Month data

2017-06-15 Thread shashank agarwal
Thanks Aljoscha Krettek I will try the same. On Thu, Jun 15, 2017 at 3:11 PM, Aljoscha Krettek wrote: > Hi, > > How would you evaluate such a query? I think the answer could be that you > have to keep all that older data around so that you can evaluate when a new > event arrives. In Flink, you c

Re: Process event with last 1 hour, 1week and 1 Month data

2017-06-15 Thread Aljoscha Krettek
Hi, How would you evaluate such a query? I think the answer could be that you have to keep all that older data around so that you can evaluate when a new event arrives. In Flink, you could use a ProcessFunction for that and use a MapState that keeps events bucketed into one-week intervals. This

Process event with last 1 hour, 1week and 1 Month data

2017-06-13 Thread shashank agarwal
Hi, I have to process each event with last 1 hour , 1 week and 1 month data. Like how many times same ip occurred in last 1 month corresponding to that event. \ I think window is for fixed time i can't calculate with last 1 hour corresponding to current event. If you have any clue please guide w