Re: onTimer() of a KeyedProcessFunction stops getting triggered after a while

2022-03-23 Thread Binil Benjamin
: > [ External sender. Exercise caution. ] > > After fixing your negative timestamp bug, can the timer be triggered? > > > > > On 23 Mar 2022, at 2:39 AM, Binil Benjamin wrote: > > Here are some more findings as I was debugging this. I peeked into the > snapshot to see the

Re: onTimer() of a KeyedProcessFunction stops getting triggered after a while

2022-03-22 Thread Binil Benjamin
e has some negative values (there was a bug in our code at some point that added these negative values). Could this be the root cause of why the timer is not getting triggered? Thanks! On Fri, Mar 18, 2022 at 6:50 PM Binil Benjamin wrote: > Hi, > > Parallelism is currently set

Re: onTimer() of a KeyedProcessFunction stops getting triggered after a while

2022-03-18 Thread Binil Benjamin
Hi, Parallelism is currently set to 9 and it appears to be occurring for all subtasks. We did put logs to see the various timestamps. The following logs are from the last 5 days. - logs from processElement() - logged immediately after timer registration: "message":

Re: onTimer() of a KeyedProcessFunction stops getting triggered after a while

2022-03-18 Thread Binil Benjamin
Exception { ... } } Thanks! On Thu, Mar 17, 2022 at 9:24 PM yu'an huang wrote: > [ External sender. Exercise caution. ] > > Hi, can you share your code so we can check whether it is written > correctly. > > > > > On 18 Mar 2022, at 7:54 AM, Binil Benjamin wrote: > > &g

onTimer() of a KeyedProcessFunction stops getting triggered after a while

2022-03-17 Thread Binil Benjamin
Hi, We have a class that extends KeyedProcessFunction and overrides onTimer() method. During processElement(), we register a timer callback using context.timerService().registerProcessingTimeTimer(). For a while, we see that the onTimer() method is getting called back and everything works as