Re: Watermarks and parallelism

2020-05-19 Thread Gnanasoundari Soundarajan
, 18 May 2020 at 4:59 PM To: Gnanasoundari Soundarajan Cc: Alexander Fedulov , "user@flink.apache.org" Subject: Re: Watermarks and parallelism Hi Gnanasoundari, Your use case is very typical and pretty much the main motivation for event time and watermarks. It's supported ou

Re: Watermarks and parallelism

2020-05-15 Thread Gnanasoundari Soundarajan
data didn’t flow downstream. I am curious to know that whether will it be a feasible requirement to achieve it in flink using event time? Regards, Gnana From: Alexander Fedulov Date: Thursday, 14 May 2020 at 9:25 PM To: Gnanasoundari Soundarajan Cc: "user@flink.apache.org" S

Watermarks and parallelism

2020-05-13 Thread Gnanasoundari Soundarajan
Hi all, I have below queries in flink. Could anyone help me to understand? Query: 1 Is watermark maintained globally at the operator level? 2 When we have a keyByOperator with parallelism >1, is there a single watermark maintained across all the parallel subtasks or for each of the parallel s

Flink Key based watermarks with event time

2020-05-13 Thread Gnanasoundari Soundarajan
Hi all, We have a requirement where we need to maintain key based watermarks with event time. Each sensor will communicate with different timestamp where we need to maintain watermark separately for each sensor. Is this requirement can be achieved with Flink? Thanks. Regards, Gnana