Event de duplication in flink with rabbitmq connector

2024-07-09 Thread banu priya
Hi All, I have a Flink job with a RMQ source, tumbling windows (fires for each 2s), an aggregator, then a RMQ sink. Incremental RocksDB checkpointing is enabled with an interval of 5 minutes. I was trying to understand Flink failure recovery. My checkpoint X is started, I have sent one event to

Re: Checkpoints and windows size

2024-06-19 Thread banu priya
On Wed, 19 Jun, 2024, 9:38 am banu priya, wrote: > Hi All, > > I have a flink job with key by, tumbling window(2sec window time > processing time)and aggregator. > > How often should I run the check point??I don't need the data to be > retained after 2s. > > I want to

Checkpoints and windows size

2024-06-18 Thread banu priya
Hi All, I have a flink job with key by, tumbling window(2sec window time processing time)and aggregator. How often should I run the check point??I don't need the data to be retained after 2s. I want to use incremental check point with rocksdb. Thanks Banupriya