Event de duplication in flink with rabbitmq connector

2024-07-09 Thread banu priya
Hi All, I have a Flink job with a RMQ source, tumbling windows (fires for each 2s), an aggregator, then a RMQ sink. Incremental RocksDB checkpointing is enabled with an interval of 5 minutes. I was trying to understand Flink failure recovery. My checkpoint X is started, I have sent one event to

Flink LAG-Function doesn't work as expected

2024-07-09 Thread Brandl, Johann
Hi everyone, i'm new to flink and tried some queries with flink sql. Currently I have a problem with the LAG function. I want to emit a new record when the ORDERS_ID changes. To do this, I use the LAG function to detect whether this has changed. However, I noticed that every now and then I

Using BlobServer in FlinkDeployment

2024-07-09 Thread Saransh Jain
Hi all, I am deploying a FlinkDeployment CR in an Operator watched namespace. I have passed these configs in the flinkConfiguration: blob.server.address: "jobmanager" blob.server.port: "6128" blob.storage.directory: "/tmp/jars/" There are a couple of jars that I don't want to make part of the