How to register TableSinks

2021-01-04 Thread Patrick.Eifler
Hi and Happy New Year, I’m currently trying to remove deprecations to prepare for the upgrade to Flink 1.12. currently running on 1.11. Specifically I need to update our code that registers table sinks into the StreamTableEnvironment. I’m maintaining jobs that use DataStreams with multiple sin

Re: How to register TableSinks

2021-01-04 Thread Patrick.Eifler
Hey, Thanks Dawid, One more question: Does the StatementSet API supposed to work with the old sink interface? I get the following error when I’m using it with the deprecated registerTableSink method: The main method caused an error: requirement failed: operations should not be empty Thanks!

Checkpoint failures without exceptions

2021-10-27 Thread Patrick.Eifler
Hi Flink Community, I have an issue with failing checkpoints on all stateful jobs in a session cluster which I’m unable to track down so far. The jobs sit between Kafka. Only the first checkpoint gets completed all others fail. The watermarks are progressing regularly and are aligned between sub

Re: CVE-2021-44228 - Log4j2 vulnerability

2022-01-06 Thread Patrick.Eifler
Hi, just to be sure: Which Flink Releases for 1.14 and 1.13 have the upgraded log4j version 2.17.0? Are those already deployed to docker? Many Thanks in Advance. Kind Regards, Patrick -- Patrick Eifler Senior Software Engineer (BI) Cloud Gaming Engineering & Infrastructure Sony Interactive E

How to avoid duplicates and enable Exactly Once - End to End

2022-01-12 Thread Patrick.Eifler
Hi, we are working on a flink pipeline and running into duplicates in case of checkpoint failures. The pipeline is running on Flink 1.13.2 and uses the source and sink classes from the flink kafka connector library. The checkpointing is set to exactly once and we do care about correctness of