Migrating Kafka Sources (major version change)

Hi! *Scenario* I want to eventually do a breaking change to a Kafka source (major version change) which requires a new Kafka topic. *Question* What utilities exist to help with this in Flink? What best practices exist? My plan is roughly the following: 1. Change my Flink job to support both kaf

Re: Questions about keyed streams

Thanks Fabian and Senhong! Here's an example diagram of the join that I want to do. There are more layers of joins. https://docs.google.com/presentation/d/17vYTBUIgrdxuYyEYXrSHypFhwwS7NdbyhVgioYMxPWc/edit#slide=id.p 1) Thanks! I'll look into these. 2) I'm using the same key across multiple Kaf

How to keep flink batch job running continously on local

Hi, I am practicing file reading through the flink batch processing mechanism on a Windows 10 machine. I downloaded flink-1.7.2-bin-hadoop24-scala_2.12.tgz from flink's official site and executed start-cluster.bat . I uploaded the jar though Flink's UI and was able to execute the job but the job

Re: Move already processed file from one folder to another folder in flink

Hi, Let me know if you have any idea as this is very critical for my project. Thanks & Regards, Samir Vasani On Fri, Jul 23, 2021 at 1:26 PM Samir Vasani wrote: > Hi, > > Can you elaborate more on UDF as I did not understand it. > > Thanks & Regards, > Samir Vasani > > > > On Fri, Jul 23, 202