Apache Flink - Using upsert JDBC sink for DataStream

2021-10-16 Thread M Singh
Hi Folks: I am working on Flink DataStream pipeline and would like to use JDBC upsert functionality.  I found a class TableJdbcUpsertOutputFormat but am not sure who to use it with the JdbcSink as shown in the document 

Re: modify the classloader of JM dynamically to handle "ADD JAR hdfs://" statement

2021-10-16 Thread Jeff Zhang
Hi vtygoss, Have you taken a look at Zeppelin ? Zeppelin support Flink UDF in several different approaches, and as you said, it is not a good practice to put udf jars under $FLINK_HOME/lib. In Zeppelin you don't do that, you can dynamically load udf jars. Check the following doc for more details.

Catching SIGINT With flink Jobs

2021-10-16 Thread Vijay Bhaskar
Can we register any method in Custom Source and Custom Sink to catch SIGINIT? (I know that we need to follow procedure to stop a flink job by saving the state.) Regards Bhaskar

modify the classloader of JM dynamically to handle "ADD JAR hdfs://" statement

2021-10-16 Thread vtygoss
Hi, community! I am working on building a stream processing platform using Flink 1.12.0. I met a problem in the scenario of SQL Application migration from SparkSQL/HiveSQL to FlinkSQL. How to dynamically modify the classloader of the JobManager already launched to handle "ADD JAR