Re: Publishing a table to Kafka

2021-01-20 Thread Abhishek Rai
Thanks Leonard, we are working towards 1.12 upgrade and should be able to try upsert-kafka after that. > Your first workaround should have been worked, but looks like an exception > was thrown in Type conversion phase, could you share you table schema and > query that can reproduce the issue. I

Re: Publishing a table to Kafka

2021-01-15 Thread Leonard Xu
Hi, Rai > What are my options to still write to Kafka? I don't mind introducing > another boolean/etc field in the Kafka output records containing the > row kind or similar info. The recommended way is use `upset-kafka`[1] connector which you can write insert/update/retract message to a compac

Publishing a table to Kafka

2021-01-13 Thread Abhishek Rai
Hello, I'm using Flink 1.11.2 where I have a SQL backed `Table` which I'm trying to write to Kafka. I'm using `KafkaTableSourceSinkFactory` which ends up instantiating a table sink of type `KafkaTableSink`. Since this sink is an `AppendStreamTableSink`, I cannot write to it using a generic table