Flink 1.12, Kafka Connector, JSON format - "Could not find a suitable table factory"

Hello! I have a Scala 2.12 project which registers some tables (that get their data from Kafka in JSON form) to the StreamTableEnvironment via the executeSql command before calling execute on the StreamExecutionEnvironment. Everything behaves as expected until I either try to set /'format.ignore-p

Re: Flink 1.12, Kafka Connector, JSON format - "Could not find a suitable table factory"

Hi! Thank you for the reply! I understand that the metadata syntax is only available as of 1.12, but I am indeed trying to use Flink 1.12. Regarding the option for ignoring parse errors: I have already noticed from before that, according to the docs, even in Flink 1.11 (which is the version that

Re: Flink 1.12, Kafka Connector, JSON format - "Could not find a suitable table factory"

Hi again! I did not realise both the new and old codes are supported in the later versions of the connector, but that was indeed the problem. Updated all of the options to use the new syntax and everything works like a charm. I should've definitely been a bit more careful about that 😅 Thanks a l

Insufficient number of network buffers - rerun with min amount of required network memory

Hello! I have a program which creates and runs a local Flink 1.12 environment. I understand that, based on factors such as parallelism and the presence of any process functions, the "Insufficient number of network buffers" exception might pop up. My plan is to catch this exception inside the main

Re: Insufficient number of network buffers - rerun with min amount of required network memory

Hello Arvid Heise, Thanks for replying! Based on your suggestion, I put together the following snippet for the config: val config = new Configuration() private val newMemorySize = config.get(TaskManagerOptions.MEMORY_SEGMENT_SIZE) .multiply(4) .multiply(config.get(TaskManagerOptions.