Re: Inserting nullable data into NOT NULL columns

2020-04-10 Thread Gyula Fóra
Thanks Timo for the answer! We are specifically working on implementing Kudu Table connectors and catalog and we hit a problem while handling keys. Naturally columns that will be used as keys in Kudu cannot be null so we set their type when the catalog returns it to NOT NULL. Unfortunately this m

Re: Inserting nullable data into NOT NULL columns

2020-04-09 Thread Timo Walther
Hi Gyula, some disclaimer: the type system rework is still ongoing and there a a couple of known issues and missing end-to-end tests around this topic. I would therefore recommend to declare the sink as `STRING NULL` for now. Can you open an issue for your concrete use case with some example

Inserting nullable data into NOT NULL columns

2020-04-09 Thread Gyula Fóra
Hi All! We ran into a problem while trying to insert data read from kafka into a table sink where some of the columns are not nullable. The problem is that from Kafka we can only read nullable columns in JSON format otherwise you get the following error: org.apache.flink.table.api.ValidationExce