Re: Flink SQL Plain avro schema deserialization

2025-06-20 Thread Yarden BenMoshe
Hi all, In case it helps someone in the future, I wanted to share that I was finally able to identify the problem and create a fix that works for me. As mentioned in earlier messages, the default Avro behavior in Flink generates a schema based on the table definition. This includes some assumptions

Re: Flink SQL Plain avro schema deserialization

2025-06-10 Thread Yarden BenMoshe
Hi again, Let me add some clarifying details: My use case involves writing Avro records (events) to a kafka topic from pipelineA using DataStream API (without schema registry, because of performance concerns). Then, I have pipelineB which uses Table API, creates a table with the relevant fields (w

Flink SQL Plain avro schema deserialization

2025-06-08 Thread Yarden BenMoshe
Hi all, I am trying to create a Flink SQL pipeline that will consume from a kafka topic that contains plain avro objects (no schema registry used). As I can see in the docs, for plain avro, the schema (in flink sql context) will be inferred from the table definition. My problem is that the schema