Re: Avro UTF-8 deserialization on integration DataStreams API -> Table API (with Confluent SchemaRegistry)

2021-10-19 Thread Peter Schrott
Update: I assume you are talking about DataStreamSource.process(.), right? ( https://nightlies.apache.org/flink/flink-docs-release-1.14/api/java/org/apache/flink/streaming/api/datastream/DataStream.html#process-org.apache.flink.streaming.api.functions.ProcessFunction- ) So similar to a .map(.)

Re: Avro UTF-8 deserialization on integration DataStreams API -> Table API (with Confluent SchemaRegistry)

2021-10-19 Thread Caizhi Weng
Hi! Sorry for misleading. I mean DataStream#process, see https://nightlies.apache.org/flink/flink-docs-release-1.14/api/java/org/apache/flink/streaming/api/datastream/DataStream.html#process-org.apache.flink.streaming.api.functions.ProcessFunction- Peter Schrott 于2021年10月19日周二 下午3:10写道: > Hi &

Re: Avro UTF-8 deserialization on integration DataStreams API -> Table API (with Confluent SchemaRegistry)

2021-10-19 Thread Peter Schrott
Hi & thanks! DataStreamSource does not provide a method processRecord: https://nightlies.apache.org/flink/flink-docs-release-1.14/api/java/org/apache/flink/streaming/api/datastream/DataStreamSource.html Can you point me to the docs for that? Thanks, Peter On Tue, Oct 19, 2021 at 4:47 AM Caizhi

Re: Avro UTF-8 deserialization on integration DataStreams API -> Table API (with Confluent SchemaRegistry)

2021-10-18 Thread Caizhi Weng
Hi! You can call streamSource.processRecord to change the CharSequence to a String, then change the stream to a table. Peter Schrott 于2021年10月18日周一 下午8:40写道: > Hi there, > > I have a Kafka topic where the schema of its values is defined by the > "MyRecord" record in the following Avro IDL and

Avro UTF-8 deserialization on integration DataStreams API -> Table API (with Confluent SchemaRegistry)

2021-10-18 Thread Peter Schrott
Hi there, I have a Kafka topic where the schema of its values is defined by the "MyRecord" record in the following Avro IDL and registered to the Confluent Schema Registry: @namespace("org.example") protocol MyProtocol { record MyRecord { string text; } } The topic is consumed with