Kevin Lam created FLINK-34440:
---------------------------------

             Summary: Support Debezium Protobuf Confluent Format
                 Key: FLINK-34440
                 URL: https://issues.apache.org/jira/browse/FLINK-34440
             Project: Flink
          Issue Type: New Feature
          Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile)
    Affects Versions: 1.18.1, 1.19.0
            Reporter: Kevin Lam


*Motivation*

Debezium and the Confluent Schema registry can be used to emit Protobuf Encoded 
messages to Kafka, but Flink does not easily support consuming these messages 
through a connector.

*Definition of Done*

Add a format `debezium-protobuf-confluent` provided by 
DebeziumProtobufFormatFactory that supports Debezium messages encoded using 
Protocol Buffer and the Confluent Schema Registry. 

To consider
 * Mirror the implementation of the `debezium-avro-confluent` format. First 
implement a `protobuf-confluent` format similar to the existing [Confluent 
Avro|https://nightlies.apache.org/flink/flink-docs-release-1.18/docs/connectors/table/formats/avro-confluent/]
 format that's provided today, which allows reading/writing protobuf using the 
Confluent Schema Registry



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to