[
https://issues.apache.org/jira/browse/FLINK-33045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17843475#comment-17843475
]
Pavel Khokhlov commented on FLINK-33045:
----------------------------------------
Hello,
have the same issue with Flink DataStream API (not SQL)
As I see this class just use method
{code:java}
schemaCoder.writeSchema(getSchema(), outputStream);{code}
[https://github.com/apache/flink/blob/80af4d502318348ba15a8f75a2a622ce9dbdc968/flink-formats/flink-avro/src/main/java/org/apache/flink/formats/avro/RegistryAvroSerializationSchema.java#L120]
without trying get registered Schema from Schema Registry
and SchemaCoder just always use
{code:java}
int registeredId = schemaRegistryClient.register(subject, schema);{code}
[https://github.com/apache/flink/blob/80af4d502318348ba15a8f75a2a622ce9dbdc968/flink-formats/flink-avro-confluent-registry/src/main/java/org/apache/flink/formats/avro/registry/confluent/ConfluentSchemaRegistryCoder.java#L85]
which calls method
[https://github.com/confluentinc/schema-registry/blob/62f09936a26058ec13805ab8e588d66ef1975f97/client/src/main/java/io/confluent/kafka/schemaregistry/client/CachedSchemaRegistryClient.java#L408]
as I see there is no additional logic which has original KafkaAvroSerializer
[https://github.com/confluentinc/schema-registry/blob/62f09936a26058ec13805ab8e588d66ef1975f97/avro-serializer/src/main/java/io/confluent/kafka/serializers/AbstractKafkaAvroSerializer.java#L115]
> format avro-confluent - disable auto-registering schema in registry
> -------------------------------------------------------------------
>
> Key: FLINK-33045
> URL: https://issues.apache.org/jira/browse/FLINK-33045
> Project: Flink
> Issue Type: Improvement
> Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile)
> Affects Versions: 1.17.1
> Environment: Flink-Kubernetes-Operator
> format avro-confluent
> Reporter: Michael Lorenzi
> Priority: Minor
>
> {code:java}
> 'value.format' = 'avro-confluent',
> 'value.avro-confluent.url' = '<url>',
> 'value.avro-confluent.schema' = '<schema>', -- available in 1.18.x{code}
> Currently the format {{avro-confluent}} seems to always try to register the
> schema to the schema-registry, be it computed out of the table-schema or set
> by property {{schema}} (if 1.18.x is used).
> In our setup we would like to prevent our flink-jobs from registering
> schemas. Flink should only lookup the schema-id by calling {{getId}} from
> confluents schema-registry-client. We control publishing of new
> schema-versions outside of flink.
> The bevaviour is expected to be similar to the behvaiour of
> KafkaAvroSerializer from confluent when {{auto.register.schemas=false}} is
> set.
> Could there be a option like
> {code:java}
> 'value.avro-confluent.auto.register.schema' = 'false'{code}
> to disable auto-registering schema to the schema-registry?
> Thank you for your help!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
