huhuan created FLINK-35427:
------------------------------

             Summary: Support fail-on-unknown-field config in json format
                 Key: FLINK-35427
                 URL: https://issues.apache.org/jira/browse/FLINK-35427
             Project: Flink
          Issue Type: Improvement
          Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile)
            Reporter: huhuan


In many cases, the consumer and producer of message queues come from different 
teams, or even different companies.
As message consumer, sometimes it is difficult to subscribe updates on message 
format, which may result in data loss.
We want to ensure the message format strictly matches the schema, if some field 
is missing or new field is added, it is better to fail the application so that 
we can notice and fix it quickly.
In this case, a fail-on-unknown-field config for JSON format could be very 
helpful, especially when works with fail-on-missing-field.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to