Hi Team,
We have pull data from Kafka generated by Debezium. The schema maintained
in the schema registry by confluent framework during the population of
data.
*Problem Statement Here: *
All the addition/deletion of columns is maintained in schema registry.
During running the Hudi pipeline, We have custom schema registry that
pulls the latest schema from the schema registry as well as from hive
metastore and we create a uber schema (so that missing the columns from the
schema registry will be pulled from hive metastore) But is there any better
approach to solve this problem?.
Thanks and Regards,
S SYED ABDUL KATHER