Hi Spark Team, We working on one use case where we need to parse Avro json schema (json is nested schema) using apache spark 1.6 and scala 10.2. As of now we are able to deflate the json from avro and read it and bring in hive table. Our requirement is like avro json can add new fields and we want to handle such scenario dynamically. Is there any way where we infer schema before hand so that we can manage it dynamically if new fields getting added.
Regards, Satwinder