Hi there, I use avro format to store historical due to avro schema evolution. I manage external schemas and read them using avroSchema option so we have been able to add and delete columns.
The problem is when I introduced aliases and Spark process didn't work as expected and then I read in spark-avro library "At the moment, it ignores docs, aliases and other properties present in the Avro file". How do you manage aliases and column renaming? Is there any workaround? Thanks in advance. Regards -- Gaspar Muñoz Soria Vía de las dos Castillas, 33, Ática 4, 3ª Planta 28224 Pozuelo de Alarcón, Madrid Tel: +34 91 828 6473