Hi Everyone,
Avro data written by dataframe in hdfs in not able to read by hive. Saving
data avro format with below statement.
df.save("com.databricks.spark.avro", SaveMode.Append, Map("path" -> path))
Created hive avro external table and while reading I see all nulls. Did
anyone face similar
Hi Sivakumar,
I have run into this issue in the past, and we were able to fix it by using
an explicit schema when saving the DataFrame to the Avro file. This schema
was an exact match to the one associated with the metadata on the Hive
database table, which allowed the Hive queries to work even