Hive is unable to avro file written by spark avro

2016-01-13 Thread Siva
Hi Everyone, Avro data written by dataframe in hdfs in not able to read by hive. Saving data avro format with below statement. df.save("com.databricks.spark.avro", SaveMode.Append, Map("path" -> path)) Created hive avro external table and while reading I see all nulls. Did anyone face similar

Re: Hive is unable to avro file written by spark avro

2016-01-13 Thread Kevin Mellott
Hi Sivakumar, I have run into this issue in the past, and we were able to fix it by using an explicit schema when saving the DataFrame to the Avro file. This schema was an exact match to the one associated with the metadata on the Hive database table, which allowed the Hive queries to work even