Hello Team , I am facing an issue where output files generated by Spark 1.6.1 are not read by Hive 1.0.0 . It is because Hive 1.0.0 uses older parquet version than Spark 1.6.1 which is using 1.7.0 parquet .
Is it possible that we can use older parquet version in Spark or newer parquet version in Hive ? I have tried adding parquet-hive-bundle : 1.7.0 to Hive but while reading it throws Failed with exception java.io.IOException:java.lang.NullPointerException . Can anyone give us the solution ? Thanks , Mayank -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Hive-1-0-0-not-able-to-read-Spark-1-6-1-parquet-output-files-on-EMR-4-7-0-tp27144.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
