Hi I have a spark job which creates hive tables in orc format with partitions. It works well I can read data back into hive table using hive console. But if I try further process orc files generated by Spark job by loading into dataframe then I get the following exception Caused by: java.io.IOException: Malformed ORC file hdfs://localhost:9000/user/hive/warehouse/partorc/part_tiny.txt. Invalid postscript.
Dataframe df = hiveContext.read().format("orc").load(to/path); Please guide. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Hive-ORC-Malformed-while-loading-into-spark-data-frame-tp24876.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org