Hi I have a Spark dataframe which I want to save as hive table with
partitions. I tried the following two statements but they dont work I dont
see any ORC files in HDFS directory its empty. I can see baseTable is there
in Hive console but obviously its empty because of no files inside HDFS. The
Before Spark 1.5, tables created using saveAsTable cannot be queried by
Hive because we only store Spark SQL metadata. In Spark 1.5 for parquet
and ORC we store both, but this will not work with partitioned tables
because hive does not support dynamic partition discovery.
On Wed, Sep 2, 2015 at
