Writing to CSV is very slow. >From what I've seen this is the preferred way to write to hive ;
myDf.createOrReplaceTempView("mytempTable")
sqlContext.sql("create table mytable as select * from mytempTable");
Source :
https://stackoverflow.com/questions/30664008/how-to-save-dataframe-directly-to-hive
--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscr...@spark.apache.org
