Hi,
You can use
sqlContext.sql("use ")
before use dataframe.saveAsTable
Hope it could be helpful
Cheers
Gen
On Sun, Feb 21, 2016 at 9:55 AM, Glen wrote:
> For dataframe in spark, so the table can be visited by hive.
>
> --
> Jacky Wang
>
Any example code?
In pyspark:
sqlContex.sql("use mytable")
my_df.saveAsTable("tmp_spark_debug", mode="overwrite")
1. The code above seems not register the table in hive. I have to create
table from hdfs in hive, it reports some format error: rcformat and parquet.
2. Rerun the saveAsTable
hall not be understood as given or endorsed by Peridale Technology Ltd, its
subsidiaries or their employees, unless expressly so stated. It is the
responsibility of the recipient to ensure that this email is virus free,
therefore neither Peridale Technology Ltd, its subsidiaries nor the
