Hi,
Hive table creation need an extra step from 1.3. You can follow the
following template
df.registerTempTable(tableName)
hc.sql(screate table $tableName as select * from $tableName)
this will save the table in hive with given tableName.
Regards,
Madhukara Phatak
Hi Michael,
Here https://issues.apache.org/jira/browse/SPARK-7084 is the jira issue
and PR https://github.com/apache/spark/pull/5654 for the same. Please
have a look.
Regards,
Madhukara Phatak
http://datamantra.io/
On Thu, Apr 23, 2015 at 1:22 PM, madhu phatak phatak@gmail.com wrote:
Sorry for the confusion. We should be more clear about the semantics in
the documentation. (PRs welcome :) )
.saveAsTable does not create a hive table, but instead creates a Spark Data
Source table. Here the metadata is persisted into Hive, but hive cannot
read the tables (as this API support
I wrote few mails here regarding this issue.
After further investigation I think there is a bug in Spark 1.3 in saving
Hive tables.
(hc is HiveContext)
1. Verify the needed configuration exists:
scala hc.sql(set hive.exec.compress.output).collect
res4: Array[org.apache.spark.sql.Row] =
