RE: Spark SQL -Hive transactions support

2016-01-19 Thread Hemang Nagar
Do you have any plans for supporting hive transactions in Spark? From: Michael Armbrust [mailto:mich...@databricks.com] Sent: Tuesday, January 19, 2016 3:18 PM To: hnagar <hemang.na...@mobiusws.com> Cc: user <user@spark.apache.org> Subject: Re: Spark SQL -Hive transactions su

Re: Spark SQL -Hive transactions support

2016-01-19 Thread Elliot West
Hive's ACID feature (which introduces transactions) is not required for inserts, only updates and deletes. Inserts should be supported on a vanilla Hive shell. I'm not sure how Spark interacts with Hive in that regard but perhaps the HiveSQLContext implementation is lacking support. On a separate

Re: Spark SQL -Hive transactions support

2016-01-19 Thread Michael Armbrust
We don't support Hive style transaction. On Tue, Jan 19, 2016 at 11:32 AM, hnagar wrote: > Hive has transactions support since version 0.14. > > I am using Spark 1.6, and Hive 1.2.1, are transactions supported in Spark > SQL now. I tried in the Spark-Shell and it