Re: Spark 2.1 and Hive Metastore

2017-04-09 Thread Benjamin Kim
ion you are asking about? > > - Dan > > On Sun, Apr 9, 2017 at 11:13 AM, Benjamin Kim <bbuil...@gmail.com > <mailto:bbuil...@gmail.com>> wrote: > I’m curious about if and when Spark SQL will ever remove its dependency on > Hive Metastore. Now that Spark 2.1’

Re: Spark 2.1 and Hive Metastore

2017-04-09 Thread Dan Burkert
on > Hive Metastore. Now that Spark 2.1’s SparkSession has superseded the need > for HiveContext, are there plans for Spark to no longer use the Hive > Metastore service with a “SparkSchema” service with a PostgreSQL, MySQL, > etc. DB backend? Hive is growing long in the tooth,

Spark 2.1 and Hive Metastore

2017-04-09 Thread Benjamin Kim
I’m curious about if and when Spark SQL will ever remove its dependency on Hive Metastore. Now that Spark 2.1’s SparkSession has superseded the need for HiveContext, are there plans for Spark to no longer use the Hive Metastore service with a “SparkSchema” service with a PostgreSQL, MySQL, etc