Re: Spark 2.1 and Hive Metastore

Dan, Yes, you’re correct. I sent it to the wrong users’ group. Thanks, Ben > On Apr 9, 2017, at 1:21 PM, Dan Burkert wrote: > > Hi Ben, > > Was this meant for the Spark user list, or is there something specific to the > Spark/Kudu integration you are asking about? >

Re: Spark 2.1 and Hive Metastore

Hi Ben, Was this meant for the Spark user list, or is there something specific to the Spark/Kudu integration you are asking about? - Dan On Sun, Apr 9, 2017 at 11:13 AM, Benjamin Kim wrote: > I’m curious about if and when Spark SQL will ever remove its dependency on > Hive

Spark 2.1 and Hive Metastore

I’m curious about if and when Spark SQL will ever remove its dependency on Hive Metastore. Now that Spark 2.1’s SparkSession has superseded the need for HiveContext, are there plans for Spark to no longer use the Hive Metastore service with a “SparkSchema” service with a PostgreSQL, MySQL, etc.

Re: Spark on Kudu Roadmap

Hi Mike, Thanks for the link. I guess further, deeper Spark integration is slowly coming. But when, we will have to wait and see. Cheers, Ben > On Mar 27, 2017, at 12:25 PM, Mike Percy wrote: > > Hi Ben, > I don't really know so I'll let someone else more familiar with