[GitHub] spark pull request: [SPARK-9944] [SQL] [WIP] Allow hive.metastore....

2015-10-18 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8186 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-9944] [SQL] [WIP] Allow hive.metastore....

2015-09-29 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/8186#issuecomment-144200187 Hive has weird semantics for only the `default` database (ignore the metastore, only look at the config), and I'd prefer to not mimic that in Spark SQL. Given that, ca

[GitHub] spark pull request: [SPARK-9944] [SQL] [WIP] Allow hive.metastore....

2015-08-19 Thread manku-timma
Github user manku-timma commented on the pull request: https://github.com/apache/spark/pull/8186#issuecomment-132874783 @yhuai In hive, the following sample code works fine:- ``` set hive.metastore.warehouse.dir=/test/warehouse create table test1 as select * from source

[GitHub] spark pull request: [SPARK-9944] [SQL] [WIP] Allow hive.metastore....

2015-08-19 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/8186#issuecomment-132668351 @manku-timma Even if you do not specify the database, there is a default database called `default`. If you are connecting to the same metastore, I do not think yo

[GitHub] spark pull request: [SPARK-9944] [SQL] [WIP] Allow hive.metastore....

2015-08-19 Thread manku-timma
Github user manku-timma commented on the pull request: https://github.com/apache/spark/pull/8186#issuecomment-132618967 Say the metastore DB admin has created a place to save the data of all tables by default. This applies to all spark (and other) jobs that use the metastore.

[GitHub] spark pull request: [SPARK-9944] [SQL] [WIP] Allow hive.metastore....

2015-08-18 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/8186#issuecomment-132313042 I don't think that this is the right semantic. Correct me if I'm wrong, but I think that we should use `hive.metastore.warehouse.dir` as the default location when crea

[GitHub] spark pull request: [SPARK-9944] [SQL] [WIP] Allow hive.metastore....

2015-08-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8186#issuecomment-130918071 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark pull request: [SPARK-9944] [SQL] [WIP] Allow hive.metastore....

2015-08-13 Thread manku-timma
GitHub user manku-timma opened a pull request: https://github.com/apache/spark/pull/8186 [SPARK-9944] [SQL] [WIP] Allow hive.metastore.warehouse.dir to override db_location_uri When you run `dataframe.saveAsTable("tablename")`, the warehouse directory in the metastore (DBS.DB_LOCAT