GitHub user ueshin opened a pull request:
https://github.com/apache/spark/pull/22552
[SPARK-25540][SQL][PYSPARK] Make HiveContext in PySpark behave as the same
as Scala.
## What changes were proposed in this pull request?
In Scala, `HiveContext` sets a config `spark.sql.catalogImplementation` of
the given `SparkContext` and then passes to `SparkSession.builder`.
The `HiveContext` in PySpark should behave as the same as Scala.
## How was this patch tested?
Existing tests.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/ueshin/apache-spark
issues/SPARK-25540/hive_context
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/22552.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #22552
----
commit 858941b08a3f28f6938fc14d92bd810f5ea7f2dd
Author: Takuya UESHIN <ueshin@...>
Date: 2018-09-26T06:06:23Z
Make HiveContext in PySpark behave as the same as Scala.
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
