GitHub user dongjoon-hyun opened a pull request:
https://github.com/apache/spark/pull/21186
[SPARK-22279][SPARK-24112] Enable `convertMetastoreOrc` and add
`convertMetastore.TableProperty` conf
## What changes were proposed in this pull request?
We reverted `spark.sql.hive.convertMetastoreOrc` at
https://github.com/apache/spark/pull/20536 because we should not ignore the
table-specific compression conf. Now, it's resolved via
[SPARK-23355](https://github.com/apache/spark/commit/8aa1d7b0ede5115297541d29eab4ce5f4fe905cb).
This PR aims to enable `convertMetastoreOrc` by default again like Parquet.
Also, in order to provide full backward-compatibility, this also introduces
additional configuration `spark.sql.hive.convertMetastoreTableProperty` to
restore the previous behavior for ignoring table properties.
## How was this patch tested?
Pass the Jenkins.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dongjoon-hyun/spark SPARK-24112
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/21186.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #21186
----
commit 5383299738877b76c46d603635520e77dad52fd9
Author: Dongjoon Hyun <dongjoon@...>
Date: 2018-04-27T18:10:55Z
[SPARK-22279][SPARK-24112] Enable `convertMetastoreOrc` and add
`convertMetastore.TableProperty` conf
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
