GitHub user dafrista opened a pull request:
https://github.com/apache/spark/pull/14515
[SPARK-16926] [SQL] Remove partition columns from partition metadata.
## What changes were proposed in this pull request?
This removes partition columns from column metadata of partitions to match
tables.
A change introduced in SPARK-14388 removed partition columns from the
column metadata of tables, but not for partitions. This causes TableReader to
believe that the schema is different between table and partition, and create an
unnecessary conversion object inspector in TableReader.
## How was this patch tested?
Existing unit tests.
(If this patch involves UI changes, please attach a screenshot; otherwise,
remove this)
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dafrista/spark partition-columns-metadata
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/14515.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #14515
----
commit fd3712360aa0fc05066b8c87b083f1b07fae762f
Author: Brian Cho <b...@fb.com>
Date: 2016-08-05T22:06:53Z
Remove partition columns from partition metadata.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
