GitHub user xdcjie opened a pull request:
https://github.com/apache/spark/pull/21447
[SPARK-24339][SQL]Add project for transform/map/reduce sql to prune column
## What changes were proposed in this pull request?
Transform query do not have Project Node, so that it will scan all the data
of table. query like:
`select transform(a, b) using 'func' from e`
In this PR, I propose to add Project Node for transform query, so that it
can scan less data by prune columns.
## How was this patch tested?
Modify existing test ("transform query spec")
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/xdcjie/spark branch-2.2
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/21447.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #21447
----
commit 11c5c5797e0fe6879e3434d7b1fae2687bcacd1e
Author: xdcjie <xdcjie@...>
Date: 2018-05-29T04:57:19Z
Add project for tranform/map/reduce sql to prune column
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
