GitHub user gengliangwang opened a pull request:
https://github.com/apache/spark/pull/22684
[SPARK-25699][SQL] Partially push down conjunctive predicated in Orc
## What changes were proposed in this pull request?
Inspired by https://github.com/apache/spark/pull/22574 .
We can partially push down top level conjunctive predicates to Orc.
The code changes include Orc data source under SQL and Hive module.
## How was this patch tested?
New unit test.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/gengliangwang/spark pushOrcFilters
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/22684.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #22684
----
commit e2dee098b2efb80238e38068d2ad8681504e03e0
Author: Gengliang Wang <gengliang.wang@...>
Date: 2018-10-10T07:00:13Z
push more predicates
commit 798ed5317f953c0aaaf6c5e92126b26f15fe66c0
Author: Gengliang Wang <gengliang.wang@...>
Date: 2018-10-10T08:34:34Z
handle hive orc
commit 28322b2efacd5fd1787c0ca1fe64e5db4a5b25fc
Author: Gengliang Wang <gengliang.wang@...>
Date: 2018-10-10T08:43:29Z
add jira number in test case
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
