GitHub user gatorsmile opened a pull request:
https://github.com/apache/spark/pull/20069
[SPARK-22895] [SQL] Push down the deterministic predicates that are after
the first non-deterministic
## What changes were proposed in this pull request?
Currently, we do not guarantee an order evaluation of conjuncts in either
Filter or Join operator. This is also true to the mainstream RDBMS vendors like
DB2 and MS SQL Server. Thus, we should also push down the deterministic
predicates that are after the first non-deterministic, if possible.
## How was this patch tested?
Updated the existing test cases.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/gatorsmile/spark morePushDown
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/20069.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #20069
----
commit ad6607c642ffac811f0fa84d9256524676c9c75e
Author: gatorsmile <gatorsmile@...>
Date: 2017-12-24T06:25:54Z
fix
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
