[
https://issues.apache.org/jira/browse/SPARK-7824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhongshuai Pei updated SPARK-7824:
----------------------------------
Summary: Collapsing operator reordering and constant folding into a single
batch to push down the single side. (was: Extracting and/or condition
optimizer from BooleanSimplification optimizer and put it before
PushPredicateThroughJoin optimizer to push down the single side.)
> Collapsing operator reordering and constant folding into a single batch to
> push down the single side.
> -----------------------------------------------------------------------------------------------------
>
> Key: SPARK-7824
> URL: https://issues.apache.org/jira/browse/SPARK-7824
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 1.3.1
> Reporter: Zhongshuai Pei
>
> SQL:
> {noformat}
> select * from tableA join tableB on (a > 3 and b = d) or (a > 3 and b = e)
> {noformat}
> Plan before modify
> {noformat}
> == Optimized Logical Plan ==
> Project [a#293,b#294,c#295,d#296,e#297]
> Join Inner, Some(((a#293 > 3) && ((b#294 = d#296) || (b#294 = e#297))))
> MetastoreRelation default, tablea, None
> MetastoreRelation default, tableb, None
> {noformat}
> Plan after modify
> {noformat}
> == Optimized Logical Plan ==
> Project [a#293,b#294,c#295,d#296,e#297]
> Join Inner, Some(((b#294 = d#296) || (b#294 = e#297)))
> Filter (a#293 > 3)
> MetastoreRelation default, tablea, None
> MetastoreRelation default, tableb, None
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
