[ https://issues.apache.org/jira/browse/SPARK-28169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
angerszhu updated SPARK-28169: ------------------------------ Summary: Spark can’t push down partition predicate for OR expression (was: Spark can’t push down predicate for OR expression) > Spark can’t push down partition predicate for OR expression > ----------------------------------------------------------- > > Key: SPARK-28169 > URL: https://issues.apache.org/jira/browse/SPARK-28169 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 2.3.0, 2.4.0 > Reporter: angerszhu > Priority: Major > Labels: SQL > > Spark can't push down filter condition of Or: > Such as if I have a table {color:#d04437}default.test{color}, his partition > col is "{color:#d04437}dt{color}", > if I use query : > {code:java} > select * from default.test where dt=20190625 or (dt = 20190626 and id in > (1,2,3) ) > {code} > In this case, Spark will resolve or condition as one expression, and since > this {color:#333333}expr {color}has reference of "{color:#FF0000}id{color}", > then it can't been push down. -- This message was sent by Atlassian JIRA (v7.6.14#76016) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org