[ https://issues.apache.org/jira/browse/SPARK-14502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Davies Liu resolved SPARK-14502. -------------------------------- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 12267 [https://github.com/apache/spark/pull/12267] > Add optimization for Binary Comparison Simplification > ----------------------------------------------------- > > Key: SPARK-14502 > URL: https://issues.apache.org/jira/browse/SPARK-14502 > Project: Spark > Issue Type: Improvement > Components: SQL > Reporter: Dongjoon Hyun > Fix For: 2.0.0 > > > We can simplifies binary comparisons with semantically-equal operands: > 1) Replace '<=>' with 'true' literal. > 2) Replace '=', '<=', and '>=' with 'true' literal if both operands are > non-nullable. > 3) Replace '<' and '>' with 'false' literal if both operands are non-nullable. > For example, the following example plan > {code} > scala> sql("SELECT * FROM (SELECT explode(array(1,2,3)) a) T WHERE a BETWEEN > a AND a+7").explain() > ... > : +- Filter ((a#59 >= a#59) && (a#59 <= (a#59 + 7))) > ... > {code} > will be optimized into the following. > {code} > : +- Filter (a#47 <= (a#47 + 7)) > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org