[ https://issues.apache.org/jira/browse/SPARK-33848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yuming Wang updated SPARK-33848: -------------------------------- Summary: Push the UnaryExpression into (if / case) branches (was: Push the cast into (if / case) branches) > Push the UnaryExpression into (if / case) branches > -------------------------------------------------- > > Key: SPARK-33848 > URL: https://issues.apache.org/jira/browse/SPARK-33848 > Project: Spark > Issue Type: Sub-task > Components: SQL > Affects Versions: 3.2.0 > Reporter: Yuming Wang > Assignee: Yuming Wang > Priority: Major > Fix For: 3.2.0 > > > Push the cast into (if / case) branches. The use case is: > {code:sql} > create table t1 using parquet as select id from range(10); > explain select id from t1 where (CASE WHEN id = 1 THEN '1' WHEN id = 3 THEN > '2' end) > 3; > {code} > Before this pr: > {noformat} > == Physical Plan == > *(1) Filter (cast(CASE WHEN (id#1L = 1) THEN 1 WHEN (id#1L = 3) THEN 2 END as > int) > 3) > +- *(1) ColumnarToRow > +- FileScan parquet default.t1[id#1L] Batched: true, DataFilters: > [(cast(CASE WHEN (id#1L = 1) THEN 1 WHEN (id#1L = 3) THEN 2 END as int) > > 3)], Format: Parquet, Location: > InMemoryFileIndex[file:/Users/yumwang/opensource/spark/spark-warehouse/org.apache.spark.sql.DataF..., > PartitionFilters: [], PushedFilters: [], ReadSchema: struct<id:bigint> > {noformat} > After this pr: > {noformat} > == Physical Plan == > LocalTableScan <empty>, [id#1L] > {noformat} -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org