[ https://issues.apache.org/jira/browse/SPARK-33427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17235086#comment-17235086 ]
Apache Spark commented on SPARK-33427: -------------------------------------- User 'viirya' has created a pull request for this issue: https://github.com/apache/spark/pull/30414 > Interpreted subexpression elimination > ------------------------------------- > > Key: SPARK-33427 > URL: https://issues.apache.org/jira/browse/SPARK-33427 > Project: Spark > Issue Type: New Feature > Components: SQL > Affects Versions: 3.1.0 > Reporter: L. C. Hsieh > Assignee: L. C. Hsieh > Priority: Major > Fix For: 3.1.0 > > > Currently we only do subexpression elimination for codegen. For some reasons, > we may need to run interpreted expression valuation. For example, codegen > fails to compile and fallback to interpreted mode. It is commonly seen for > complex schema from expressions that is possibly caused by the query > optimizer too, e.g. SPARK-32945. > We should also support subexpression elimination for interpreted evaluation. > That could reduce performance difference when Spark fallbacks from codegen to > interpreted expression evaluation. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org