[ https://issues.apache.org/jira/browse/SPARK-35688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17363077#comment-17363077 ]
Fu Chen commented on SPARK-35688: --------------------------------- Hi, [~maropu] , [~hyukjin.kwon] . I can reproduce the bug by providing snippet code ( in the master branch). When we enabled subexpression elimination, The interpreted predicate implementation`[GeneratePredicate|https://github.com/apache/spark/blob/master/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/codegen/GeneratePredicate.scala#L63-L64]` will eval the subexpressions (in this case `explode_name_array(name)`) before other condition expressions. But note that the UDF may depend on the other condition. In this case, the UDF `name2Array` depends on the condition `name <> '?'`. > GeneratePredicate eliminate will fail in some case > --------------------------------------------------- > > Key: SPARK-35688 > URL: https://issues.apache.org/jira/browse/SPARK-35688 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 3.1.1 > Reporter: todd.chen > Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org