[ https://issues.apache.org/jira/browse/SPARK-34421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Wenchen Fan updated SPARK-34421: -------------------------------- Fix Version/s: 3.0.3 > Custom functions can't be used in temporary views with CTEs > ----------------------------------------------------------- > > Key: SPARK-34421 > URL: https://issues.apache.org/jira/browse/SPARK-34421 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 3.1.0 > Environment: Databricks Runtime 8.0 > Reporter: Lauri Koobas > Assignee: Peter Toth > Priority: Blocker > Fix For: 3.1.1, 3.0.3 > > > The following query works in Spark 3.0 not Spark 3.1. > > Start with: > {{spark.udf.registerJavaFunction("custom_func", > "com.stuff.path.custom_func", LongType())}} > > Works: * {{select custom_func()}} > * {{create temporary view blaah as select custom_func()}} > * {{with step_1 as ( select custom_func() ) select * from step_1}} > Broken: > {{create temporary view blaah as with step_1 as ( select custom_func() ) > select * from step_1}} > > followed by: > {{select * from blaah}} > > Error: > {{Error in SQL statement: AnalysisException: No handler for UDF/UDAF/UDTF > '}}{{com.stuff.path.custom_func}}{{';}} -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org