[ https://issues.apache.org/jira/browse/SPARK-34421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Xiao Li updated SPARK-34421: ---------------------------- Priority: Blocker (was: Major) > Custom functions can't be used in temporary views with CTEs > ----------------------------------------------------------- > > Key: SPARK-34421 > URL: https://issues.apache.org/jira/browse/SPARK-34421 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 3.1.0 > Environment: Databricks Runtime 8.0 > Reporter: Lauri Koobas > Priority: Blocker > > Works in DBR 7.4, which is Spark 3.0.1. Breaks in DBR8.0(beta), which is > Spark 3.1. > > Start with: > {{spark.udf.registerJavaFunction("custom_func", "com.stuff.path.custom_func", > LongType())}} > > Works: * {{select custom_func()}} > * {{create temporary view blaah as select custom_func()}} > * {{with step_1 as ( select custom_func() ) select * from step_1}} > Broken: > {{create temporary view blaah as with step_1 as ( select custom_func() ) > select * from step_1}} > > followed by: > {{select * from blaah}} > > Error: > {{Error in SQL statement: AnalysisException: No handler for UDF/UDAF/UDTF > '}}{{com.stuff.path.custom_func}}{{';}} -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org