[
https://issues.apache.org/jira/browse/SPARK-34421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17283060#comment-17283060
]
Apache Spark commented on SPARK-34421:
--------------------------------------
User 'peter-toth' has created a pull request for this issue:
https://github.com/apache/spark/pull/31550
> Custom functions can't be used in temporary views with CTEs
> -----------------------------------------------------------
>
> Key: SPARK-34421
> URL: https://issues.apache.org/jira/browse/SPARK-34421
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 3.1.0
> Environment: Databricks Runtime 8.0
> Reporter: Lauri Koobas
> Priority: Major
>
> Works in DBR 7.4, which is Spark 3.0.1. Breaks in DBR8.0(beta), which is
> Spark 3.1.
>
> Start with:
> {{spark.udf.registerJavaFunction("custom_func", "com.stuff.path.custom_func",
> LongType())}}
>
> Works: * {{select custom_func()}}
> * {{create temporary view blaah as select custom_func()}}
> * {{with step_1 as ( select custom_func() ) select * from step_1}}
> Broken:
> {{create temporary view blaah as with step_1 as ( select custom_func() )
> select * from step_1}}
>
> followed by:
> {{select * from blaah}}
>
> Error:
> {{Error in SQL statement: AnalysisException: No handler for UDF/UDAF/UDTF
> '}}{{com.stuff.path.custom_func}}{{';}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
