[jira] [Commented] (SPARK-25334) Default SessionCatalog should support UDFs
[ https://issues.apache.org/jira/browse/SPARK-25334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16630890#comment-16630890 ] Swapnil Chougule commented on SPARK-25334: -- +1 My work has also been impacted by same. SessionCatalog calls registerFunction to add a function to function registry. However, makeFunctionExpression supports only UserDefinedAggregateFunction. Can we have handler for scala udf, java udf & java udaf as well in SessionCatalog? > Default SessionCatalog should support UDFs > -- > > Key: SPARK-25334 > URL: https://issues.apache.org/jira/browse/SPARK-25334 > Project: Spark > Issue Type: Task > Components: SQL >Affects Versions: 2.3.1 >Reporter: Tomasz Gawęda >Priority: Major > > SessionCatalog calls registerFunction to add a function to function registry. > However, makeFunctionExpression supports only UserDefinedAggregateFunction. > We should make makeFunctionExpression support UserDefinedFunction, as it's > one of functions type. > Currently we can use persistent functions only with Hive metastore, but > "create function" command works also with default SessionCatalog. It > sometimes cause user confusion, like in > https://stackoverflow.com/questions/52164488/spark-hive-udf-no-handler-for-udaf-analysis-exception/52170519 -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-25334) Default SessionCatalog should support UDFs
[ https://issues.apache.org/jira/browse/SPARK-25334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16603341#comment-16603341 ] Tomasz Gawęda commented on SPARK-25334: --- If commiters say it's not very important, I can start work on this. However, it will probably take more time for me to implement it than for some that's already a Spark committer :) > Default SessionCatalog should support UDFs > -- > > Key: SPARK-25334 > URL: https://issues.apache.org/jira/browse/SPARK-25334 > Project: Spark > Issue Type: Task > Components: SQL >Affects Versions: 2.3.1 >Reporter: Tomasz Gawęda >Priority: Major > > SessionCatalog calls registerFunction to add a function to function registry. > However, makeFunctionExpression supports only UserDefinedAggregateFunction. > We should make makeFunctionExpression support UserDefinedFunction, as it's > one of functions type. > Currently we can use persistent functions only with Hive metastore, but > "create function" command works also with default SessionCatalog. It > sometimes cause user confusion, like in > https://stackoverflow.com/questions/52164488/spark-hive-udf-no-handler-for-udaf-analysis-exception/52170519 -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
