[ https://issues.apache.org/jira/browse/SPARK-23122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Xiao Li updated SPARK-23122: ---------------------------- Description: Deprecate register* for UDFs in SQLContext and Catalog in PySpark Seems we allow many other ways to register UDFs in SQL statements. Some are in {{SQLContext}} and some are in {{Catalog}}. These are also inconsistent with Java / Scala APIs. Seems we better deprecating them and put the logics into {{UDFRegistration}} ({{spark.udf.register*}}). Please see this discussion too - [https://github.com/apache/spark/pull/20217#issuecomment-357134926]. was: Seems we allow many other ways to register UDFs in SQL statements. Some are in {{SQLContext}} and some are in {{Catalog}}. These are also inconsistent with Java / Scala APIs. Seems we better deprecating them and put the logics into {{UDFRegistration}} ({{spark.udf.register*}}). Please see this discussion too - [https://github.com/apache/spark/pull/20217#issuecomment-357134926]. > Deprecate register* for UDFs in SQLContext and Catalog in PySpark > ----------------------------------------------------------------- > > Key: SPARK-23122 > URL: https://issues.apache.org/jira/browse/SPARK-23122 > Project: Spark > Issue Type: Improvement > Components: PySpark, SQL > Affects Versions: 2.3.0 > Reporter: Hyukjin Kwon > Assignee: Hyukjin Kwon > Priority: Major > Fix For: 2.3.0 > > > Deprecate register* for UDFs in SQLContext and Catalog in PySpark > Seems we allow many other ways to register UDFs in SQL statements. Some are > in {{SQLContext}} and some are in {{Catalog}}. > These are also inconsistent with Java / Scala APIs. Seems we better > deprecating them and put the logics into {{UDFRegistration}} > ({{spark.udf.register*}}). > Please see this discussion too - > [https://github.com/apache/spark/pull/20217#issuecomment-357134926]. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org