[jira] [Commented] (SPARK-24077) Issue a better error message for `CREATE TEMPORARY FUNCTION IF NOT EXISTS`
[ https://issues.apache.org/jira/browse/SPARK-24077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941444#comment-16941444 ] Takeshi Yamamuro commented on SPARK-24077: -- Yea, its been fixed there; {code} scala> sql("CREATE TEMPORARY FUNCTION IF NOT EXISTS yuzhouwan as 'org.apache.spark.sql.hive.udf.YuZhouWan'") org.apache.spark.sql.catalyst.parser.ParseException: It is not allowed to define a TEMPORARY function with IF NOT EXISTS. == SQL == CREATE TEMPORARY FUNCTION IF NOT EXISTS yuzhouwan as 'org.apache.spark.sql.hive.udf.YuZhouWan' at org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parse(ParseDriver.scala:129) at org.apache.spark.sql.execution.SparkSqlParser.parse(SparkSqlParser.scala:48) at org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parsePlan(ParseDriver.scala:76) at org.apache.spark.sql.SparkSession.$anonfun$sql$1(SparkSession.scala:605) at org.apache.spark.sql.catalyst.QueryPlanningTracker.measurePhase(QueryPlanningTracker.scala:111) at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:605) ... 47 elided {code} > Issue a better error message for `CREATE TEMPORARY FUNCTION IF NOT EXISTS` > -- > > Key: SPARK-24077 > URL: https://issues.apache.org/jira/browse/SPARK-24077 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 2.3.0 >Reporter: Benedict Jin >Priority: Major > Labels: starter > > The error message of {{CREATE TEMPORARY FUNCTION IF NOT EXISTS}} looks > confusing: > {code} > scala> > org.apache.spark.sql.SparkSession.builder().enableHiveSupport.getOrCreate.sql("CREATE > TEMPORARY FUNCTION IF NOT EXISTS yuzhouwan as > 'org.apache.spark.sql.hive.udf.YuZhouWan'") > {code} > {code} > org.apache.spark.sql.catalyst.parser.ParseException: > mismatched input 'NOT' expecting \{'.', 'AS'}(line 1, pos 29) > == SQL == > CREATE TEMPORARY FUNCTION IF NOT EXISTS yuzhouwan as > 'org.apache.spark.sql.hive.udf.YuZhouWan' > -^^^ > at > org.apache.spark.sql.catalyst.parser.ParseException.withCommand(ParseDriver.scala:197) > at > org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parse(ParseDriver.scala:99) > at > org.apache.spark.sql.execution.SparkSqlParser.parse(SparkSqlParser.scala:45) > at > org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parsePlan(ParseDriver.scala:53) > at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:592) > ... 48 elided > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-24077) Issue a better error message for `CREATE TEMPORARY FUNCTION IF NOT EXISTS`
[ https://issues.apache.org/jira/browse/SPARK-24077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16941363#comment-16941363 ] Jeff Evans commented on SPARK-24077: Is this still relevant, given SPARK-20383 is done? > Issue a better error message for `CREATE TEMPORARY FUNCTION IF NOT EXISTS` > -- > > Key: SPARK-24077 > URL: https://issues.apache.org/jira/browse/SPARK-24077 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 2.3.0 >Reporter: Benedict Jin >Priority: Major > Labels: starter > > The error message of {{CREATE TEMPORARY FUNCTION IF NOT EXISTS}} looks > confusing: > {code} > scala> > org.apache.spark.sql.SparkSession.builder().enableHiveSupport.getOrCreate.sql("CREATE > TEMPORARY FUNCTION IF NOT EXISTS yuzhouwan as > 'org.apache.spark.sql.hive.udf.YuZhouWan'") > {code} > {code} > org.apache.spark.sql.catalyst.parser.ParseException: > mismatched input 'NOT' expecting \{'.', 'AS'}(line 1, pos 29) > == SQL == > CREATE TEMPORARY FUNCTION IF NOT EXISTS yuzhouwan as > 'org.apache.spark.sql.hive.udf.YuZhouWan' > -^^^ > at > org.apache.spark.sql.catalyst.parser.ParseException.withCommand(ParseDriver.scala:197) > at > org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parse(ParseDriver.scala:99) > at > org.apache.spark.sql.execution.SparkSqlParser.parse(SparkSqlParser.scala:45) > at > org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parsePlan(ParseDriver.scala:53) > at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:592) > ... 48 elided > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-24077) Issue a better error message for `CREATE TEMPORARY FUNCTION IF NOT EXISTS`
[ https://issues.apache.org/jira/browse/SPARK-24077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16879858#comment-16879858 ] HondaWei commented on SPARK-24077: -- Hi [~hyukjin.kwon] Thank you! I am going to trace the code and modify it in the near term if [~benedict jin] doesn't work on it. > Issue a better error message for `CREATE TEMPORARY FUNCTION IF NOT EXISTS` > -- > > Key: SPARK-24077 > URL: https://issues.apache.org/jira/browse/SPARK-24077 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 2.3.0 >Reporter: Benedict Jin >Priority: Major > Labels: starter > > The error message of {{CREATE TEMPORARY FUNCTION IF NOT EXISTS}} looks > confusing: > {code} > scala> > org.apache.spark.sql.SparkSession.builder().enableHiveSupport.getOrCreate.sql("CREATE > TEMPORARY FUNCTION IF NOT EXISTS yuzhouwan as > 'org.apache.spark.sql.hive.udf.YuZhouWan'") > {code} > {code} > org.apache.spark.sql.catalyst.parser.ParseException: > mismatched input 'NOT' expecting \{'.', 'AS'}(line 1, pos 29) > == SQL == > CREATE TEMPORARY FUNCTION IF NOT EXISTS yuzhouwan as > 'org.apache.spark.sql.hive.udf.YuZhouWan' > -^^^ > at > org.apache.spark.sql.catalyst.parser.ParseException.withCommand(ParseDriver.scala:197) > at > org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parse(ParseDriver.scala:99) > at > org.apache.spark.sql.execution.SparkSqlParser.parse(SparkSqlParser.scala:45) > at > org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parsePlan(ParseDriver.scala:53) > at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:592) > ... 48 elided > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-24077) Issue a better error message for `CREATE TEMPORARY FUNCTION IF NOT EXISTS`
[ https://issues.apache.org/jira/browse/SPARK-24077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16879782#comment-16879782 ] Hyukjin Kwon commented on SPARK-24077: -- It doesn't have to assign someone. When you open a PR, it automatically links the JIRA and PR. Please review https://spark.apache.org/contributing.html and go ahead. [~benedict jin], are you currently working on this? > Issue a better error message for `CREATE TEMPORARY FUNCTION IF NOT EXISTS` > -- > > Key: SPARK-24077 > URL: https://issues.apache.org/jira/browse/SPARK-24077 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 2.3.0 >Reporter: Benedict Jin >Priority: Major > Labels: starter > > The error message of {{CREATE TEMPORARY FUNCTION IF NOT EXISTS}} looks > confusing: > {code} > scala> > org.apache.spark.sql.SparkSession.builder().enableHiveSupport.getOrCreate.sql("CREATE > TEMPORARY FUNCTION IF NOT EXISTS yuzhouwan as > 'org.apache.spark.sql.hive.udf.YuZhouWan'") > {code} > {code} > org.apache.spark.sql.catalyst.parser.ParseException: > mismatched input 'NOT' expecting \{'.', 'AS'}(line 1, pos 29) > == SQL == > CREATE TEMPORARY FUNCTION IF NOT EXISTS yuzhouwan as > 'org.apache.spark.sql.hive.udf.YuZhouWan' > -^^^ > at > org.apache.spark.sql.catalyst.parser.ParseException.withCommand(ParseDriver.scala:197) > at > org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parse(ParseDriver.scala:99) > at > org.apache.spark.sql.execution.SparkSqlParser.parse(SparkSqlParser.scala:45) > at > org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parsePlan(ParseDriver.scala:53) > at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:592) > ... 48 elided > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-24077) Issue a better error message for `CREATE TEMPORARY FUNCTION IF NOT EXISTS`
[ https://issues.apache.org/jira/browse/SPARK-24077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16879615#comment-16879615 ] HondaWei commented on SPARK-24077: -- I would like to contribute Spark. May someone assign this issue to me for my first contribution in Spark. Thanks:) > Issue a better error message for `CREATE TEMPORARY FUNCTION IF NOT EXISTS` > -- > > Key: SPARK-24077 > URL: https://issues.apache.org/jira/browse/SPARK-24077 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 2.3.0 >Reporter: Benedict Jin >Priority: Major > Labels: starter > > The error message of {{CREATE TEMPORARY FUNCTION IF NOT EXISTS}} looks > confusing: > {code} > scala> > org.apache.spark.sql.SparkSession.builder().enableHiveSupport.getOrCreate.sql("CREATE > TEMPORARY FUNCTION IF NOT EXISTS yuzhouwan as > 'org.apache.spark.sql.hive.udf.YuZhouWan'") > {code} > {code} > org.apache.spark.sql.catalyst.parser.ParseException: > mismatched input 'NOT' expecting \{'.', 'AS'}(line 1, pos 29) > == SQL == > CREATE TEMPORARY FUNCTION IF NOT EXISTS yuzhouwan as > 'org.apache.spark.sql.hive.udf.YuZhouWan' > -^^^ > at > org.apache.spark.sql.catalyst.parser.ParseException.withCommand(ParseDriver.scala:197) > at > org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parse(ParseDriver.scala:99) > at > org.apache.spark.sql.execution.SparkSqlParser.parse(SparkSqlParser.scala:45) > at > org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parsePlan(ParseDriver.scala:53) > at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:592) > ... 48 elided > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-24077) Issue a better error message for `CREATE TEMPORARY FUNCTION IF NOT EXISTS`
[ https://issues.apache.org/jira/browse/SPARK-24077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16853573#comment-16853573 ] Hyukjin Kwon commented on SPARK-24077: -- Reopened after editing the JIRA. > Issue a better error message for `CREATE TEMPORARY FUNCTION IF NOT EXISTS` > -- > > Key: SPARK-24077 > URL: https://issues.apache.org/jira/browse/SPARK-24077 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 2.3.0 >Reporter: Benedict Jin >Priority: Major > Labels: starter > > The error message of {{CREATE TEMPORARY FUNCTION IF NOT EXISTS}} looks > confusing: > {code} > scala> > org.apache.spark.sql.SparkSession.builder().enableHiveSupport.getOrCreate.sql("CREATE > TEMPORARY FUNCTION IF NOT EXISTS yuzhouwan as > 'org.apache.spark.sql.hive.udf.YuZhouWan'") > {code} > {code} > org.apache.spark.sql.catalyst.parser.ParseException: > mismatched input 'NOT' expecting \{'.', 'AS'}(line 1, pos 29) > == SQL == > CREATE TEMPORARY FUNCTION IF NOT EXISTS yuzhouwan as > 'org.apache.spark.sql.hive.udf.YuZhouWan' > -^^^ > at > org.apache.spark.sql.catalyst.parser.ParseException.withCommand(ParseDriver.scala:197) > at > org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parse(ParseDriver.scala:99) > at > org.apache.spark.sql.execution.SparkSqlParser.parse(SparkSqlParser.scala:45) > at > org.apache.spark.sql.catalyst.parser.AbstractSqlParser.parsePlan(ParseDriver.scala:53) > at org.apache.spark.sql.SparkSession.sql(SparkSession.scala:592) > ... 48 elided > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org