[ https://issues.apache.org/jira/browse/SPARK-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105537#comment-14105537 ]
William Benton commented on SPARK-2863: --------------------------------------- I wrote up how Hive handles type coercions in a blog post: http://chapeau.freevariable.com/2014/08/existing-system-coercion.html The short version is that strings can be coerced to doubles or decimals and (in Hive 0.13) decimals can be coerced to doubles for numeric functions. As a first pass, I propose extending the numeric function helpers to handle strings. > Emulate Hive type coercion in native reimplementations of Hive functions > ------------------------------------------------------------------------ > > Key: SPARK-2863 > URL: https://issues.apache.org/jira/browse/SPARK-2863 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 1.0.0 > Reporter: William Benton > Assignee: William Benton > > Native reimplementations of Hive functions no longer have the same > type-coercion behavior as they would if executed via Hive. As [Michael > Armbrust points > out|https://github.com/apache/spark/pull/1750#discussion_r15790970], queries > like {{SELECT SQRT("2") FROM src LIMIT 1}} succeed in Hive but fail if > {{SQRT}} is implemented natively. > Spark SQL should have Hive-compatible type coercions for arguments to > natively-implemented functions. -- This message was sent by Atlassian JIRA (v6.2#6252) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org