[
https://issues.apache.org/jira/browse/SPARK-30339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhenhua Wang updated SPARK-30339:
---------------------------------
Description: Currently if function lookup fails, spark will give it a
second chance by casting decimal type to double type. But for cases where
decimal type doesn't exist, it's meaningless to lookup again and cause extra
cost like unnecessary metastore access. We should throw exceptions directly in
these cases. (was: Currently if function lookup fails, spark will give it a
second change by casting decimal type to double type. But for cases where
decimal type doesn't exist, it's meaningless to lookup again and causes extra
cost like unnecessary metastore access. We should throw exceptions directly in
these cases.)
> Avoid to fail twice in function lookup
> --------------------------------------
>
> Key: SPARK-30339
> URL: https://issues.apache.org/jira/browse/SPARK-30339
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 2.4.5, 3.0.0
> Reporter: Zhenhua Wang
> Assignee: Zhenhua Wang
> Priority: Minor
> Fix For: 3.0.0
>
>
> Currently if function lookup fails, spark will give it a second chance by
> casting decimal type to double type. But for cases where decimal type doesn't
> exist, it's meaningless to lookup again and cause extra cost like unnecessary
> metastore access. We should throw exceptions directly in these cases.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
