[
https://issues.apache.org/jira/browse/SPARK-39783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Enrico Minack updated SPARK-39783:
----------------------------------
Description:
AnalysisException {{[UNRESOLVED_COLUMN.WITH_SUGGESTION]}} shows the wrong
suggestion when a field with the "." separator is referenced without backticks.
The following code references a nested value {{{}`the`.`id`{}}}, that does not
exist. The proposed / existing column names are not correctly wrapped in
backticks:
{code:scala}
Seq((0)).toDF("the.id")
.select("the.id").show()
org.apache.spark.sql.AnalysisException: [UNRESOLVED_COLUMN.WITH_SUGGESTION] A
column or function parameter with name `the`.`id` cannot be resolved. Did you
mean one of the following? [`the`.`id`];
{code}
Instead of suggesting {{[`the`.`id`]}} in the *error message*, you would expect
suggesting {{[`the.id`]}}.
was:
AnalysisException {{[UNRESOLVED_COLUMN.WITH_SUGGESTION]}} shows the wrong
suggestion when a field with the "." separator is referenced without backticks.
The following code references a nested value {{{}`the`.`id`{}}}, that does not
exist. The proposed / existing column names are not correctly wrapped in
backticks:
{code:scala}
Seq((0)).toDF("the.id")
.select("the.id").show()
org.apache.spark.sql.AnalysisException: [UNRESOLVED_COLUMN.WITH_SUGGESTION] A
column or function parameter with name `the`.`id` cannot be resolved. Did you
mean one of the following? [`the`.`id`];
{code}
Instead of {{{}[`the`.`id`]{}}}, you would expect {{{}[`the.id`]{}}}.
> Column backticks are misplaced in the AnalysisException [UNRESOLVED_COLUMN]
> error message when using field with "."
> -------------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-39783
> URL: https://issues.apache.org/jira/browse/SPARK-39783
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 3.4.0
> Reporter: Enrico Minack
> Priority: Major
>
> AnalysisException {{[UNRESOLVED_COLUMN.WITH_SUGGESTION]}} shows the wrong
> suggestion when a field with the "." separator is referenced without
> backticks.
> The following code references a nested value {{{}`the`.`id`{}}}, that does
> not exist. The proposed / existing column names are not correctly wrapped in
> backticks:
> {code:scala}
> Seq((0)).toDF("the.id")
> .select("the.id").show()
> org.apache.spark.sql.AnalysisException: [UNRESOLVED_COLUMN.WITH_SUGGESTION] A
> column or function parameter with name `the`.`id` cannot be resolved. Did you
> mean one of the following? [`the`.`id`];
> {code}
> Instead of suggesting {{[`the`.`id`]}} in the *error message*, you would
> expect suggesting {{[`the.id`]}}.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
