[
https://issues.apache.org/jira/browse/SPARK-34555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karen Feng updated SPARK-34555:
-------------------------------
Description: Today, we can't resolve a metadata column from a Spark
dataframe from Scala with {{df.col("metadataColName")}}. This is because
metadata output is only used during {{resolveChildren}} (used during SQL
resolution); it should likely also be used by {{resolve}} (used during Scala
resolution). (was: Today, we can't resolve a metadata column from a Spark SQL
dataframe with `df.col("metadataColName")`. This is because metadata output is
only used during `resolveChildren`; it should likely also be used by `resolve`.)
> Resolve metadata output
> -----------------------
>
> Key: SPARK-34555
> URL: https://issues.apache.org/jira/browse/SPARK-34555
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 3.1.0
> Reporter: Karen Feng
> Priority: Minor
>
> Today, we can't resolve a metadata column from a Spark dataframe from Scala
> with {{df.col("metadataColName")}}. This is because metadata output is only
> used during {{resolveChildren}} (used during SQL resolution); it should
> likely also be used by {{resolve}} (used during Scala resolution).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
