[
https://issues.apache.org/jira/browse/SPARK-21144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-21144:
----------------------------
Target Version/s: 2.2.0
> Unexpected results when the data schema and partition schema have the
> duplicate columns
> ---------------------------------------------------------------------------------------
>
> Key: SPARK-21144
> URL: https://issues.apache.org/jira/browse/SPARK-21144
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 2.2.0
> Reporter: Xiao Li
>
> {noformat}
> withTempPath { dir =>
> val basePath = dir.getCanonicalPath
> spark.range(0, 3).toDF("foo").write.parquet(new Path(basePath,
> "foo=1").toString)
> spark.range(0, 3).toDF("foo").write.parquet(new Path(basePath,
> "foo=a").toString)
> spark.read.parquet(basePath).show()
> }
> {noformat}
> The result of the above case is
> {noformat}
> +---+
> |foo|
> +---+
> | 1|
> | 1|
> | a|
> | a|
> | 1|
> | a|
> +---+
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
