Xiao Li created SPARK-21144:
-------------------------------

             Summary: Unexpected results when the data schema and partition 
schema have the duplicate columns
                 Key: SPARK-21144
                 URL: https://issues.apache.org/jira/browse/SPARK-21144
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 2.2.0
            Reporter: Xiao Li


{noformat}
    withTempPath { dir =>
      val basePath = dir.getCanonicalPath
      spark.range(0, 3).toDF("foo").write.parquet(new Path(basePath, 
"foo=1").toString)
      spark.range(0, 3).toDF("foo").write.parquet(new Path(basePath, 
"foo=a").toString)
      spark.read.parquet(basePath).show()
    }
{noformat}

The result of the above case is
{noformat}
+---+
|foo|
+---+
|  1|
|  1|
|  a|
|  a|
|  1|
|  a|
+---+
{noformat}




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to