Steve Lindemann created SPARK-9278:
--------------------------------------

             Summary: DataFrameWriter.insertInto inserts incorrect data
                 Key: SPARK-9278
                 URL: https://issues.apache.org/jira/browse/SPARK-9278
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 1.4.0
         Environment: Linux, S3, Hive Metastore
            Reporter: Steve Lindemann


After creating a partitioned Hive table (stored as Parquet) via the 
DataFrameWriter.createTable command, subsequent attempts to insert additional 
data into new partitions of this table result in inserting incorrect data rows. 
Reordering the columns in the data to be written seems to avoid this issue.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to