Steve Lindemann created SPARK-9278: -------------------------------------- Summary: DataFrameWriter.insertInto inserts incorrect data Key: SPARK-9278 URL: https://issues.apache.org/jira/browse/SPARK-9278 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 1.4.0 Environment: Linux, S3, Hive Metastore Reporter: Steve Lindemann
After creating a partitioned Hive table (stored as Parquet) via the DataFrameWriter.createTable command, subsequent attempts to insert additional data into new partitions of this table result in inserting incorrect data rows. Reordering the columns in the data to be written seems to avoid this issue. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org