viirya edited a comment on issue #25979: [SPARK-29295][SQL] Insert overwrite to Hive external table partition should delete old data URL: https://github.com/apache/spark/pull/25979#issuecomment-537771098 Currently behavior of INSERT OVERWRITE into a Hive external table partition is consistent with Hive. If the partition was dropped by DROP PARTITION before, INSERT OVERWRITE will not overwrite existing partition directory. If there are files in the directory, conflicting files will be overwritten (Hive 2.1) or exception thrown (Hive 2.3.2). Unique files will be read as duplicated data.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
