mcdull_zhang created SPARK-31459: ------------------------------------ Summary: When using the insert overwrite directory syntax, if the target path is an existing file, the final run result is incorrect Key: SPARK-31459 URL: https://issues.apache.org/jira/browse/SPARK-31459 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 2.4.5, 3 Environment: spark2.4.5 Reporter: mcdull_zhang
When using the insert overwrite directory syntax, if the target path is an existing file, the final operation result is incorrect. At present, Spark will not delete the existing files. After the calculation is completed, one of the result files will be renamed to the result path. This is different from hive's behavior. Hive will delete the existing target file. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org