[
https://issues.apache.org/jira/browse/SPARK-31459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-31459:
----------------------------------
Affects Version/s: (was: 3)
3.0.0
> When using the insert overwrite directory syntax, if the target path is an
> existing file, the final run result is incorrect
> ---------------------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-31459
> URL: https://issues.apache.org/jira/browse/SPARK-31459
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 2.4.5, 3.0.0
> Environment: spark2.4.5
> Reporter: mcdull_zhang
> Priority: Major
> Labels: sql
>
> When using the insert overwrite directory syntax, if the target path is an
> existing file, the final operation result is incorrect.
> At present, Spark will not delete the existing files. After the calculation
> is completed, one of the result files will be renamed to the result path.
> This is different from hive's behavior. Hive will delete the existing target
> file.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
