Jackey Lee created SPARK-38521:
----------------------------------

             Summary: Throw Exception if overwriting hive partition table with 
dynamic and staticPartitionOverwriteMode
                 Key: SPARK-38521
                 URL: https://issues.apache.org/jira/browse/SPARK-38521
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 3.3.0
            Reporter: Jackey Lee


The `spark.sql.sources.partitionOverwriteMode` allows us to overwrite the 
existing data of the table through staticmode, but for hive table, it is 
disastrous. It may deleting all data in hive partitioned table while writing 
with dynamic overwrite and `partitionOverwriteMode=STATIC`.

Here we add a check for this and throw Exception if this happends.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to