[jira] [Commented] (SPARK-33937) Move the old partition data to trash instead of deleting it when inserting rewrite hive table
[ https://issues.apache.org/jira/browse/SPARK-33937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17256196#comment-17256196 ] 黄海升 commented on SPARK-33937: - I'm sorry. It looks like it is. > Move the old partition data to trash instead of deleting it when inserting > rewrite hive table > - > > Key: SPARK-33937 > URL: https://issues.apache.org/jira/browse/SPARK-33937 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.2.0 >Reporter: 黄海升 >Priority: Minor > Fix For: 3.2.0 > > > InsertIntoHiveTable should move the old partition data to trash instead of > deleting it. > Because that's what we do in hive. > [https://github.com/apache/hive/blob/9c6f8b76123c88b0c8a98645874722ba80b3c2b0/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java] > `deleteOldPathForReplace` -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-33937) Move the old partition data to trash instead of deleting it when inserting rewrite hive table
[ https://issues.apache.org/jira/browse/SPARK-33937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17256192#comment-17256192 ] Chao Sun commented on SPARK-33937: -- This looks like a duplicate of SPARK-32480. > Move the old partition data to trash instead of deleting it when inserting > rewrite hive table > - > > Key: SPARK-33937 > URL: https://issues.apache.org/jira/browse/SPARK-33937 > Project: Spark > Issue Type: Improvement > Components: SQL >Affects Versions: 3.2.0 >Reporter: 黄海升 >Priority: Minor > Fix For: 3.2.0 > > > InsertIntoHiveTable should move the old partition data to trash instead of > deleting it. > Because that's what we do in hive. > [https://github.com/apache/hive/blob/9c6f8b76123c88b0c8a98645874722ba80b3c2b0/ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java] > `deleteOldPathForReplace` -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
