chen xiao created SPARK-25193:
---------------------------------
Summary: insert overwrite doesn't throw exception when drop old
data fails
Key: SPARK-25193
URL: https://issues.apache.org/jira/browse/SPARK-25193
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 2.2.2
Reporter: chen xiao
dataframe.write.mode(SaveMode.Overwrite).insertInto(s"$databaseName.$tableName")
Insert overwrite mode will drop old data in hive table if there's old data.
But if data deleting fails, no exception will be thrown and the data folder
will be like:
hdfs://uxs_nbp/nba_score/dt=2018-08-15/seq_num=2/part-00000
hdfs://uxs_nbp/nba_score/dt=2018-08-15/seq_num=2/part-000001534916642513.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
