yangz created SPARK-24238:
-----------------------------
Summary: HadoopFsRelation can't append the same table with multi
job.
Key: SPARK-24238
URL: https://issues.apache.org/jira/browse/SPARK-24238
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 2.3.0, 2.2.0, 2.4.0
Reporter: yangz
Fix For: 2.4.0
When there are multiple tasks at the same time append a *_HadoopFsRelation_*,
there will be an error, there are the following two errors:
1. A task will succeed, but the data will be wrong and more data than excepted
will appear
2. Other tasks will fail with *_java.io.FileNotFoundException: Failed to get
file status skip_dir/_temporary/0, ENOENT: No such file or directory_*
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
