[ https://issues.apache.org/jira/browse/SPARK-24238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
yangz updated SPARK-24238: -------------------------- Summary: HadoopFsRelation can't append the same table with multi job at the same time. (was: HadoopFsRelation can't append the same table with multi job.) > HadoopFsRelation can't append the same table with multi job at the same time. > ----------------------------------------------------------------------------- > > Key: SPARK-24238 > URL: https://issues.apache.org/jira/browse/SPARK-24238 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 2.2.0, 2.3.0, 2.4.0 > Reporter: yangz > Priority: Major > Fix For: 2.4.0 > > > When there are multiple tasks at the same time append a *_HadoopFsRelation_*, > there will be an error, there are the following two errors: > 1. A task will succeed, but the data will be wrong and more data than > excepted will appear > 2. Other tasks will fail with *_java.io.FileNotFoundException: Failed to get > file status skip_dir/_temporary/0, ENOENT: No such file or directory_* -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org