[ https://issues.apache.org/jira/browse/FLINK-25049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17450797#comment-17450797 ]
Jark Wu commented on FLINK-25049: --------------------------------- cc [~luoyuxia], it seems the tmpPath is removed by someone when executing multiple INSERT INTO async? > sql-client.sh execute batch job in async mode failed with > java.io.FileNotFoundException > --------------------------------------------------------------------------------------- > > Key: FLINK-25049 > URL: https://issues.apache.org/jira/browse/FLINK-25049 > Project: Flink > Issue Type: Bug > Components: Connectors / Hive, Table SQL / Ecosystem > Affects Versions: 1.14.0 > Reporter: macdoor615 > Priority: Major > Attachments: ddl.sql, merge.sql > > > execute multi simple sql in a sql file, like > > {code:java} > insert overwrite bnpmp.p_biz_hcd_5m select * from bnpmp.p_biz_hcd_5m where > dt='2021-11-22'; > insert overwrite bnpmp.p_biz_hjr_5m select * from bnpmp.p_biz_hjr_5m where > dt='2021-11-22'; > insert overwrite bnpmp.p_biz_hswtv_5m select * from bnpmp.p_biz_hswtv_5m > where dt='2021-11-22'; > ... > {code} > > if > {code:java} > SET table.dml-sync = true;{code} > execute properly. > if > {code:java} > SET table.dml-sync = false;{code} > some SQL Job failed with the following error > > {code:java} > Caused by: java.lang.Exception: Failed to finalize execution on master ... > 37 more Caused by: org.apache.flink.table.api.TableException: Exception in > finalizeGlobal at > org.apache.flink.table.filesystem.FileSystemOutputFormat.finalizeGlobal(FileSystemOutputFormat.java:91) > at > org.apache.flink.runtime.jobgraph.InputOutputFormatVertex.finalizeOnMaster(InputOutputFormatVertex.java:148) > at > org.apache.flink.runtime.executiongraph.DefaultExecutionGraph.vertexFinished(DefaultExecutionGraph.java:1086) > ... 36 more Caused by: java.io.FileNotFoundException: File > hdfs://service1/user/hive/warehouse/bnpmp.db/p_snmp_f5_traffic_5m/.staging_1637821441497 > does not exist. at > org.apache.hadoop.hdfs.DistributedFileSystem.listStatusInternal(DistributedFileSystem.java:901) > at > org.apache.hadoop.hdfs.DistributedFileSystem.access$600(DistributedFileSystem.java:112) > at > org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:961) > at > org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:958) > at > org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) > at > org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:958) > at > org.apache.flink.hive.shaded.fs.hdfs.HadoopFileSystem.listStatus(HadoopFileSystem.java:170) > at > org.apache.flink.table.filesystem.PartitionTempFileManager.listTaskTemporaryPaths(PartitionTempFileManager.java:104) > at > org.apache.flink.table.filesystem.FileSystemCommitter.commitPartitions(FileSystemCommitter.java:77) > at > org.apache.flink.table.filesystem.FileSystemOutputFormat.finalizeGlobal(FileSystemOutputFormat.java:89) > ... 38 more > > {code} > -- This message was sent by Atlassian Jira (v8.20.1#820001)