Jingsong Lee created FLINK-18130: ------------------------------------ Summary: File name conflict for different jobs in filesystem/hive sink Key: FLINK-18130 URL: https://issues.apache.org/jira/browse/FLINK-18130 Project: Flink Issue Type: Bug Components: Connectors / FileSystem, Connectors / Hive Reporter: Jingsong Lee Assignee: Jingsong Lee Fix For: 1.11.0
The sink of different jobs (or the same SQL runs multiple times) will produce the same file name, the rename will fail, and different file systems will produce different results: * HadoopFileSystem: ignore new data. * LocalFileSystem: overwrite old data. We can add UUID to prefix, make sure there is no conflict between jobs. -- This message was sent by Atlassian Jira (v8.3.4#803005)