Caizhi Weng created FLINK-29805: ----------------------------------- Summary: Table Store sink continuously fails with "Trying to add file which is already added" when snapshot committing is slow Key: FLINK-29805 URL: https://issues.apache.org/jira/browse/FLINK-29805 Project: Flink Issue Type: Bug Components: Table Store Affects Versions: table-store-0.3.0, table-store-0.2.2 Reporter: Caizhi Weng Assignee: Caizhi Weng Fix For: table-store-0.3.0, table-store-0.2.2
Table Store sink continuously fails with "Trying to add file which is already added" when snapshot committing is slow. This is due to a bug in {{FileStoreCommitImpl#filterCommitted}}. When this method finds an identifier, it removes the identifier from a map. However different snapshots may have the same identifier (for example an APPEND commit and the following COMPACT commit will have the same identifier), so we need to use another set to check for identifiers. -- This message was sent by Atlassian Jira (v8.20.10#820010)