Krisztian Kasa created HIVE-26795: ------------------------------------- Summary: Iceberg integration: clean up temporary files in case of statement cancel Key: HIVE-26795 URL: https://issues.apache.org/jira/browse/HIVE-26795 Project: Hive Issue Type: Bug Components: Iceberg integration Reporter: Krisztian Kasa
Iceberg write operations are performed in the Tez task but the Iceberg commit of these writes are happening in the move task. To inform the MoveTask what writes has to be committed temp files are created with the path of the actual datafiles. Also in case of ctas statements the table is created by the ddl task is serialized into a temp file to be available for the Tez task which does the writes into the newly created table. Normally the cleanup of these temp files are happening in the move task but this task is not executed in case of cancel or an error in tez task. -- This message was sent by Atlassian Jira (v8.20.10#820010)