Jason Fehr created IMPALA-12768: ----------------------------------- Summary: Set iceberg.engine.hive.lock-enabled To false By Default Key: IMPALA-12768 URL: https://issues.apache.org/jira/browse/IMPALA-12768 Project: IMPALA Issue Type: Improvement Components: be Reporter: Jason Fehr
[Iceberg documentation|https://iceberg.apache.org/docs/latest/configuration/#hadoop-configuration] says to set the property "iceberg.engine.hive.lock-enabled {noformat} Warn: Setting iceberg.engine.hive.lock-enabled=false will cause HiveCatalog to commit to tables without using Hive locks. This should only be set to false if all following conditions are met: * HIVE-26882 is available on the Hive Metastore server * All other HiveCatalogs committing to tables that this HiveCatalog commits to are also on Iceberg 1.3 or later * All other HiveCatalogs committing to tables that this HiveCatalog commits to have also disabled Hive locks on commit. Failing to ensure these conditions risks corrupting the table. {noformat} Setting this property to false reduces the possibility of stuck table locks where the lock in HMS does not get released because the Impala process that took the lock was ungracefully killed before it released the lock. -- This message was sent by Atlassian Jira (v8.20.10#820010)