Jason Fehr created IMPALA-12768:
-----------------------------------

             Summary: Set iceberg.engine.hive.lock-enabled To false By Default 
                 Key: IMPALA-12768
                 URL: https://issues.apache.org/jira/browse/IMPALA-12768
             Project: IMPALA
          Issue Type: Improvement
          Components: be
            Reporter: Jason Fehr


[Iceberg 
documentation|https://iceberg.apache.org/docs/latest/configuration/#hadoop-configuration]
 says to set the property "iceberg.engine.hive.lock-enabled

{noformat}
Warn: Setting iceberg.engine.hive.lock-enabled=false will cause HiveCatalog to 
commit to tables without using Hive locks. This should only be set to false if 
all following conditions are met:

* HIVE-26882 is available on the Hive Metastore server
* All other HiveCatalogs committing to tables that this HiveCatalog commits to 
are also on Iceberg 1.3 or later
* All other HiveCatalogs committing to tables that this HiveCatalog commits to 
have also disabled Hive locks on commit.

Failing to ensure these conditions risks corrupting the table.
{noformat}

Setting this property to false reduces the possibility of stuck table locks 
where the lock in HMS does not get released because the Impala process that 
took the lock was ungracefully killed before it released the lock.




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to