Venugopal Reddy K created HIVE-29496:
----------------------------------------
Summary: when source is an iceberg table, materialized view
rebuild failed with "SemanticException: Another process is rebuilding the
materialized view mydb.ice_mv1" OR "SemanticException: Exception acquiring lock
for rebuilding the materialized view"
Key: HIVE-29496
URL: https://issues.apache.org/jira/browse/HIVE-29496
Project: Hive
Issue Type: Bug
Components: Hive
Reporter: Venugopal Reddy K
*[Description]*
when source is an iceberg table, materialized view rebuild succeeds for the
first time. But subsequent materialized view rebuild fail with one of these
exceptions.
"SemanticException org.apache.hadoop.hive.ql.parse.SemanticException: Another
process is rebuilding the materialized view mydb.ice_mv1;" +when rebuild is
tried with same materialized view as first succeeded one.+
*OR*
"SemanticException org.apache.hadoop.hive.ql.parse.SemanticException: Exception
acquiring lock for rebuilding the materialized view;" +when rebuild is tried
with different materialized view.+
Happens because lock is acquired with txn id as 0 and not released after
rebuild. And MRL_TXN_ID is PRIMARY KEY for MATERIALIZATION_REBUILD_LOCKS table.
||MATERIALIZATION_REBUILD_LOCKS||
||MRL_TXN_ID||MRL_DB_NAME||MRL_TBL_NAME||MRL_LAST_HEARTBEAT||
|{color:#FF0000}0{color}|mydb|ice_mv1|1,773,117,466,400|
*[Steps to reproduce]*
# Create an iceberg table, insert some data to it.
# Create a materialized view(either in Hive ACID or Iceberg format) with
source as above created iceberg table.
# Insert some data into iceberg table again so that mv becomes outdated for
rewriting.
# Alter materialized view rebuild so that it can be used in rewriting.
# Repeat step-3 and step-4 again. This time materialized view rebuild throws
*Error: Error while compiling statement: FAILED: SemanticException
org.apache.hadoop.hive.ql.parse.SemanticException: Another process is
rebuilding the materialized view mydb.ice_mv1;*
# Here after, none of the other materialized views(created with any iceberg
source table) rebuild works. All of them fail with below exception. Can verify
with below steps.
## Try creating another iceberg table, insert some data and another
materialized view.
## Insert some more data to the iceberg table and rebuild the mv created on
step-6. Materialized view Rebuild throws - {*}Error: Error while compiling
statement: FAILED: SemanticException
org.apache.hadoop.hive.ql.parse.SemanticException: Exception acquiring lock for
rebuilding the materialized view;{*}{*}{*}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
