Jason Phelps created HIVE-27022:
-----------------------------------

             Summary: Split removeDuplicateCompletedTxnComponents away from 
AcidHouseKeeper and onto a separate timer
                 Key: HIVE-27022
                 URL: https://issues.apache.org/jira/browse/HIVE-27022
             Project: Hive
          Issue Type: Improvement
            Reporter: Jason Phelps


The operations and queries involved with removeDuplicateCompletedTxnComponents 
are much costlier than the rest of the AcidHouseKeeper jobs. The default timer 
for metastore.acid.housekeeper.interval is 60s [0], which is much too frequent 
for removeDuplicateCompletedTxnComponents, but fine for the other operations. 

There is no way of lowering the internal for just 
removeDuplicateCompletedTxnComponents without impacting the other 
AcidHouseKeeper jobs, so I am requesting that it be split into its own 
process/timer



[0]
https://github.com/apache/hive/blob/master/standalone-metastore/metastore-common/src/main/java/org/apache/hadoop/hive/metastore/conf/MetastoreConf.java#L286
 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to