Sankar Hariappan created HIVE-18747:
---------------------------------------

             Summary: Cleaner for TXNS_TO_WRITE_ID table entries.
                 Key: HIVE-18747
                 URL: https://issues.apache.org/jira/browse/HIVE-18747
             Project: Hive
          Issue Type: Sub-task
          Components: repl, Transactions
    Affects Versions: 3.0.0
            Reporter: Sankar Hariappan
            Assignee: Sankar Hariappan
             Fix For: 3.0.0


Per table write ID implementation (HIVE-18192) maintains a map between txn ID 
and table write ID in TXN_TO_WRITE_ID meta table. 

The entries in this table is used to generate ValidWriteIdList for the given 
ValidTxnList to ensure snapshot isolation. 

When table or database is dropped, then these entries are cleaned-up. But, it 
is necessary to clean-up for active tables too for better performance.

Need to have another table MIN_HISTORY_LEVEL to maintain the least txn which is 
referred by any active ValidTxnList snapshot as open/aborted txn. If no 
references found in this table for any txn, then it is eligible for cleanup.

After clean-up, need to maintain just one entry per table to mark as LWM (low 
water mark).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to