[ 
https://issues.apache.org/jira/browse/HIVE-29532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Marta Kuczora resolved HIVE-29532.
----------------------------------
    Fix Version/s: NA
       Resolution: Duplicate

This is the same issue as in 
[HIVE-30026|https://issues.apache.org/jira/browse/HIVE-30026], so closing this 
as duplicate.

> FindPotentialCompactions method is Truncating out some records, even though 
> corresponding entries still exist in COMPLETED_TXN_COMPONENTS
> -----------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-29532
>                 URL: https://issues.apache.org/jira/browse/HIVE-29532
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 4.0.0, 4.1.0, 4.0.1, 4.2.0
>            Reporter: Denys Kuzmenko
>            Priority: Major
>             Fix For: NA
>
>
> *Problem Statement* -  Hive Compaction Initiator not initiating compaction 
> for few tables. 
> Every Initiator cycle hits exactly 1000 candidates (COMPACTOR_FETCH_SIZE 
> limit) and ignores the rest on the next cycle
> In findPotentialCompactions, the condition TC.CTC_TIMESTAMP >= 
> CURRENT_TIMESTAMP - INTERVAL 300 SECOND, returns rows where CTC_TIMESTAMP is 
> within the last 300 seconds, i.e., the last 5 minutes.
> The next cycle doesn't pick this table due to the above condition hence it 
> remains in the table itself. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to