[
https://issues.apache.org/jira/browse/HIVE-26717?focusedWorklogId=839376&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-839376
]
ASF GitHub Bot logged work on HIVE-26717:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 16/Jan/23 11:30
Start Date: 16/Jan/23 11:30
Worklog Time Spent: 10m
Work Description: veghlaci05 commented on code in PR #3935:
URL: https://github.com/apache/hive/pull/3935#discussion_r1071135779
##########
ql/src/java/org/apache/hadoop/hive/ql/txn/compactor/Worker.java:
##########
@@ -315,10 +315,14 @@ protected Boolean findNextCompactionAndExecute(boolean
collectGenericStats, bool
return false;
}
- if (!ci.type.equals(CompactionType.REBALANCE) && ci.numberOfBuckets > 0)
{
- if (LOG.isWarnEnabled()) {
- LOG.warn("Only the REBALANCE compaction accepts the number of
buckets clause (CLUSTERED INTO {N} BUCKETS). " +
- "Since the compaction request is {}, it will be ignored.",
ci.type);
+ boolean insertOnly = AcidUtils.isInsertOnlyTable(table.getParameters());
+ if (LOG.isWarnEnabled() && ci.type.equals(CompactionType.REBALANCE) &&
insertOnly) {
+ LOG.warn("REBALANCE compaction requested on an insert-only table ({}).
Falling back to MAJOR compaction as " +
+ "REBALANCE compaction is supported only on full-acid tables",
table.getTableName());
+ if (ci.numberOfBuckets > 0) {
Review Comment:
Yes, during the implementation of the insert-only REBALANCE, two things
turned out:
- only in case of full-acid tables were are accepting the number of buckets
- in case of insert-only tables the number of buckets are ignored like for
non REBALANCE compactions, and we are falling back to MM MAJOR compaction.
This logging block has been adjusted to reflect the changes above.
Issue Time Tracking
-------------------
Worklog Id: (was: 839376)
Time Spent: 1h 20m (was: 1h 10m)
> Query based Rebalance compaction on insert-only tables
> ------------------------------------------------------
>
> Key: HIVE-26717
> URL: https://issues.apache.org/jira/browse/HIVE-26717
> Project: Hive
> Issue Type: Sub-task
> Components: Hive
> Reporter: László Végh
> Assignee: László Végh
> Priority: Major
> Labels: ACID, compaction, pull-request-available
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
