[ https://issues.apache.org/jira/browse/HIVE-25600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sankar Hariappan resolved HIVE-25600. ------------------------------------- Target Version/s: 3.1.3 Resolution: Fixed > Compaction job creates redundant base/delta folder within base/delta folder > --------------------------------------------------------------------------- > > Key: HIVE-25600 > URL: https://issues.apache.org/jira/browse/HIVE-25600 > Project: Hive > Issue Type: Bug > Components: Hive > Affects Versions: 3.1.0, 3.1.2 > Reporter: Nikhil Gupta > Assignee: Nikhil Gupta > Priority: Minor > Labels: ACID, Compaction, pull-request-available > Fix For: 3.1.3 > > Time Spent: 1h > Remaining Estimate: 0h > > {noformat} > Hive table 'aa.bb_item' is corrupt. Found sub-directory > 'abfs://aabb-hive-d...@gen2hiveaabb.dfs.core.windows.net/prod-data/aa.db/bb_item/part_created_on=202105/base_0004042/base_0004042' > in bucket directory for partition: part_created_on=202105 > at > io.prestosql.plugin.hive.BackgroundHiveSplitLoader.loadPartition(BackgroundHiveSplitLoader.java:543) > at > io.prestosql.plugin.hive.BackgroundHiveSplitLoader.loadSplits(BackgroundHiveSplitLoader.java:325) > at > io.prestosql.plugin.hive.BackgroundHiveSplitLoader$HiveSplitLoaderTask.process(BackgroundHiveSplitLoader.java:254) > at io.prestosql.plugin.hive.util.ResumableTasks$1.run(ResumableTasks.java:38) > at io.prestosql.$gen.Presto_347____20210615_143054_2.run(Unknown Source) > at io.airlift.concurrent.BoundedExecutor.drainQueue(BoundedExecutor.java:80) > at > java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) > at > java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) > at java.base/java.lang.Thread.run(Thread.java:829);{noformat} > Why it happens: > Multiple compaction jobs for the same transactions can be triggered if the > HMS gets restarted and the MR job is still in progress. -- This message was sent by Atlassian Jira (v8.3.4#803005)