[ https://issues.apache.org/jira/browse/HIVE-12403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eugene Koifman updated HIVE-12403: ---------------------------------- Assignee: (was: Eugene Koifman) > Too many delta files during Compaction - OOM Part Deux > ------------------------------------------------------ > > Key: HIVE-12403 > URL: https://issues.apache.org/jira/browse/HIVE-12403 > Project: Hive > Issue Type: Bug > Components: Transactions > Affects Versions: 1.3.0 > Reporter: Eugene Koifman > > HIVE-11540 solution is somewhat incomplete. > Suppose hive.compactor.max.num.delta=10 and there are 1000 delta files to > compact. > CompactorMR will currently run 100 jobs on 10 files each to create 100 wider > delta files but then it will run 1 job which will include 100 of the wider > deltas. > it's a simple fix to make sure the max.num.delta is always respected -- This message was sent by Atlassian JIRA (v6.3.4#6332)