[ https://issues.apache.org/jira/browse/HIVE-18429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eugene Koifman reassigned HIVE-18429: ------------------------------------- > Compaction should handle a case when it produces no output > ---------------------------------------------------------- > > Key: HIVE-18429 > URL: https://issues.apache.org/jira/browse/HIVE-18429 > Project: Hive > Issue Type: Bug > Components: Transactions > Affects Versions: 1.0.0 > Reporter: Eugene Koifman > Assignee: Eugene Koifman > > Suppose we start with empty delta_8_8 and delta_9_9 and compaction runs. > It will currently produce an MR job with 0 splits and so > {{CompactorMR.TMP_LOCATION}} never gets created. This causes > {{CompactorOutputCommitted.commitJob()}} to fail when it tries to do > {{FileStatus[] contents = fs.listStatus(tmpLocation);}} since tmpLocation > doesn't exist. > If compactor fails to produce delta_8_9 here it will fail to do further > compaction unless new delta with data is created. > If the number of empty deltas is > than > HiveConf.ConfVars.COMPACTOR_MAX_NUM_DELTA, compaction will not be able to > proceed at all. > It should produce a delta_8_9 in this case even if it's empty. -- This message was sent by Atlassian JIRA (v6.4.14#64029)