[ https://issues.apache.org/jira/browse/HIVE-11376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14651480#comment-14651480 ]
Amareshwari Sriramadasu commented on HIVE-11376: ------------------------------------------------ +1 for the patch, pending test results. > CombineHiveInputFormat is falling back to HiveInputFormat in case codecs are > found for one of the input files > ------------------------------------------------------------------------------------------------------------- > > Key: HIVE-11376 > URL: https://issues.apache.org/jira/browse/HIVE-11376 > Project: Hive > Issue Type: Bug > Reporter: Rajat Khandelwal > Assignee: Rajat Khandelwal > Attachments: HIVE-11376_02.patch > > > https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/io/CombineHiveInputFormat.java#L379 > This is the exact code snippet: > {noformat} > / Since there is no easy way of knowing whether MAPREDUCE-1597 is present in > the tree or not, > // we use a configuration variable for the same > if (this.mrwork != null && !this.mrwork.getHadoopSupportsSplittable()) { > // The following code should be removed, once > // https://issues.apache.org/jira/browse/MAPREDUCE-1597 is fixed. > // Hadoop does not handle non-splittable files correctly for > CombineFileInputFormat, > // so don't use CombineFileInputFormat for non-splittable files > //ie, dont't combine if inputformat is a TextInputFormat and has > compression turned on > {noformat} -- This message was sent by Atlassian JIRA (v6.3.4#6332)