[ https://issues.apache.org/jira/browse/HIVE-2629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13183312#comment-13183312 ]
Amareshwari Sriramadasu commented on HIVE-2629: ----------------------------------------------- Reverted the previous commit, as the patch broke CombineFileInputFormat changes in 23 shims. Jobs which use CombineFileInputFormat fail with following exception: java.lang.ClassCastException: [Lorg.apache.hadoop.mapred.InputSplit; cannot be cast to [Lorg.apache.hadoop.mapred.lib.CombineFileSplit; at org.apache.hadoop.hive.shims.HadoopShimsSecure$CombineFileInputFormatShim.getSplits(HadoopShimsSecure.java:387) at org.apache.hadoop.hive.shims.HadoopShimsSecure$CombineFileInputFormatShim.getSplits(HadoopShimsSecure.java:353) at org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.getSplits(CombineHiveInputFormat.java:387) at org.apache.hadoop.mapreduce.JobSubmitter.writeOldSplits(JobSubmitter.java:472) at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:464) at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:360) at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159) at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:396) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152) at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156) at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:571) at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:432) at org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:690) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:189) Job Submission failed with exception 'java.lang.ClassCastException([Lorg.apache.hadoop.mapred.InputSplit; cannot be cast Looks like we need to have Hadoop20SShims.java and Hadoop23Shims.java files with proper CombineFileInputFormat changes for each version. > Make a single Hive binary work with both 0.20.x and 0.23.0 > ---------------------------------------------------------- > > Key: HIVE-2629 > URL: https://issues.apache.org/jira/browse/HIVE-2629 > Project: Hive > Issue Type: Bug > Components: Shims > Reporter: Carl Steinbach > Assignee: Thomas Weise > Fix For: 0.8.1, 0.9.0 > > Attachments: HIVE-2629.3.patch, HIVE-2629.D711.1.patch, > HIVE-2629.D711.2.patch, HIVE-2629.D711.3.patch, HIVE-2629.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira