[
https://issues.apache.org/jira/browse/HIVE-6219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13913460#comment-13913460
]
Steven Willis commented on HIVE-6219:
-------------------------------------
I just added the following to HIVE-5112, but it seems like this issue is a
better place to track the incompatibility between hadoop and hive with respect
to protocol buffers:
The hive downloads page says that hive-0.12.0 is compatible with hadoop-2.x.y .
However, I have hive-0.12.0 installed with hadoop-2.2.0 and I get the same
error that Abin Shahab has. I noticed that if I moved all the
protobuf-java-2.5.0.jar files under hadoop's lib dirs to
protobuf-java-2.5.0.jar.bak, then I didn't get the error.
It looks like protobuf 2.5.0 is not compatible with generated code from 2.4.1,
and if I move all of the newer jars out of the way, then the
protobuf-java-2.4.1.jar file is found under hive's lib dir.
I think there needs to be a new release (0.12.1 or 0.13.0) with the upgrade to
protobuf-2.5.0 and/or the compatibility note on the downloads page needs to be
adjusted.
> TestProtocolBuffersObjectInspectors fails when upgrading protobuf to 2.5.0
> --------------------------------------------------------------------------
>
> Key: HIVE-6219
> URL: https://issues.apache.org/jira/browse/HIVE-6219
> Project: Hive
> Issue Type: Bug
> Components: Serializers/Deserializers
> Affects Versions: 0.13.0
> Reporter: Gordon Wang
>
> As Hadoop 2.2.0 is GA, the protobuf version in Hadoop 2.2.0 is protobuf 2.5.0.
> I notice that there is already a jira HIVE-5112 about protobuf upgrading. But
> in this jira,{code} serde/if/test/complexpb.proto {code}is not generated with
> protobuf 2.5.0.
> If we generate it with protobuf 2.5.0, then
> TestProtocolBuffersObjectInspectors fails.
> The error message is like this
> {code}
> java.lang.RuntimeException: Internal error: Cannot find ObjectInspector for
> UNKNOWN
> at
> org.apache.hadoop.hive.serde2.objectinspector.primitive.PrimitiveObjectInspectorFactory.getPrimitiveJavaObjectInspector(PrimitiveObjectInspectorFactory.java:332)
> at
> org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspectorNoCache(ObjectInspectorFactory.java:146)
> at
> org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspector(ObjectInspectorFactory.java:69)
> at
> org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspectorNoCache(ObjectInspectorFactory.java:192)
> at
> org.apache.hadoop.hive.serde2.objectinspector.ObjectInspectorFactory.getReflectionObjectInspector(ObjectInspectorFactory.java:69)
> at
> org.apache.hadoop.hive.serde2.objectinspector.TestProtocolBuffersObjectInspectors.testProtocolBuffersObjectInspectors(TestProtocolBuffersObjectInspectors.java:40)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:601)
> at junit.framework.TestCase.runTest(TestCase.java:168)
> at junit.framework.TestCase.runBare(TestCase.java:134)
> at junit.framework.TestResult$1.protect(TestResult.java:110)
> at junit.framework.TestResult.runProtected(TestResult.java:128)
> at junit.framework.TestResult.run(TestResult.java:113)
> at junit.framework.TestCase.run(TestCase.java:124)
> at junit.framework.TestSuite.runTest(TestSuite.java:243)
> at junit.framework.TestSuite.run(TestSuite.java:238)
> at
> org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:520)
> at
> org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1060)
> at
> org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:911)
> {code}
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
