Nigel Savage created HIVE-6336:
----------------------------------
Summary: Issue is hive 12 datanucleus incompatability with
org.apache.hadoop.hive.contrib.serde2.RegexSerDe
Key: HIVE-6336
URL: https://issues.apache.org/jira/browse/HIVE-6336
Project: Hive
Issue Type: Wish
Components: HiveServer2
Affects Versions: 0.12.0
Environment: Hadoop 2.2 local derby Meatastore embedded
Reporter: Nigel Savage
Priority: Blocker
Issue is hive 12 datanucleus incompatability with
org.apache.hadoop.hive.contrib.serde2.RegexSerDe
I have hadoop and hive running as a pseudo cluster local mode and derby as the
metastore
I have the following environment variables
HADOOP_HOME=/home/ubu/hadoop
JAVA_HOME=/usr/lib/jvm/java-7-oracle
I have the RegexSerDe declared in thew hive-site.xml
<property>
<name>hive.aux.jars.path</name>
<value>file:///home/ubu/hadoop/lib/hive-contrib-0.12.0.jar </value>
<description>This JAR file available to all users for
alljobs</description>
</property>
If I run with <datanucleus.version>3.0.2</datanucleus.version> I get the
following exception
java.lang.ClassNotFoundException:
org.datanucleus.store.types.backed.Map
If I run with <datanucleus.version>3.2.0-release</datanucleus.version> I get
the following exception
java.lang.ClassNotFoundException:
org/apache/hadoop/hive/contrib/serde2/RegexSerDe
basically the RegexSerDe class is picked up at run time but the datanucleus Map
class is not available, I have checked in the
datanucleus-core 3.0.2 jar and it is missing
upgrading to the first datanucleus above 3.0.2 that incluse the Map class
throws the ClassNotFoundException for RegexSerDe
what is the version of datanucleus I should be using with Hive 12 and Hadoop
2.2, thanks for your time and effort
here are the dependencies from the pom
<dependency>
<groupId>javax.jdo</groupId>
<artifactId>jdo-api</artifactId>
<version>3.0.1</version>
</dependency>
<dependency>
<groupId>org.datanucleus</groupId>
<artifactId>datanucleus-core</artifactId>
<version>${datanucleus.version}</version>
<scope>runtime</scope>
</dependency>
<dependency>
<groupId>org.datanucleus</groupId>
<artifactId>datanucleus-rdbms</artifactId>
<version>${datanucleus.version}</version>
<scope>runtime</scope>
</dependency>
<dependency>
<groupId>org.datanucleus</groupId>
<artifactId>datanucleus-api-jdo</artifactId>
<version>${datanucleus.version}</version>
</dependency>
<!-- hadoop -->
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-client</artifactId>
<version>${hadoop.version}</version>
</dependency>
<!-- hive -->
<dependency>
<groupId>org.apache.hive</groupId>
<artifactId>hive-common</artifactId>
<version>${hive.version}</version>
<scope>provided</scope>
</dependency>
<dependency>
<groupId>org.apache.hive</groupId>
<artifactId>hive-serde</artifactId>
<version>${hive.version}</version>
<scope>provided</scope>
</dependency>
<dependency>
<groupId>org.apache.hive</groupId>
<artifactId>hive-exec</artifactId>
<version>${hive.version}</version>
<scope>provided</scope>
</dependency>
<dependency>
<groupId>org.apache.hive</groupId>
<artifactId>hive-jdbc</artifactId>
<version>${hive.version}</version>
</dependency>
<dependency>
<groupId>org.apache.hive</groupId>
<artifactId>hive-contrib</artifactId>
<version>${hive.version}</version>
</dependency>
<dependency>
<groupId>com.jolbox</groupId>
<artifactId>bonecp</artifactId>
<version>${bonecp.version}</version>
</dependency>
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
