[
https://issues.apache.org/jira/browse/GORA-144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13966475#comment-13966475
]
Matzz commented on GORA-144:
----------------------------
Thx. After some changes in pom.xml and gora-core/pom.xml I was able to package
gora 0.4 with cloudera chd5 hadoop jars. I didn't test it in production yet but
at least test are passing.
{code:title=pom.xml}
<properties>
/*...*/
<!-- Hadoop Dependencies -->
<hadoop.version>2.2.0-mr1-cdh5.0.0-beta-2</hadoop.version>
<hadoop.common.version>2.2.0-cdh5.0.0-beta-2</hadoop.common.version>
/*...*/
</properties>
<dependencies>
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-common</artifactId>
<version>${hadoop.common.version}</version>
/* not sure if those exclusions are necessary */
<exclusions>
<!-- jackson is conflicting with the Avro dep -->
<exclusion>
<groupId>org.codehaus.jackson</groupId>
<artifactId>jackson-core-asl</artifactId>
</exclusion>
<exclusion>
<groupId>org.codehaus.jackson</groupId>
<artifactId>jackson-mapper-asl</artifactId>
</exclusion>
<exclusion>
<groupId>hsqldb</groupId>
<artifactId>hsqldb</artifactId>
</exclusion>
<exclusion>
<groupId>net.sf.kosmos</groupId>
<artifactId>kfs</artifactId>
</exclusion>
<exclusion>
<groupId>net.java.dev.jets3t</groupId>
<artifactId>jets3t</artifactId>
</exclusion>
<exclusion>
<groupId>org.eclipse.jdt</groupId>
<artifactId>core</artifactId>
</exclusion>
</exclusions>
</dependency>
</dependencies>
{code}
{code:title=gora-core/pom.xml}
<dependencies>
<!-- Hadoop Dependencies -->
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-core</artifactId>
</dependency>
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-common</artifactId>
</dependency>
</dependencies>
/*...*/
{code}
> Upgrade gora so to be compatible with hadoop 2
> ----------------------------------------------
>
> Key: GORA-144
> URL: https://issues.apache.org/jira/browse/GORA-144
> Project: Apache Gora
> Issue Type: Task
> Components: avro, build process, maven
> Affects Versions: 0.2
> Reporter: raf shin
> Priority: Minor
> Fix For: 0.4
>
>
> TaskAttemptContext and JobContext which were a class in previous hadoop
> versions are now interfaces.
> Compiling gora with new hadoop version 2 fails.
> BinaryDecoder and BinaryEncoder in Avro 1.5.4 are also now interfaces which
> were previously class.
> avro.ipc.ByteBufferOutputStream and avro.ipc.ByteBufferInputStream are also
> moved to avro.util package.
> There might be much more incompatibilities there which we have not seen yet.
> We gave up upgrading our nutchgora to the new hadoop 2 version.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
