[
https://issues.apache.org/jira/browse/PIG-2125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13069124#comment-13069124
]
Daniel Dai commented on PIG-2125:
---------------------------------
Steps to build pig.jar for hadoop 23:
1. change "build.xml", modify "hadoopversion" to "23"
2. change "ivy.xml", remove the lines:
<dependency org="org.apache.hadoop" name="hadoop-core"
rev="${hadoop-core.version}"
conf="compile->default;test->default"/>
<dependency org="org.apache.hadoop" name="hadoop-test"
rev="${hadoop-test.version}"
conf="compile->default;test->default"/>
3. Build hadoop 23, copy hadoop 23 libraries into lib, here is a list:
aopalliance-1.0.jar
commons-cli-1.2.jar
commons-codec-1.4.jar
commons-collections-3.2.1.jar
commons-configuration-1.6.jar
commons-httpclient-3.1.jar
guice-2.0.jar
guice-servlet-2.0.jar
hadoop-common-0.22.0-SNAPSHOT.jar
hadoop-common-test-0.22.0-SNAPSHOT.jar
hadoop-hdfs-0.22.0-SNAPSHOT.jar
hadoop-hdfs-test-0.22.0-SNAPSHOT.jar
hadoop-mapreduce-client-app-1.0-SNAPSHOT.jar
hadoop-mapreduce-client-common-1.0-SNAPSHOT.jar
hadoop-mapreduce-client-core-1.0-SNAPSHOT.jar
hadoop-mapreduce-client-hs-1.0-SNAPSHOT.jar
hadoop-mapreduce-client-jobclient-1.0-SNAPSHOT.jar
hadoop-mapreduce-client-jobclient-1.0-SNAPSHOT-tests.jar
hadoop-mapreduce-client-shuffle-1.0-SNAPSHOT.jar
hadoop-metrics2-0.22.0-SNAPSHOT.jar
jetty-6.1.26.jar
log4j-1.2.16.jar
protobuf-java-2.4.0a.jar
servlet-api-2.5-20081211.jar
slf4j-api-1.6.1.jar
slf4j-log4j12-1.6.1.jar
yarn-api-1.0-SNAPSHOT.jar
yarn-common-1.0-SNAPSHOT.jar
yarn-server-common-1.0-SNAPSHOT.jar
yarn-server-nodemanager-1.0-SNAPSHOT.jar
yarn-server-resourcemanager-1.0-SNAPSHOT.jar
yarn-server-tests-1.0-SNAPSHOT-tests.jar
4. Then, do an "ant clean jar"
5. You may also need to recompile your udf with the new hadoop libraries.
> Make Pig work with hadoop .NEXT
> -------------------------------
>
> Key: PIG-2125
> URL: https://issues.apache.org/jira/browse/PIG-2125
> Project: Pig
> Issue Type: New Feature
> Components: impl
> Affects Versions: 0.10
> Reporter: Daniel Dai
> Assignee: Daniel Dai
> Fix For: 0.10
>
> Attachments: PIG-2125-1.patch, PIG-2125-2.patch, PIG-2125-3.patch,
> PIG-2125-4.patch, PIG-2125-5.patch
>
>
> We need to make Pig work with hadoop .NEXT, the svn branch currently is:
> https://svn.apache.org/repos/asf/hadoop/common/branches/MR-279
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
