[
https://issues.apache.org/jira/browse/PIG-3892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14010805#comment-14010805
]
Daniel Dai commented on PIG-3892:
---------------------------------
bq. Whether hadoop1 or hadoop2, HADOOP_CORE_JAR is not zero-length, so the
following doesn't work
How do you install Hadoop 2? I download Apache tar ball and it does not contain
hadoop-core.jar. Is there an easy way to distinguish h2 from h1 from your
installation?
bq. jar-all-h12 shouldn't depend on jar and jar-withouthadoop
It should not, new patch will remove this
bq.Won't this break BigTop for the same reason as PIG-3905 because ivy will
resolve both hadoop1 and hadoop2 dependencies no matter what the value of
hadoopversion is?
Yes, "ant package" will create the distribution layout containing both
pig-h1.jar and pig-h2.jar, which will need both hadoop 1 and hadoop 2
dependency. It might create some trouble if the private maven repository only
carry h2 build artifacts. But can BIGTOP specify public maven repository as an
alternative? [~gkesavan], [~cos], want to comment on this?
> Pig distribution for hadoop 2
> -----------------------------
>
> Key: PIG-3892
> URL: https://issues.apache.org/jira/browse/PIG-3892
> Project: Pig
> Issue Type: Bug
> Components: build
> Reporter: Daniel Dai
> Assignee: Daniel Dai
> Fix For: 0.13.0
>
> Attachments: PIG-3892-1.patch, PIG-3892-2.patch
>
>
> Currently Pig distribution only bundle pig.jar for Hadoop 1. For Hadoop 2
> users they need to compile again using -Dhadoopversion=23 flag. That is a
> quite confusing process. We need to make Pig work with Hadoop 2 out of box. I
> am thinking two approaches:
> 1. Bundle both pig-h1.jar and pig-h2.jar in distribution, and bin/pig will
> chose the right pig.jar to run
> 2. Make two Pig distributions for Hadoop 1 and Hadoop
> Any opinion?
--
This message was sent by Atlassian JIRA
(v6.2#6252)