[
https://issues.apache.org/jira/browse/SPARK-1491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13984069#comment-13984069
]
Patrick Wendell commented on SPARK-1491:
----------------------------------------
Fixed by :
https://github.com/apache/spark/pull/480
I tested the build with this exact configuration and it worked.
> maven hadoop-provided profile fails to build
> --------------------------------------------
>
> Key: SPARK-1491
> URL: https://issues.apache.org/jira/browse/SPARK-1491
> Project: Spark
> Issue Type: Bug
> Components: Build
> Affects Versions: 1.0.0
> Reporter: Thomas Graves
> Assignee: Guoqiang Li
> Fix For: 1.0.0
>
>
> I tried to use the -Phadoop-profile with maven to build the assembly without
> the yarn/hadoop pieces that are already on the cluster, but it fails with:
> [ERROR] The project org.apache.spark:spark-parent:1.0.0-SNAPSHOT
> (/home/tgraves/tgravescs-spark/pom.xml) has 2 errors
> [ERROR] 'dependencies.dependency.version' for
> org.apache.avro:avro-ipc:jar is missing. @ line 884, column 21
> [ERROR] 'dependencies.dependency.version' for
> org.apache.zookeeper:zookeeper:jar is missing. @ line 889, column 21
> [ERROR]
> This means avro-ipc and zookeeper don't have versions in the
> dependencyManagement section.
> I tried on both hadoop 0.23 and hadoop 2.3.0. build command like:
> mvn -Dyarn.version=0.23.9 -Dhadoop.version=0.23.9 -Pyarn-alpha
> -Phadoop-provided package -DskipTests
--
This message was sent by Atlassian JIRA
(v6.2#6252)
