[ https://issues.apache.org/jira/browse/SPARK-5978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14336914#comment-14336914 ]
Michael Nazario commented on SPARK-5978: ---------------------------------------- I was building this with 2.0.0-cdh4.7.0. The original version I was using which had this problem also was 2.0.0-cdh4.2.0 which is one of the pre-built distributions of spark. mvn -DskipTests -Phadoop-2.4 -Dhadoop.version=2.0.0-cdh4.7.0 dependency:tree -pl examples will show [INFO] +- org.apache.hbase:hbase-server:jar:0.98.7-hadoop1:compile > Spark examples cannot compile with Hadoop 2 > ------------------------------------------- > > Key: SPARK-5978 > URL: https://issues.apache.org/jira/browse/SPARK-5978 > Project: Spark > Issue Type: Bug > Components: Examples, PySpark > Affects Versions: 1.2.0, 1.2.1 > Reporter: Michael Nazario > Labels: hadoop-version > > This is a regression from Spark 1.1.1. > The Spark Examples includes an example for an avro converter for PySpark. > When I was trying to debug a problem, I discovered that even though you can > build with Hadoop 2 for Spark 1.2.0, an hbase dependency depends on Hadoop 1 > somewhere else in the examples code. > An easy fix would be to separate the examples into hadoop specific versions. > Another way would be to fix the hbase dependencies so that they don't rely on > hadoop 1 specific code. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org