[ https://issues.apache.org/jira/browse/SPARK-5978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Owen updated SPARK-5978: ----------------------------- Summary: Spark, Examples have Hadoop1/2 compat issues with Hadoop 2.0.x (e.g. CDH4) (was: Spark examples cannot compile with Hadoop 2) > Spark, Examples have Hadoop1/2 compat issues with Hadoop 2.0.x (e.g. CDH4) > -------------------------------------------------------------------------- > > Key: SPARK-5978 > URL: https://issues.apache.org/jira/browse/SPARK-5978 > Project: Spark > Issue Type: Bug > Components: Examples, PySpark > Affects Versions: 1.2.0, 1.2.1 > Reporter: Michael Nazario > Labels: hadoop-version > > This is a regression from Spark 1.1.1. > The Spark Examples includes an example for an avro converter for PySpark. > When I was trying to debug a problem, I discovered that even though you can > build with Hadoop 2 for Spark 1.2.0, an hbase dependency depends on Hadoop 1 > somewhere else in the examples code. > An easy fix would be to separate the examples into hadoop specific versions. > Another way would be to fix the hbase dependencies so that they don't rely on > hadoop 1 specific code. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org