[ https://issues.apache.org/jira/browse/SPARK-5978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Owen updated SPARK-5978: ----------------------------- Component/s: (was: PySpark) Build Priority: Critical (was: Major) Labels: (was: hadoop-version) Raising priority since I would like to get more discussion on whether to actually address this or reconsider Hadoop version support. > Spark, Examples have Hadoop1/2 compat issues with Hadoop 2.0.x (e.g. CDH4) > -------------------------------------------------------------------------- > > Key: SPARK-5978 > URL: https://issues.apache.org/jira/browse/SPARK-5978 > Project: Spark > Issue Type: Bug > Components: Build, Examples > Affects Versions: 1.2.0, 1.2.1 > Reporter: Michael Nazario > Priority: Critical > > This is a regression from Spark 1.1.1. > The Spark Examples includes an example for an avro converter for PySpark. > When I was trying to debug a problem, I discovered that even though you can > build with Hadoop 2 for Spark 1.2.0, an hbase dependency depends on Hadoop 1 > somewhere else in the examples code. > An easy fix would be to separate the examples into hadoop specific versions. > Another way would be to fix the hbase dependencies so that they don't rely on > hadoop 1 specific code. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org