http://spark.apache.org/docs/latest/building-spark.html#packaging-without-hadoop-dependencies-for-yarn
does not list hadoop 2.5 in Hadoop version table table etc.
I assume it is still OK to compile with -Pyarn -Phadoop-2.5 for use with
Hadoop 2.5 (cdh 5.3.2)
Thanks,
Hadoop 2.5 would be referenced as via -Dhadoop-2.5 using the profile
-Phadoop-2.4
Please note earlier in the link the section:
# Apache Hadoop 2.4.X or 2.5.X
mvn -Pyarn -Phadoop-2.4 -Dhadoop.version=VERSION -DskipTests clean package
Versions of Hadoop after 2.5.X may or may not work with the
The right invocation is still a bit different:
... -Phadoop-2.4 -Dhadoop.version=2.5.0
hadoop-2.4 == Hadoop 2.4+
On Tue, Mar 24, 2015 at 5:44 PM, Denny Lee denny.g@gmail.com wrote:
Hadoop 2.5 would be referenced as via -Dhadoop-2.5 using the profile
-Phadoop-2.4
Please note earlier in
