The right invocation is still a bit different:
... -Phadoop-2.4 -Dhadoop.version=2.5.0
hadoop-2.4 == Hadoop 2.4+
On Tue, Mar 24, 2015 at 5:44 PM, Denny Lee wrote:
> Hadoop 2.5 would be referenced as via -Dhadoop-2.5 using the profile
> -Phadoop-2.4
>
> Please note earlier in the link the section:
>
> # Apache Hadoop 2.4.X or 2.5.X
> mvn -Pyarn -Phadoop-2.4 -Dhadoop.version=VERSION -DskipTests clean package
>
> Versions of Hadoop after 2.5.X may or may not work with the -Phadoop-2.4
> profile (they were
> released after this version of Spark).
>
>
> HTH!
>
> On Tue, Mar 24, 2015 at 10:28 AM Manoj Samel
> wrote:
>>
>>
>> http://spark.apache.org/docs/latest/building-spark.html#packaging-without-hadoop-dependencies-for-yarn
>> does not list hadoop 2.5 in Hadoop version table table etc.
>>
>> I assume it is still OK to compile with -Pyarn -Phadoop-2.5 for use with
>> Hadoop 2.5 (cdh 5.3.2)
>>
>> Thanks,
-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org