Re: Hadoop 2.6 compatibility?

2014-12-20 Thread Sean Owen
To clarify clarify, Ted's got the right formula. You would use -Phadoop-2.4 to set up the build configuration, and then customize -Dhadoop.version= further to the 2.4+ version you want. On Sat, Dec 20, 2014 at 12:35 AM, Denny Lee wrote: > To clarify, there isn't a Hadoop 2.6 profile per se but yo

Re: Hadoop 2.6 compatibility?

2014-12-19 Thread Denny Lee
Sorry Ted! I saw profile (-P) but missed the -D. My bad! On Fri, Dec 19, 2014 at 16:46 Ted Yu wrote: > Here is the command I used: > > mvn package -Pyarn -Dyarn.version=2.6.0 -Phadoop-2.4 > -Dhadoop.version=2.6.0 -Phive -DskipTests > > FYI > > On Fri, Dec 19, 2014 at 4:35 PM, Denny Lee wrote: >

Re: Hadoop 2.6 compatibility?

2014-12-19 Thread Ted Yu
Here is the command I used: mvn package -Pyarn -Dyarn.version=2.6.0 -Phadoop-2.4 -Dhadoop.version=2.6.0 -Phive -DskipTests FYI On Fri, Dec 19, 2014 at 4:35 PM, Denny Lee wrote: > To clarify, there isn't a Hadoop 2.6 profile per se but you can build > using -Dhadoop.version=2.4 which works with

Re: Hadoop 2.6 compatibility?

2014-12-19 Thread Denny Lee
To clarify, there isn't a Hadoop 2.6 profile per se but you can build using -Dhadoop.version=2.4 which works with Hadoop 2.6. On Fri, Dec 19, 2014 at 12:55 Ted Yu wrote: > You can use hadoop-2.4 profile and pass -Dhadoop.version=2.6.0 > > Cheers > > On Fri, Dec 19, 2014 at 12:51 PM, sa wrote: >

Re: Hadoop 2.6 compatibility?

2014-12-19 Thread Ted Yu
You can use hadoop-2.4 profile and pass -Dhadoop.version=2.6.0 Cheers On Fri, Dec 19, 2014 at 12:51 PM, sa wrote: > Can Spark be built with Hadoop 2.6? All I see instructions up to are for > 2.4 > and there does not seem to be a hadoop2.6 profile. If it works with Hadoop > 2.6, can anyone recom