How to build Spark against the latest

2014-12-23 Thread guxiaobo1982
Hi, The official pom.xml file only have profile for hadoop version 2.4 as the latest version, but I installed hadoop version 2.6.0 with ambari, how can I build spark against it, just using mvn -Dhadoop.version=2.6.0, or how to make a coresponding profile for it? Regards, Xiaobo

Re: How to build Spark against the latest

2014-12-23 Thread Ted Yu
See http://search-hadoop.com/m/JW1q5Cew0j On Tue, Dec 23, 2014 at 8:00 PM, guxiaobo1982 wrote: > Hi, > The official pom.xml file only have profile for hadoop version 2.4 as the > latest version, but I installed hadoop version 2.6.0 with ambari, how can I > build spark against it, just using mvn

Re: How to build Spark against the latest

2014-12-24 Thread guxiaobo1982
Hi Ted, The reference command works, but where I can get the deployable binaries? Xiaobo Gu -- Original -- From: "Ted Yu";; Send time: Wednesday, Dec 24, 2014 12:09 PM To: ""; Cc: "user@spark.apache.org"; Subject:

Re: How to build Spark against the latest

2014-12-24 Thread guxiaobo1982
Send time: Wednesday, Dec 24, 2014 6:52 PM To: "Ted Yu"; Cc: "user@spark.apache.org"; Subject: Re: How to build Spark against the latest Hi Ted, The reference command works, but where I can get the deployable binaries? Xiaobo Gu -- Original ---

Re: How to build Spark against the latest

2014-12-25 Thread guxiaobo1982
"Ted Yu"; Cc: "user@spark.apache.org"; Subject: Re: How to build Spark against the latest What options should I use when running the make-distribution.sh script, I tried ./make-distribution.sh --hadoop.version 2.6.0 --with-yarn -with-hive --with-tachyo

Re: How to build Spark against the latest

2014-12-26 Thread Ted Yu
-DskipTests > > -- Original -- > *From: * "guxiaobo1982";; > *Send time:* Thursday, Dec 25, 2014 3:58 PM > *To:* ""; "Ted Yu"; > *Cc:* "user@spark.apache.org"; > *Subject: * Re: How to build Spark against the lat

Re: How to build Spark against the latest

2014-12-27 Thread Sean Owen
gt;> *Send time:* Thursday, Dec 25, 2014 3:58 PM >> *To:* ""; "Ted Yu"; >> *Cc:* "user@spark.apache.org"; >> *Subject: * Re: How to build Spark against the latest >> >> >> What options should I use when running the make-

Re: How to build Spark against the latest

2014-12-27 Thread Ted Yu
gt;> -- Original ---------- >>> *From: * "guxiaobo1982";; >>> *Send time:* Thursday, Dec 25, 2014 3:58 PM >>> *To:* ""; "Ted Yu"; >>> *Cc:* "user@spark.apache.org"; >>> *Subject: * Re:

Re: How to build Spark against the latest

2014-12-27 Thread Sean Owen
>>> wrote: >>> >>>> The following command works >>>> >>>> ./make-distribution.sh --tgz -Pyarn -Dyarn.version=2.6.0 -Phadoop-2.4 >>>> -Dhadoop.version=2.6.0 -Phive -DskipTests >>>> >>>> -- Origina