Re: [VOTE] Release Apache Spark 1.5.1 (RC1)

2015-09-28 Thread james
+1 1) Build binary instruction: ./make-distribution.sh --tgz --skip-java-test -Pyarn -Phadoop-2.6 -Dhadoop.version=2.6.0 -Phive -Phive-thriftserver -DskipTests 2) Run Spark SQL with YARN client mode This 1.5.1 RC1 package have better test results than previous 1.5.0 except for

Re: [VOTE] Release Apache Spark 1.5.1 (RC1)

2015-09-28 Thread Jerry Lam
Hi Spark Developers, The Spark 1.5.1 documentation is already publicly accessible ( https://spark.apache.org/docs/latest/index.html) but the release is not. Is it intentional? Best Regards, Jerry On Mon, Sep 28, 2015 at 9:21 AM, james wrote: > +1 > > 1) Build binary

Re: [VOTE] Release Apache Spark 1.5.1 (RC1)

2015-09-28 Thread Sean Owen
It's on Maven Central already. These various updates have to happen in some order, and you'll probably see an inconsistent state for a day or so while things get slowly updated. Consider it released when there's an announcement, I suppose. On Mon, Sep 28, 2015 at 11:07 PM, Jerry Lam

Re: [VOTE] Release Apache Spark 1.5.1 (RC1)

2015-09-27 Thread Yin Huai
+1 Tested 1.5.1 SQL blockers. On Sat, Sep 26, 2015 at 1:36 PM, robineast wrote: > +1 > > > build/mvn clean package -DskipTests -Pyarn -Phadoop-2.6 > OK > Basic graph tests > Load graph using edgeListFile...SUCCESS > Run PageRank...SUCCESS > Minimum Spanning Tree

Re: [VOTE] Release Apache Spark 1.5.1 (RC1)

2015-09-27 Thread Suresh Thalamati
+1 (non-binding.) Tested jdbc data source, and some of the tpc-ds queries.

Re: [VOTE] Release Apache Spark 1.5.1 (RC1)

2015-09-27 Thread Reynold Xin
Thanks everybody for voting. I'm going to close the vote now. The vote passes with 17 +1 votes and 1 -1 vote. I will work on packaging this asap. +1: Reynold Xin* Sean Owen Hossein Falaki Xiangrui Meng* Krishna Sankar Joseph Bradley Sean McNamara* Luciano Resende Doug Balog Eugene Zhulenev

Re: [VOTE] Release Apache Spark 1.5.1 (RC1)

2015-09-26 Thread robineast
+1 build/mvn clean package -DskipTests -Pyarn -Phadoop-2.6 OK Basic graph tests Load graph using edgeListFile...SUCCESS Run PageRank...SUCCESS Minimum Spanning Tree Algorithm Run basic Minimum Spanning Tree algorithm...SUCCESS Run Minimum Spanning Tree taxonomy creation...SUCCESS --

Re: [VOTE] Release Apache Spark 1.5.1 (RC1)

2015-09-25 Thread vaquar khan
+1 (non-binding) Regards, Vaquar khan On 25 Sep 2015 18:28, "Eugene Zhulenev" wrote: > +1 > > Running latest build from 1.5 branch, SO much more stable than 1.5.0 > release. > > On Fri, Sep 25, 2015 at 8:55 AM, Doug Balog > wrote: > >> +1

Re: [VOTE] Release Apache Spark 1.5.1 (RC1)

2015-09-25 Thread Tom Graves
+1. Tested Spark on Yarn on Hadoop 2.6 and 2.7. Tom On Thursday, September 24, 2015 2:34 AM, Reynold Xin wrote: Please vote on releasing the following candidate as Apache Spark version 1.5.1. The vote is open until Sun, Sep 27, 2015 at 10:00 UTC and passes if

Re: [VOTE] Release Apache Spark 1.5.1 (RC1)

2015-09-25 Thread Marcelo Vanzin
Ignoring my previous question, +1. Tested several different jobs on YARN and standalone with dynamic allocation on. On Fri, Sep 25, 2015 at 11:32 AM, Marcelo Vanzin wrote: > Mostly for my education (I hope), but I was testing > "spark-1.5.1-bin-without-hadoop.tgz" assuming

Re: [VOTE] Release Apache Spark 1.5.1 (RC1)

2015-09-25 Thread Marcelo Vanzin
Mostly for my education (I hope), but I was testing "spark-1.5.1-bin-without-hadoop.tgz" assuming it would contain everything (including HiveContext support), just without the Hadoop common jars in the assembly. But HiveContext is not there. Is this expected? On Thu, Sep 24, 2015 at 12:27 AM,

[VOTE] Release Apache Spark 1.5.1 (RC1)

2015-09-24 Thread Reynold Xin
Please vote on releasing the following candidate as Apache Spark version 1.5.1. The vote is open until Sun, Sep 27, 2015 at 10:00 UTC and passes if a majority of at least 3 +1 PMC votes are cast. [ ] +1 Release this package as Apache Spark 1.5.1 [ ] -1 Do not release this package because ...

Re: [VOTE] Release Apache Spark 1.5.1 (RC1)

2015-09-24 Thread Sean Owen
+1 non-binding. This is the first time I've seen all tests pass the first time with Java 8 + Ubuntu + "-Pyarn -Phadoop-2.6 -Phive -Phive-thriftserver". Clearly the test improvement efforts are paying off. As usual the license, sigs, etc are OK. On Thu, Sep 24, 2015 at 8:27 AM, Reynold Xin

Re: [VOTE] Release Apache Spark 1.5.1 (RC1)

2015-09-24 Thread Sean Owen
On Thu, Sep 24, 2015 at 6:45 PM, Richard Hillegas wrote: > Under your guidance, I would be happy to help compile a NOTICE file which > follows the pattern used by Derby and the JDK. This effort might proceed in > parallel with vetting 1.5.1 and could be targeted at a later

Re: [VOTE] Release Apache Spark 1.5.1 (RC1)

2015-09-24 Thread Richard Hillegas
ll <pwend...@gmail.com> > To: Sean Owen <so...@cloudera.com> > Cc: Richard Hillegas/San Francisco/IBM@IBMUS, "dev@spark.apache.org" > <dev@spark.apache.org> > Date: 09/24/2015 10:24 AM > Subject: Re: [VOTE] Release Apache Spark 1.5.1 (RC1) > > Hey Richard

Re: [VOTE] Release Apache Spark 1.5.1 (RC1)

2015-09-24 Thread Patrick Wendell
the ASF >> were protected by our bundling the licenses inside our source distros. >> >> After looking for those three licenses, I stopped reading the NOTICE file. >> Maybe I'm confused about how to read the NOTICE file. Where should users >> expect to find the 3rd party li

Re: [VOTE] Release Apache Spark 1.5.1 (RC1)

2015-09-24 Thread Reynold Xin
I'm going to +1 this myself. Tested on my laptop. On Thu, Sep 24, 2015 at 10:56 AM, Reynold Xin wrote: > I forked a new thread for this. Please discuss NOTICE file related things > there so it doesn't hijack this thread. > > > On Thu, Sep 24, 2015 at 10:51 AM, Sean Owen

Re: [VOTE] Release Apache Spark 1.5.1 (RC1)

2015-09-24 Thread Xiangrui Meng
+1. Checked user guide and API doc, and ran some MLlib and SparkR examples. -Xiangrui On Thu, Sep 24, 2015 at 2:54 PM, Reynold Xin wrote: > I'm going to +1 this myself. Tested on my laptop. > > > > On Thu, Sep 24, 2015 at 10:56 AM, Reynold Xin wrote: >>

Re: [VOTE] Release Apache Spark 1.5.1 (RC1)

2015-09-24 Thread Hossein
+1 tested SparkR on Mac and Linux. --Hossein On Thu, Sep 24, 2015 at 3:10 PM, Xiangrui Meng wrote: > +1. Checked user guide and API doc, and ran some MLlib and SparkR > examples. -Xiangrui > > On Thu, Sep 24, 2015 at 2:54 PM, Reynold Xin wrote: > > I'm

Re: [VOTE] Release Apache Spark 1.5.1 (RC1)

2015-09-24 Thread Richard Hillegas
tabricks.com> > To: "dev@spark.apache.org" <dev@spark.apache.org> > Date: 09/24/2015 12:28 AM > Subject: [VOTE] Release Apache Spark 1.5.1 (RC1) > > Please vote on releasing the following candidate as Apache Spark > version 1.5.1. The vote is open until Sun, Sep

Re: [VOTE] Release Apache Spark 1.5.1 (RC1)

2015-09-24 Thread Sean Owen
y licenses? > > Thanks, > -Rick > > Reynold Xin <r...@databricks.com> wrote on 09/24/2015 12:27:25 AM: > >> From: Reynold Xin <r...@databricks.com> >> To: "dev@spark.apache.org" <dev@spark.apache.org> >> Date: 09/24/2015 12:28 AM >>

Re: [VOTE] Release Apache Spark 1.5.1 (RC1)

2015-09-24 Thread Luciano Resende
+1 (non-binding) Compiled in Mac OS with : build/mvn -Pyarn,sparkr,hive,hive-thriftserver -Phadoop-2.6 -Dhadoop.version=2.6.0 -DskipTests clean package Checked around R Looked into legal files All looks good. On Thu, Sep 24, 2015 at 12:27 AM, Reynold Xin wrote: > Please

Re: [VOTE] Release Apache Spark 1.5.1 (RC1)

2015-09-24 Thread Joseph Bradley
+1 Tested MLlib on Mac OS X On Thu, Sep 24, 2015 at 6:14 PM, Reynold Xin wrote: > Krishna, > > Thanks for testing every release! > > > On Thu, Sep 24, 2015 at 6:08 PM, Krishna Sankar > wrote: > >> +1 (non-binding, of course) >> >> 1. Compiled OSX

Re: [VOTE] Release Apache Spark 1.5.1 (RC1)

2015-09-24 Thread Reynold Xin
Krishna, Thanks for testing every release! On Thu, Sep 24, 2015 at 6:08 PM, Krishna Sankar wrote: > +1 (non-binding, of course) > > 1. Compiled OSX 10.10 (Yosemite) OK Total time: 26:48 min > mvn clean package -Pyarn -Phadoop-2.6 -DskipTests > 2. Tested pyspark,

Re: [VOTE] Release Apache Spark 1.5.1 (RC1)

2015-09-24 Thread Sean McNamara
Ran tests + built/ran an internal spark streaming app /w 1.5.1 artifacts. +1 Cheers, Sean On Sep 24, 2015, at 1:28 AM, Reynold Xin > wrote: Please vote on releasing the following candidate as Apache Spark version 1.5.1. The vote is open until