Re: [VOTE] Release Apache Spark 2.0.0 (RC4)

2016-07-19 Thread Holden Karau
Ah in that case: 0 On Tue, Jul 19, 2016 at 3:26 PM, Jonathan Kelly wrote: > The docs link from Reynold's initial email is apparently no longer valid. > He posted an updated link a little later in this same thread. > > >

Re: [VOTE] Release Apache Spark 2.0.0 (RC4)

2016-07-19 Thread Jonathan Kelly
The docs link from Reynold's initial email is apparently no longer valid. He posted an updated link a little later in this same thread. http://people.apache.org/~pwendell/spark-releases/spark-2.0.0-rc4-docs-updated/ On Tue, Jul 19, 2016 at 3:19 PM Holden Karau wrote: > -1

Re: [VOTE] Release Apache Spark 2.0.0 (RC4)

2016-07-19 Thread Holden Karau
-1 : The docs don't seem to be fully built (e.g. http://people.apache.org/~pwendell/spark-releases/spark-2.0.0-rc4-docs/streaming-programming-guide.html is a zero byte file currently) - although if this is a transient apache issue no worries. On Thu, Jul 14, 2016 at 11:59 AM, Reynold Xin

Re: [VOTE] Release Apache Spark 2.0.0 (RC4)

2016-07-19 Thread Marcelo Vanzin
+0 Our internal test suites seem mostly happy, except for SPARK-16632. Since there's a somewhat easy workaround, I don't think it's a blocker for 2.0.0. On Thu, Jul 14, 2016 at 11:59 AM, Reynold Xin wrote: > Please vote on releasing the following candidate as Apache Spark

Re: [VOTE] Release Apache Spark 2.0.0 (RC4)

2016-07-19 Thread nseggert
Can I point out this guy? https://issues.apache.org/jira/browse/SPARK-15705 I managed to find a workaround, but this is still IMO a pretty significant bug. -- View this message in context:

Re: [VOTE] Release Apache Spark 2.0.0 (RC4)

2016-07-19 Thread Sean Owen
I think unfortunately at least this one is gonna block: https://issues.apache.org/jira/browse/SPARK-16620 Good news is that just about anything else that's at all a blocker has been resolved and there are only about 6 issues of any kind at all targeted for 2.0. It seems very close. On Thu, Jul

RE: [VOTE] Release Apache Spark 2.0.0 (RC4)

2016-07-15 Thread james
-1 This bug SPARK-16515 in Spark 2.0 breaks our cases which can run on 1.6. -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/VOTE-Release-Apache-Spark-2-0-0-RC4-tp18317p18341.html Sent from the Apache Spark Developers List mailing list archive at

Re: [VOTE] Release Apache Spark 2.0.0 (RC4)

2016-07-15 Thread Krishna Sankar
+1 (non-binding, of course) 1. Compiled OS X 10.11.5 (El Capitan) OK Total time: 26:27 min mvn clean package -Pyarn -Phadoop-2.7 -DskipTests 2. Tested pyspark, mllib (iPython 4.0) 2.0 Spark version is 2.0.0 2.1. statistics (min,max,mean,Pearson,Spearman) OK 2.2. Linear/Ridge/Lasso Regression

Re: [VOTE] Release Apache Spark 2.0.0 (RC4)

2016-07-15 Thread Mark Hamstra
Yes. https://github.com/apache/spark/pull/11796 On Fri, Jul 15, 2016 at 2:50 PM, Krishna Sankar wrote: > Can't find the "spark-assembly-2.0.0-hadoop2.7.0.jar" after compilation. > Usually it is in the assembly/target/scala-2.11 > Has the packaging changed for 2.0.0 ? >

Re: [VOTE] Release Apache Spark 2.0.0 (RC4)

2016-07-15 Thread Krishna Sankar
Can't find the "spark-assembly-2.0.0-hadoop2.7.0.jar" after compilation. Usually it is in the assembly/target/scala-2.11 Has the packaging changed for 2.0.0 ? Cheers On Thu, Jul 14, 2016 at 11:59 AM, Reynold Xin wrote: > Please vote on releasing the following candidate as

Re: [VOTE] Release Apache Spark 2.0.0 (RC4)

2016-07-15 Thread Reynold Xin
I just retargeted SPARK-16011 to 2.1. On Fri, Jul 15, 2016 at 10:43 AM, Shivaram Venkataraman < shiva...@eecs.berkeley.edu> wrote: > Hashes, sigs match. I built and ran tests with Hadoop 2.3 ("-Pyarn > -Phadoop-2.3 -Phive -Pkinesis-asl -Phive-thriftserver"). I couldn't > get the following tests

Re: [VOTE] Release Apache Spark 2.0.0 (RC4)

2016-07-15 Thread Shivaram Venkataraman
Hashes, sigs match. I built and ran tests with Hadoop 2.3 ("-Pyarn -Phadoop-2.3 -Phive -Pkinesis-asl -Phive-thriftserver"). I couldn't get the following tests to pass but I think it might be something specific to my setup as Jenkins on branch-2.0 seems quite stable. [error] Failed tests: [error]

Re: [VOTE] Release Apache Spark 2.0.0 (RC4)

2016-07-15 Thread Sean Owen
Signatures and hashes are OK. I built and ran tests successfully on Ubuntu 16 + Java 8 with "-Phive -Phadoop-2.7 -Pyarn". Although I encountered a few tests failures, none were repeatable. Regarding other issues brought up so far: SPARK-16522 Does not seem quite enough to be a blocker if it's

RE: [VOTE] Release Apache Spark 2.0.0 (RC4)

2016-07-14 Thread Cheng, Hao
] Sent: Friday, July 15, 2016 7:26 AM To: dev@spark.apache.org Subject: Re: [VOTE] Release Apache Spark 2.0.0 (RC4) Updated documentation at http://people.apache.org/~pwendell/spark-releases/spark-2.0.0-rc4-docs-updated/ On Thu, Jul 14, 2016 at 11:59 AM, Reynold Xin <r...@databricks.

Re: [VOTE] Release Apache Spark 2.0.0 (RC4)

2016-07-14 Thread Nicholas Chammas
-1 There is a typo here : There is specially handling for not-a-number (NaN)… Just kidding, of course (about the vote). :) I vote +1 (for realz). - Successfully

Re: [VOTE] Release Apache Spark 2.0.0 (RC4)

2016-07-14 Thread Reynold Xin
Updated documentation at http://people.apache.org/~pwendell/spark-releases/spark-2.0.0-rc4-docs-updated/ On Thu, Jul 14, 2016 at 11:59 AM, Reynold Xin wrote: > Please vote on releasing the following candidate as Apache Spark version > 2.0.0. The vote is open until Sunday,

Re: [VOTE] Release Apache Spark 2.0.0 (RC4)

2016-07-14 Thread Reynold Xin
So the mesos issue (SPARK-16522) Michael is investigating. Unless it is actually failing Mesos, I wouldn't call it a blocker. The file path thing Alex brought up (SPARK-15899) only impacts test cases on Windows. I think it's important to fix, but definitely not a blocker either. For the doc

RE: [VOTE] Release Apache Spark 2.0.0 (RC4)

2016-07-14 Thread Ulanov, Alexander
-1, due to unresolved https://issues.apache.org/jira/browse/SPARK-15899 From: Reynold Xin [mailto:r...@databricks.com] Sent: Thursday, July 14, 2016 12:00 PM To: dev@spark.apache.org Subject: [VOTE] Release Apache Spark 2.0.0 (RC4) Please vote on releasing the following candidate as Apache Spark

Re: [VOTE] Release Apache Spark 2.0.0 (RC4)

2016-07-14 Thread Shivaram Venkataraman
I think the docs build was broken because of https://issues.apache.org/jira/browse/SPARK-16553 - A fix has been merged and we are testing it now Shivaram On Thu, Jul 14, 2016 at 1:56 PM, Matthias Niehoff wrote: > Some of the programming guides in the docs only

Re: [VOTE] Release Apache Spark 2.0.0 (RC4)

2016-07-14 Thread Matthias Niehoff
Some of the programming guides in the docs only give me blank page (Spark programming guide works. Streaming, DataFrame/SQL and Structured Streaming do not). 2016-07-14 22:21 GMT+02:00 Nicholas Chammas : > Oh nevermind, just noticed your note. Apologies. > > On Thu,

Re: [VOTE] Release Apache Spark 2.0.0 (RC4)

2016-07-14 Thread Nicholas Chammas
Oh nevermind, just noticed your note. Apologies. On Thu, Jul 14, 2016 at 4:20 PM Nicholas Chammas wrote: > Just curious: Did we have an RC3? I don't remember seeing one. > > > On Thu, Jul 14, 2016 at 3:00 PM Reynold Xin wrote: > >> Please vote

Re: [VOTE] Release Apache Spark 2.0.0 (RC4)

2016-07-14 Thread Nicholas Chammas
Just curious: Did we have an RC3? I don't remember seeing one. On Thu, Jul 14, 2016 at 3:00 PM Reynold Xin wrote: > Please vote on releasing the following candidate as Apache Spark version > 2.0.0. The vote is open until Sunday, July 17, 2016 at 12:00 PDT and passes > if a

Re: [VOTE] Release Apache Spark 2.0.0 (RC4)

2016-07-14 Thread Michael Gummelt
-1 Pending resolution of https://issues.apache.org/jira/browse/SPARK-16522 (diagnosing now) On Thu, Jul 14, 2016 at 11:59 AM, Reynold Xin wrote: > Please vote on releasing the following candidate as Apache Spark version > 2.0.0. The vote is open until Sunday, July 17, 2016