Re: [VOTE] Release Apache Spark 1.0.0 (RC11)

2014-06-04 Thread Patrick Wendell
Hey There, The best way is to use the v1.0.0 tag: https://github.com/apache/spark/releases/tag/v1.0.0 - Patrick On Wed, Jun 4, 2014 at 12:19 PM, Debasish Das wrote: > Hi Patrick, > > We maintain internal Spark mirror in sync with Spark github master... > > What's the way to get the 1.0.0 stable

Re: [VOTE] Release Apache Spark 1.0.0 (RC11)

2014-06-04 Thread Debasish Das
Hi Patrick, We maintain internal Spark mirror in sync with Spark github master... What's the way to get the 1.0.0 stable release from github to deploy on our production cluster ? Is there a tag for 1.0.0 that I should use to deploy ? Thanks. Deb On Wed, Jun 4, 2014 at 10:49 AM, Patrick Wendel

Re: [VOTE] Release Apache Spark 1.0.0 (RC11)

2014-06-04 Thread Patrick Wendell
Received! On Wed, Jun 4, 2014 at 10:47 AM, Tom Graves wrote: > Testing... Resending as it appears my message didn't go through last week. > > Tom > > > On Wednesday, May 28, 2014 4:12 PM, Tom Graves wrote: > > > > +1. Tested spark on yarn (cluster mode, client mode, pyspark, spark-shell) on > h

Re: [VOTE] Release Apache Spark 1.0.0 (RC11)

2014-06-04 Thread Tom Graves
Testing... Resending as it appears my message didn't go through last week. Tom On Wednesday, May 28, 2014 4:12 PM, Tom Graves wrote: +1. Tested spark on yarn (cluster mode, client mode, pyspark, spark-shell) on hadoop 0.23 and 2.4.  Tom On Wednesday, May 28, 2014 3:07 PM, Sean McNamara

Re: [RESULT][VOTE] Release Apache Spark 1.0.0 (RC11)

2014-05-29 Thread Andy Konwinski
Yes great work all. Special thanks to Patrick (and TD) for excellent leadership! On May 29, 2014 5:39 PM, "Usman Ghani" wrote: > Congrats everyone. Really pumped about this. > > > On Thu, May 29, 2014 at 2:57 PM, Henry Saputra > wrote: > > > Congrats guys! Another milestone for Apache Spark inde

Re: [RESULT][VOTE] Release Apache Spark 1.0.0 (RC11)

2014-05-29 Thread Usman Ghani
Congrats everyone. Really pumped about this. On Thu, May 29, 2014 at 2:57 PM, Henry Saputra wrote: > Congrats guys! Another milestone for Apache Spark indeed =) > > - Henry > > On Thu, May 29, 2014 at 2:08 PM, Matei Zaharia > wrote: > > Yup, congrats all. The most impressive thing is the numbe

Re: [RESULT][VOTE] Release Apache Spark 1.0.0 (RC11)

2014-05-29 Thread Henry Saputra
Congrats guys! Another milestone for Apache Spark indeed =) - Henry On Thu, May 29, 2014 at 2:08 PM, Matei Zaharia wrote: > Yup, congrats all. The most impressive thing is the number of contributors to > this release — with over 100 contributors, it’s becoming hard to even write > the credits.

Re: [RESULT][VOTE] Release Apache Spark 1.0.0 (RC11)

2014-05-29 Thread Matei Zaharia
Yup, congrats all. The most impressive thing is the number of contributors to this release — with over 100 contributors, it’s becoming hard to even write the credits. Look forward to the Apache press release tomorrow. Matei On May 29, 2014, at 1:33 PM, Patrick Wendell wrote: > Congrats everyo

Re: [RESULT][VOTE] Release Apache Spark 1.0.0 (RC11)

2014-05-29 Thread Patrick Wendell
Congrats everyone! This is a huge accomplishment! On Thu, May 29, 2014 at 1:24 PM, Tathagata Das wrote: > Hello everyone, > > The vote on Spark 1.0.0 RC11 passes with13 "+1" votes, one "0" vote and no > "-1" vote. > > Thanks to everyone who tested the RC and voted. Here are the totals: > > +1: (1

Re: [VOTE] Release Apache Spark 1.0.0 (RC11)

2014-05-29 Thread Tathagata Das
Let me put in my +1 as well! This voting is now closed, and it successfully passes with 13 "+1" votes and one "0" vote. Thanks to everyone who tested the RC and voted. Here are the totals: +1: (13 votes) Matei Zaharia* Mark Hamstra* Holden Karau Nick Pentreath* Will Benton Henry Saputra Sean McNa

[RESULT][VOTE] Release Apache Spark 1.0.0 (RC11)

2014-05-29 Thread Tathagata Das
Hello everyone, The vote on Spark 1.0.0 RC11 passes with13 "+1" votes, one "0" vote and no "-1" vote. Thanks to everyone who tested the RC and voted. Here are the totals: +1: (13 votes) Matei Zaharia* Mark Hamstra* Holden Karau Nick Pentreath* Will Benton Henry Saputra Sean McNamara* Xiangrui Me

Re: [VOTE] Release Apache Spark 1.0.0 (RC11)

2014-05-29 Thread Patrick Wendell
+1 I spun up a few EC2 clusters and ran my normal audit checks. Tests passing, sigs, CHANGES and NOTICE look good Thanks TD for helping cut this RC! On Wed, May 28, 2014 at 9:38 PM, Kevin Markey wrote: > +1 > > Built -Pyarn -Phadoop-2.3 -Dhadoop.version=2.3.0 > Ran current version of one of my

Re: [VOTE] Release Apache Spark 1.0.0 (RC11)

2014-05-28 Thread Kevin Markey
+1 Built -Pyarn -Phadoop-2.3 -Dhadoop.version=2.3.0 Ran current version of one of my applications on 1-node pseudocluster (sorry, unable to test on full cluster). yarn-cluster mode Ran regression tests. Thanks Kevin On 05/28/2014 09:55 PM, Krishna Sankar wrote: +1 Pulled & built on MacOS X,

Re: [VOTE] Release Apache Spark 1.0.0 (RC11)

2014-05-28 Thread Krishna Sankar
+1 Pulled & built on MacOS X, EC2 Amazon Linux Ran test programs on OS X, 5 node c3.4xlarge cluster Cheers On Wed, May 28, 2014 at 7:36 PM, Andy Konwinski wrote: > +1 > On May 28, 2014 7:05 PM, "Xiangrui Meng" wrote: > > > +1 > > > > Tested apps with standalone client mode and yarn cluster and

Re: [VOTE] Release Apache Spark 1.0.0 (RC11)

2014-05-28 Thread Andy Konwinski
+1 On May 28, 2014 7:05 PM, "Xiangrui Meng" wrote: > +1 > > Tested apps with standalone client mode and yarn cluster and client modes. > > Xiangrui > > On Wed, May 28, 2014 at 1:07 PM, Sean McNamara > wrote: > > Pulled down, compiled, and tested examples on OS X and ubuntu. > > Deployed app we a

Re: [VOTE] Release Apache Spark 1.0.0 (RC11)

2014-05-28 Thread Xiangrui Meng
+1 Tested apps with standalone client mode and yarn cluster and client modes. Xiangrui On Wed, May 28, 2014 at 1:07 PM, Sean McNamara wrote: > Pulled down, compiled, and tested examples on OS X and ubuntu. > Deployed app we are building on spark and poured data through it. > > +1 > > Sean > > >

Re: [VOTE] Release Apache Spark 1.0.0 (RC11)

2014-05-28 Thread Tom Graves
+1. Tested spark on yarn (cluster mode, client mode, pyspark, spark-shell) on hadoop 0.23 and 2.4.  Tom On Wednesday, May 28, 2014 3:07 PM, Sean McNamara wrote: Pulled down, compiled, and tested examples on OS X and ubuntu. Deployed app we are building on spark and poured data through it.

Re: [VOTE] Release Apache Spark 1.0.0 (RC11)

2014-05-28 Thread Sean McNamara
Pulled down, compiled, and tested examples on OS X and ubuntu. Deployed app we are building on spark and poured data through it. +1 Sean On May 26, 2014, at 8:39 AM, Tathagata Das wrote: > Please vote on releasing the following candidate as Apache Spark version > 1.0.0! > > This has a few i

Re: [VOTE] Release Apache Spark 1.0.0 (RC11)

2014-05-28 Thread Henry Saputra
NOTICE and LICENSE files look good Signatures look good. Hashes look good No external executables in the source distributions Source compiled with sbt Run local and standalone examples look good. +1 - Henry On Mon, May 26, 2014 at 7:38 AM, Tathagata Das wrote: > Please vote on releasing the fo

Re: [VOTE] Release Apache Spark 1.0.0 (RC11)

2014-05-28 Thread Will Benton
athagata Das" > To: dev@spark.apache.org > Sent: Monday, May 26, 2014 9:38:10 AM > Subject: [VOTE] Release Apache Spark 1.0.0 (RC11) > > Please vote on releasing the following candidate as Apache Spark version > 1.0.0! > > This has a few important bug fixes on top

Re: [VOTE] Release Apache Spark 1.0.0 (RC11)

2014-05-28 Thread Nick Pentreath
+1 Built and tested locally on Mac OS X Built and tested on AWS Ubuntu, with and without Hive support Ran production jobs including MLlib and SparkSQL/HiveContext successfully On Wed, May 28, 2014 at 1:09 AM, Holden Karau wrote: > +1 (I did some very basic testing with PySpark & Pandas on rc11)

Re: [VOTE] Release Apache Spark 1.0.0 (RC11)

2014-05-27 Thread Holden Karau
+1 (I did some very basic testing with PySpark & Pandas on rc11) On Tue, May 27, 2014 at 3:53 PM, Mark Hamstra wrote: > +1 > > > On Tue, May 27, 2014 at 9:26 AM, Ankur Dave wrote: > > > 0 > > > > OK, I withdraw my downvote. > > > > Ankur > > > -- Cell : 425-233-8

Re: [VOTE] Release Apache Spark 1.0.0 (RC11)

2014-05-27 Thread Mark Hamstra
+1 On Tue, May 27, 2014 at 9:26 AM, Ankur Dave wrote: > 0 > > OK, I withdraw my downvote. > > Ankur >

Re: [VOTE] Release Apache Spark 1.0.0 (RC11)

2014-05-27 Thread Ankur Dave
0 OK, I withdraw my downvote. Ankur

Re: [VOTE] Release Apache Spark 1.0.0 (RC11)

2014-05-26 Thread Sandy Ryza
+1 On Mon, May 26, 2014 at 7:38 AM, Tathagata Das wrote: > Please vote on releasing the following candidate as Apache Spark version > 1.0.0! > > This has a few important bug fixes on top of rc10: > SPARK-1900 and SPARK-1918: https://github.com/apache/spark/pull/853 > SPARK-1870

Re: [VOTE] Release Apache Spark 1.0.0 (RC11)

2014-05-26 Thread Matei Zaharia
I think the question for me would be does this only happen when you call partitionBy, or always? And how common do you expect calls to partitionBy to be? If we can wait for 1.0.1 then I’d wait on this one. Matei On May 26, 2014, at 10:47 PM, Patrick Wendell wrote: > Hey Ankur, > > That does

Re: [VOTE] Release Apache Spark 1.0.0 (RC11)

2014-05-26 Thread Patrick Wendell
Hey Ankur, That does seem like a good fix, but right now we are only blocking the release on major regressions that affect all components. So I don't think this is sufficient to block it from going forward and cutting a new candidate. This is because we are in the very late stage of the release.

Re: [VOTE] Release Apache Spark 1.0.0 (RC11)

2014-05-26 Thread ankurdave
-1 I just fixed SPARK-1931 , which was a critical bug in Graph#partitionBy. Since this is an important part of the GraphX API, I think Spark 1.0.0 should include the fix: https://github.com/apache/spark/pull/885. -- View this message in conte

Re: [VOTE] Release Apache Spark 1.0.0 (RC11)

2014-05-26 Thread Matei Zaharia
+1 Tested on Mac OS X and Windows. Matei On May 26, 2014, at 7:38 AM, Tathagata Das wrote: > Please vote on releasing the following candidate as Apache Spark version > 1.0.0! > > This has a few important bug fixes on top of rc10: > SPARK-1900 and SPARK-1918: https://github.com/apache/spark/

[VOTE] Release Apache Spark 1.0.0 (RC11)

2014-05-26 Thread Tathagata Das
Please vote on releasing the following candidate as Apache Spark version 1.0.0! This has a few important bug fixes on top of rc10: SPARK-1900 and SPARK-1918: https://github.com/apache/spark/pull/853 SPARK-1870: https://github.com/apache/spark/pull/848 SPARK-1897: https://github.com/apache/spark/pu