Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-28 Thread Michael Gummelt
+1 I know this is cancelled, but FYI, RC3 passes mesos/spark integration tests On Wed, Sep 28, 2016 at 2:52 AM, Sean Owen wrote: > (Process-wise there's no problem with that. The vote is open for at > least 3 days and ends when the RM says it ends. So it's valid anyway > as

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-28 Thread Sean Owen
(Process-wise there's no problem with that. The vote is open for at least 3 days and ends when the RM says it ends. So it's valid anyway as the vote is still open.) On Tue, Sep 27, 2016 at 8:37 PM, Reynold Xin wrote: > So technically the vote has passed, but IMHO it does not

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-27 Thread Reynold Xin
So technically the vote has passed, but IMHO it does not make sense to release this and then immediately release 2.0.2. I will work on a new RC once SPARK-17666 and SPARK-17673 are fixed. Please shout if you disagree. On Tue, Sep 27, 2016 at 2:05 PM, Mark Hamstra

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-27 Thread Mark Hamstra
If we're going to cut another RC, then it would be good to get this in as well (assuming that it is merged shortly): https://github.com/apache/spark/pull/15213 It's not a regression, and it shouldn't happen too often, but when failed stages don't get resubmitted it is a fairly significant issue.

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-27 Thread Reynold Xin
Actually I'm going to have to -1 the release myself. Sorry for crashing the party, but I saw two super critical issues discovered in the last 2 days: https://issues.apache.org/jira/browse/SPARK-17666 -- this would eventually hang Spark when running against S3 (and many other storage systems)

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-27 Thread Suresh Thalamati
e.org > Date: 27-09-16 11:27 AM > Subject:Re: [VOTE] Release Apache Spark 2.0.1 (RC3) > > > > +1 (non binding) > > Regards > JB > > On 09/27/2016 07:51 AM, Hyukjin Kwon wrote: > > +1 (non-binding) > > > > 2016-09-27 13:22 GMT+09:

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-26 Thread Jean-Baptiste Onofré
+1 (non binding) Regards JB On 09/27/2016 07:51 AM, Hyukjin Kwon wrote: +1 (non-binding) 2016-09-27 13:22 GMT+09:00 Denny Lee >: +1 on testing with Python2. On Mon, Sep 26, 2016 at 3:13 PM Krishna Sankar

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-26 Thread Holden Karau
+1 (non-binding) PySpark Core, ML, MLlib, SQL tests pass w/Python3 on Ubuntu 14.04 - some intermittent weird failures when running the streaming suite but seem to be flaky test issue & not a real issue, which is makes sense given how some of the Python streaming tests are structured. On Mon, Sep

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-26 Thread Hyukjin Kwon
+1 (non-binding) 2016-09-27 13:22 GMT+09:00 Denny Lee : > +1 on testing with Python2. > > > On Mon, Sep 26, 2016 at 3:13 PM Krishna Sankar > wrote: > >> I do run both Python and Scala. But via iPython/Python2 with my own test >> code. Not running the

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-26 Thread Denny Lee
+1 on testing with Python2. On Mon, Sep 26, 2016 at 3:13 PM Krishna Sankar wrote: > I do run both Python and Scala. But via iPython/Python2 with my own test > code. Not running the tests from the distribution. > Cheers > > > On Mon, Sep 26, 2016 at 11:59 AM, Holden Karau

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-26 Thread Yanbo Liang
+1 On Mon, Sep 26, 2016 at 4:53 PM, akchin wrote: > +1 (non-bind) > -Pyarn -Phadoop-2.7 -Phive -Phive-thriftserver -Psparkr > CentOS 7.2 / openjdk version "1.8.0_101" > > > > > - > IBM Spark Technology Center > -- > View this message in context: http://apache-spark- >

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-26 Thread akchin
+1 (non-bind) -Pyarn -Phadoop-2.7 -Phive -Phive-thriftserver -Psparkr CentOS 7.2 / openjdk version "1.8.0_101" - IBM Spark Technology Center -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/VOTE-Release-Apache-Spark-2-0-1-RC3-tp19044p19093.html

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-26 Thread Krishna Sankar
I do run both Python and Scala. But via iPython/Python2 with my own test code. Not running the tests from the distribution. Cheers On Mon, Sep 26, 2016 at 11:59 AM, Holden Karau wrote: > I'm seeing some test failures with Python 3 that could definitely be > environmental

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-26 Thread Holden Karau
I'm seeing some test failures with Python 3 that could definitely be environmental (going to rebuild my virtual env and double check), I'm just wondering if other people are also running the Python tests on this release or if everyone is focused on the Scala tests? On Mon, Sep 26, 2016 at 11:48

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-26 Thread Maciej Bryński
+1 At last :) 2016-09-26 19:56 GMT+02:00 Sameer Agarwal : > +1 (non-binding) > > On Mon, Sep 26, 2016 at 9:54 AM, Davies Liu wrote: > >> +1 (non-binding) >> >> On Mon, Sep 26, 2016 at 9:36 AM, Joseph Bradley >> wrote: >> > +1

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-26 Thread Sameer Agarwal
+1 (non-binding) On Mon, Sep 26, 2016 at 9:54 AM, Davies Liu wrote: > +1 (non-binding) > > On Mon, Sep 26, 2016 at 9:36 AM, Joseph Bradley > wrote: > > +1 > > > > On Mon, Sep 26, 2016 at 7:47 AM, Denny Lee > wrote: > >> > >>

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-26 Thread Davies Liu
+1 (non-binding) On Mon, Sep 26, 2016 at 9:36 AM, Joseph Bradley wrote: > +1 > > On Mon, Sep 26, 2016 at 7:47 AM, Denny Lee wrote: >> >> +1 (non-binding) >> On Sun, Sep 25, 2016 at 23:20 Jeff Zhang wrote: >>> >>> +1 >>> >>> On

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-26 Thread Joseph Bradley
+1 On Mon, Sep 26, 2016 at 7:47 AM, Denny Lee wrote: > +1 (non-binding) > On Sun, Sep 25, 2016 at 23:20 Jeff Zhang wrote: > >> +1 >> >> On Mon, Sep 26, 2016 at 2:03 PM, Shixiong(Ryan) Zhu < >> shixi...@databricks.com> wrote: >> >>> ＋1 >>> >>> On Sun,

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-26 Thread Denny Lee
+1 (non-binding) On Sun, Sep 25, 2016 at 23:20 Jeff Zhang wrote: > +1 > > On Mon, Sep 26, 2016 at 2:03 PM, Shixiong(Ryan) Zhu < > shixi...@databricks.com> wrote: > >> ＋1 >> >> On Sun, Sep 25, 2016 at 10:43 PM, Pete Lee wrote: >> >>> +1 >>> >>> >>> On

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-26 Thread Jeff Zhang
+1 On Mon, Sep 26, 2016 at 2:03 PM, Shixiong(Ryan) Zhu wrote: > ＋1 > > On Sun, Sep 25, 2016 at 10:43 PM, Pete Lee wrote: > >> +1 >> >> >> On Sun, Sep 25, 2016 at 3:26 PM, Herman van Hövell tot Westerflier < >> hvanhov...@databricks.com> wrote:

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-26 Thread Shixiong(Ryan) Zhu
＋1 On Sun, Sep 25, 2016 at 10:43 PM, Pete Lee wrote: > +1 > > > On Sun, Sep 25, 2016 at 3:26 PM, Herman van Hövell tot Westerflier < > hvanhov...@databricks.com> wrote: > >> +1 (non-binding) >> >> On Sun, Sep 25, 2016 at 2:05 PM, Ricardo Almeida < >>

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-25 Thread Pete Lee
+1 On Sun, Sep 25, 2016 at 3:26 PM, Herman van Hövell tot Westerflier < hvanhov...@databricks.com> wrote: > +1 (non-binding) > > On Sun, Sep 25, 2016 at 2:05 PM, Ricardo Almeida < > ricardo.alme...@actnowib.com> wrote: > >> +1 (non-binding) >> >> Built and tested on >> - Ubuntu 16.04 / OpenJDK

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-25 Thread Luciano Resende
+1 (non-binding) On Sat, Sep 24, 2016 at 3:08 PM, Reynold Xin wrote: > Please vote on releasing the following candidate as Apache Spark version > 2.0.1. The vote is open until Tue, Sep 27, 2016 at 15:30 PDT and passes if > a majority of at least 3+1 PMC votes are cast. > >

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-25 Thread vaquar khan
+1 (non-binding) Regards, Vaquar khan On 25 Sep 2016 20:41, "Kousuke Saruta" wrote: > +1 (non-binding) > > On 2016年09月26日 07:26, Herman van Hövell tot Westerflier wrote: > > +1 (non-binding) > > On Sun, Sep 25, 2016 at 2:05 PM, Ricardo Almeida < >

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-25 Thread Kousuke Saruta
+1 (non-binding) On 2016年09月26日 07:26, Herman van Hövell tot Westerflier wrote: +1 (non-binding) On Sun, Sep 25, 2016 at 2:05 PM, Ricardo Almeida > wrote: +1 (non-binding) Built and tested on - Ubuntu 16.04 /

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-25 Thread Herman van Hövell tot Westerflier
+1 (non-binding) On Sun, Sep 25, 2016 at 2:05 PM, Ricardo Almeida < ricardo.alme...@actnowib.com> wrote: > +1 (non-binding) > > Built and tested on > - Ubuntu 16.04 / OpenJDK 1.8.0_91 > - CentOS / Oracle Java 1.7.0_55 > (-Phadoop-2.7 -Dhadoop.version=2.7.3 -Phive -Phive-thriftserver -Pyarn) > >

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-25 Thread Ricardo Almeida
+1 (non-binding) Built and tested on - Ubuntu 16.04 / OpenJDK 1.8.0_91 - CentOS / Oracle Java 1.7.0_55 (-Phadoop-2.7 -Dhadoop.version=2.7.3 -Phive -Phive-thriftserver -Pyarn) On 25 September 2016 at 22:35, Matei Zaharia wrote: > +1 > > Matei > > On Sep 25, 2016, at

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-25 Thread Matei Zaharia
+1 Matei > On Sep 25, 2016, at 1:25 PM, Josh Rosen wrote: > > +1 > > On Sun, Sep 25, 2016 at 1:16 PM Yin Huai > wrote: > +1 > > On Sun, Sep 25, 2016 at 11:40 AM, Dongjoon Hyun

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-25 Thread Josh Rosen
+1 On Sun, Sep 25, 2016 at 1:16 PM Yin Huai wrote: > +1 > > On Sun, Sep 25, 2016 at 11:40 AM, Dongjoon Hyun > wrote: > >> +1 (non binding) >> >> RC3 is compiled and tested on the following two systems, too. All tests >> passed. >> >> * CentOS 7.2 /

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-25 Thread Yin Huai
+1 On Sun, Sep 25, 2016 at 11:40 AM, Dongjoon Hyun wrote: > +1 (non binding) > > RC3 is compiled and tested on the following two systems, too. All tests > passed. > > * CentOS 7.2 / Oracle JDK 1.8.0_77 / R 3.3.1 >with -Pyarn -Phadoop-2.7 -Pkinesis-asl -Phive

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-25 Thread Dongjoon Hyun
+1 (non binding) RC3 is compiled and tested on the following two systems, too. All tests passed. * CentOS 7.2 / Oracle JDK 1.8.0_77 / R 3.3.1 with -Pyarn -Phadoop-2.7 -Pkinesis-asl -Phive -Phive-thriftserver -Dsparkr * CentOS 7.2 / Open JDK 1.8.0_102 with -Pyarn -Phadoop-2.7 -Pkinesis-asl

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-25 Thread Jacek Laskowski
+1 Ship it! Pozdrawiam, Jacek Laskowski https://medium.com/@jaceklaskowski/ Mastering Apache Spark 2.0 http://bit.ly/mastering-apache-spark Follow me at https://twitter.com/jaceklaskowski On Sun, Sep 25, 2016 at 12:08 AM, Reynold Xin wrote: > Please vote on releasing

Re: [VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-25 Thread Sean Owen
+1 binding. Same as for RC2 -- it all checks out, from license to sigs to compile and test. We have no issues of any kind targeted for 2.0.1. I do have one test failure that I have seen with some regularity in Ubuntu but not on any Jenkins machines. One of the YARN tests will just kill all my ssh

[VOTE] Release Apache Spark 2.0.1 (RC3)

2016-09-24 Thread Reynold Xin
Please vote on releasing the following candidate as Apache Spark version 2.0.1. The vote is open until Tue, Sep 27, 2016 at 15:30 PDT and passes if a majority of at least 3+1 PMC votes are cast. [ ] +1 Release this package as Apache Spark 2.0.1 [ ] -1 Do not release this package because ... The