Re: [VOTE] Spark 2.3.1 (RC1)

FYI the fix for the blocker has just been committed. I'll prepare RC2 tomorrow morning assuming jenkins is reasonably happy with the current state of the branch. On Fri, May 18, 2018 at 10:39 AM, Marcelo Vanzin wrote: > Just to give folks an update. > > In case you haven't

Re: [VOTE] Spark 2.3.1 (RC1)

Just to give folks an update. In case you haven't followed the thread, this vote failed. I'll cut a new RC once the current blocker is addressed. On Thu, May 17, 2018 at 2:59 PM, Imran Rashid wrote: > I just found https://issues.apache.org/jira/browse/SPARK-24309 which

Re: [VOTE] Spark 2.3.1 (RC1)

SPARK-22371 turns an error to a warning, so it won't break any existing workloads. Let me backport it to 2.3 so users won't hit this problem in the new release. On Fri, May 18, 2018 at 5:59 AM, Imran Rashid wrote: > I just found

Re: [VOTE] Spark 2.3.1 (RC1)

I just found https://issues.apache.org/jira/browse/SPARK-24309 which is pretty serious. I've marked it a blocker, I think it should go into 2.3.1. I'll also take a closer look comparing to the behavior of the old listener bus. On Thu, May 17, 2018 at 12:18 PM, Marcelo Vanzin

Re: [VOTE] Spark 2.3.1 (RC1)

Wenchen reviewed and pushed that change, so he's the most qualified to make that decision. I plan to cut a new RC tomorrow so hopefully he'll see this by then. On Thu, May 17, 2018 at 10:13 AM, Artem Rudoy wrote: > Can we include

Re: [VOTE] Spark 2.3.1 (RC1)

Can we include https://issues.apache.org/jira/browse/SPARK-22371 as well please? Artem -- Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: [VOTE] Spark 2.3.1 (RC1)

+1, checked new py4j related changes. Marcelo Vanzin 于2018年5月17日周四 上午5:41写道： > This is actually in 2.3, jira is just missing the version. > > https://github.com/apache/spark/pull/20765 > > On Wed, May 16, 2018 at 2:14 PM, kant kodali wrote: > > I am not

Re: [VOTE] Spark 2.3.1 (RC1)

This is actually in 2.3, jira is just missing the version. https://github.com/apache/spark/pull/20765 On Wed, May 16, 2018 at 2:14 PM, kant kodali wrote: > I am not sure how SPARK-23406 is a new feature. since streaming joins are > already part of SPARK 2.3.0. The self joins

Re: [VOTE] Spark 2.3.1 (RC1)

I am not sure how SPARK-23406 is a new feature. since streaming joins are already part of SPARK 2.3.0. The self joins didn't work because of a bug and it is fixed but I can understand if it touches some other code paths. On Wed, May 16, 2018 at

Re: [VOTE] Spark 2.3.1 (RC1)

RC1 pyspark install works into a venv for what its worth. On Wed, May 16, 2018 at 5:26 AM, Sean Owen wrote: > +1 the release (otherwise) looks fine to me. Sigs and licenses are OK. > Builds and passes tests on Debian with -Pyarn -Phadoop-2.7 -Phive > -Phive-thriftserver

Re: [VOTE] Spark 2.3.1 (RC1)

+1 the release (otherwise) looks fine to me. Sigs and licenses are OK. Builds and passes tests on Debian with -Pyarn -Phadoop-2.7 -Phive -Phive-thriftserver -Pkubernetes On Tue, May 15, 2018 at 4:00 PM Marcelo Vanzin wrote: > Please vote on releasing the following candidate

Re: [VOTE] Spark 2.3.1 (RC1)

I'd be against having a new feature in a minor maintenance release. I think such a release should contain only bugfixes. 2018-05-16 12:11 GMT+02:00 kant kodali : > Can this https://issues.apache.org/jira/browse/SPARK-23406 be part of > 2.3.1? > > On Tue, May 15, 2018 at 2:07

Re: [VOTE] Spark 2.3.1 (RC1)

Can this https://issues.apache.org/jira/browse/SPARK-23406 be part of 2.3.1? On Tue, May 15, 2018 at 2:07 PM, Marcelo Vanzin wrote: > Bummer. People should still feel welcome to test the existing RC so we > can rule out other issues. > > On Tue, May 15, 2018 at 2:04 PM,

Re: [VOTE] Spark 2.3.1 (RC1)

-1 We have a correctness bug fix that was merged after 2.3 RC1. It would be nice to have that in Spark 2.3.1 release. https://issues.apache.org/jira/browse/SPARK-24259 Xiao 2018-05-15 14:00 GMT-07:00 Marcelo Vanzin : > Please vote on releasing the following candidate as

Re: [VOTE] Spark 2.3.1 (RC1)

It's in. That link is only a list of the currently open bugs. On Tue, May 15, 2018 at 2:02 PM, Justin Miller wrote: > Did SPARK-24067 not make it in? I don’t see it in https://s.apache.org/Q3Uo. > > Thanks, > Justin > > On May 15, 2018, at 3:00 PM, Marcelo Vanzin

Re: [VOTE] Spark 2.3.1 (RC1)

Did SPARK-24067 not make it in? I don’t see it in https://s.apache.org/Q3Uo . Thanks, Justin > On May 15, 2018, at 3:00 PM, Marcelo Vanzin wrote: > > Please vote on releasing the following candidate as Apache Spark version > 2.3.1. > > The

Re: [VOTE] Spark 2.3.1 (RC1)

I'll start with my +1 (binding). I've ran unit tests and a bunch of integration tests on the hadoop-2.7 package. Please note that there are still a few flaky tests. Please check jira before you decide to send a -1 because of a flaky test. Also, apologies for the delay in getting the RC ready.

[VOTE] Spark 2.3.1 (RC1)

Please vote on releasing the following candidate as Apache Spark version 2.3.1. The vote is open until Friday, May 18, at 21:00 UTC and passes if a majority of at least 3 +1 PMC votes are cast. [ ] +1 Release this package as Apache Spark 2.3.1 [ ] -1 Do not release this package because ... To