[RESULT][VOTE] [SPARK-27495] SPIP: Support Stage level resource configuration and scheduling

2019-09-13 Thread Thomas graves
Hi all, The vote passed with 6 +1's (4 binding) and no -1's. +1s (* = binding) : Bobby Evans* Thomas Graves* Dongjoon Hyuni* Felix Cheung* Bryan Cutler Ryan Blue Thanks, Tom Graves - To unsubscribe e-mail:

Re: Thoughts on Spark 3 release, or a preview release

2019-09-13 Thread Andrew Melo
Hi Spark Aficionados- On Fri, Sep 13, 2019 at 15:08 Ryan Blue wrote: > +1 for a preview release. > > DSv2 is quite close to being ready. I can only think of a couple issues > that we need to merge, like getting a fix for stats estimation done. I'll > have a better idea once I've caught up from

Re: Thoughts on Spark 3 release, or a preview release

2019-09-13 Thread Ryan Blue
+1 for a preview release. DSv2 is quite close to being ready. I can only think of a couple issues that we need to merge, like getting a fix for stats estimation done. I'll have a better idea once I've caught up from being away for ApacheCon and I'll add this to the agenda for our next DSv2 sync

Re: [VOTE] [SPARK-27495] SPIP: Support Stage level resource configuration and scheduling

2019-09-13 Thread Dongjoon Hyun
+1 Thanks, Dongjoon. On Fri, Sep 13, 2019 at 9:59 AM Thomas Graves wrote: > Thanks everyone so far for the voting and the feedback, bumping this > up as vote is scheduling to end today. > > Tom > > On Wed, Sep 11, 2019 at 1:10 PM Bryan Cutler wrote: > > > > +1 (non-binding), looks good! > > >

Re: Thoughts on Spark 3 release, or a preview release

2019-09-13 Thread Dongjoon Hyun
Ur, Sean. I prefer a full release like 2.0.0-preview. https://archive.apache.org/dist/spark/spark-2.0.0-preview/ And, thank you, Xingbo! Could you take a look at website generation? It seems to be broken on `master`. Bests, Dongjoon. On Fri, Sep 13, 2019 at 11:30 AM Xingbo Jiang wrote: >

Re: Thoughts on Spark 3 release, or a preview release

2019-09-13 Thread Xingbo Jiang
Hi all, I would like to volunteer to be the release manager of Spark 3 preview, thanks! Sean Owen 于2019年9月13日周五 上午11:21写道: > Well, great to hear the unanimous support for a Spark 3 preview > release. Now, I don't know how to make releases myself :) I would > first open it up to our revered

Re: Thoughts on Spark 3 release, or a preview release

2019-09-13 Thread Sean Owen
Well, great to hear the unanimous support for a Spark 3 preview release. Now, I don't know how to make releases myself :) I would first open it up to our revered release managers: would anyone be interested in trying to make one? sounds like it's not too soon to get what's in master out for

Re: Thoughts on Spark 3 release, or a preview release

2019-09-13 Thread Ilan Filonenko
+1 for preview release On Fri, Sep 13, 2019 at 9:58 AM Thomas Graves wrote: > +1, I think having preview release would be great. > > Tom > > On Fri, Sep 13, 2019 at 4:55 AM Stavros Kontopoulos < > stavros.kontopou...@lightbend.com> wrote: > >> +1 as a contributor and as a user. Given the amount

Re: [VOTE] [SPARK-27495] SPIP: Support Stage level resource configuration and scheduling

2019-09-13 Thread Thomas Graves
Thanks everyone so far for the voting and the feedback, bumping this up as vote is scheduling to end today. Tom On Wed, Sep 11, 2019 at 1:10 PM Bryan Cutler wrote: > > +1 (non-binding), looks good! > > On Wed, Sep 11, 2019 at 10:05 AM Ryan Blue wrote: >> >> +1 >> >> This is going to be really

Re: Thoughts on Spark 3 release, or a preview release

2019-09-13 Thread Thomas Graves
+1, I think having preview release would be great. Tom On Fri, Sep 13, 2019 at 4:55 AM Stavros Kontopoulos < stavros.kontopou...@lightbend.com> wrote: > +1 as a contributor and as a user. Given the amount of testing required > for all the new cool stuff like java 11 support, major >

Re: Thoughts on Spark 3 release, or a preview release

2019-09-13 Thread Stavros Kontopoulos
+1 as a contributor and as a user. Given the amount of testing required for all the new cool stuff like java 11 support, major refactorings/deprecations etc, a preview version would help a lot the community making adoption smoother long term. I would also add to the list of issues, Scala 2.13

Re: Thoughts on Spark 3 release, or a preview release

2019-09-13 Thread Driesprong, Fokko
Michael Heuer, that's an interesting issue. 1.8.2 to 1.9.0 is almost binary compatible (94%): http://people.apache.org/~busbey/avro/1.9.0-RC4/1.8.2_to_1.9.0RC4_compat_report.html. Most of the stuff is removing the Jackson and Netty API from Avro's public API and deprecating the Joda library. I