Re: Spark 3.0 preview release 2?

Hi, Yuming, Thank you, @Wang, Yuming ! It sounds like everyone is fine about releasing a new Spark 3.0 preview. Could you start working on it? Thanks, Xiao On Tue, Dec 10, 2019 at 2:14 PM Dongjoon Hyun wrote: > BTW, our Jenkins seems to be behind. > > 1. For the first item, `Support JDK 11

Re: Spark 3.0 preview release 2?

BTW, our Jenkins seems to be behind. 1. For the first item, `Support JDK 11 with Hadoop 2.7`: At least, we need a new Jenkins job `spark-master-test-maven-hadoop-2.7-jdk-11/`. 2. https://issues.apache.org/jira/browse/SPARK-28900 (Test Pyspark, SparkR on JDK 11 with run-tests) 3.

Re: Spark 3.0 preview release 2?

+1 for another preview Tom On Monday, December 9, 2019, 12:32:29 AM CST, Xiao Li wrote: I got many great feedbacks from the community about the recent 3.0 preview  release. Since the last 3.0 preview release, we already have 353 commits

Re: Spark 3.0 preview release 2?

Yup, it would be great to release these more often. > On Dec 9, 2019, at 4:25 PM, Takeshi Yamamuro wrote: > > +1; Looks great if we can in terms of user's feedbacks. > > Bests, > Takeshi > > On Tue, Dec 10, 2019 at 3:14 AM Dongjoon Hyun > wrote: > Thank you,

Re: Spark 3.0 preview release 2?

+1; Looks great if we can in terms of user's feedbacks. Bests, Takeshi On Tue, Dec 10, 2019 at 3:14 AM Dongjoon Hyun wrote: > Thank you, All. > > +1 for another `3.0-preview`. > > Also, thank you Yuming for volunteering for that! > > Bests, > Dongjoon. > > > On Mon, Dec 9, 2019 at 9:39 AM Xiao

Re: Spark 3.0 preview release 2?

Thank you, All. +1 for another `3.0-preview`. Also, thank you Yuming for volunteering for that! Bests, Dongjoon. On Mon, Dec 9, 2019 at 9:39 AM Xiao Li wrote: > When entering the official release candidates, the new features have to be > disabled or even reverted [if the conf is not

Re: Spark 3.0 preview release 2?

When entering the official release candidates, the new features have to be disabled or even reverted [if the conf is not available] if the fixes are not trivial; otherwise, we might need 10+ RCs to make the final release. The new features should not block the release based on the previous

Re: Spark 3.0 preview release 2?

Seems fine to me of course. Honestly that wouldn't be a bad result for a release candidate, though we would probably roll another one now. How about simply moving to a release candidate? If not now then at least move to code freeze from the start of 2020. There is also some downside in pushing out

Re: Spark 3.0 preview release 2?

If the cost is low, why don't we just do monthly previews until we code freeze? If it is high, maybe we should discuss and do it when there are people that volunteer On Sun, Dec 08, 2019 at 10:32 PM, Xiao Li < gatorsm...@gmail.com > wrote: > > > > I got many great feedbacks from the

Spark 3.0 preview release 2?

I got many great feedbacks from the community about the recent 3.0 preview release. Since the last 3.0 preview release, we already have 353 commits [https://github.com/apache/spark/compare/v3.0.0-preview...master]. There are various important features and behavior changes we want the community to