Re: [DISCUSS] Apache Spark 3.0.1 Release

[Shivaram Venkataraman]

Hi all

Just wanted to check if there are any blockers that we are still waiting
for to start the new release process.

Thanks
Shivaram

On Sun, Jul 5, 2020, 06:51 wuyi <yi...@databricks.com> wrote:

> Ok, after having another look, I think it only affects local cluster deploy
> mode, which is for testing only.
>
>
> wuyi wrote
> > Please also includes https://issues.apache.org/jira/browse/SPARK-32120
>  in
> > Spark 3.0.1. It's a regression compares to Spark 3.0.0-preview2.
> >
> > Thanks,
> > Yi Wu
> >
> >
> > Yuanjian Li wrote
> >> Hi dev-list,
> >>
> >> I’m writing this to raise the discussion about Spark 3.0.1 feasibility
> >> since 4 blocker issues were found after Spark 3.0.0:
> >>
> >>
> >>    1.
> >>
> >>    [SPARK-31990]
> >> &lt;https://issues.apache.org/jira/browse/SPARK-31990&gt;
> >> The
> >>    state store compatibility broken will cause a correctness issue when
> >>    Streaming query with `dropDuplicate` uses the checkpoint written by
> >> the
> >> old
> >>    Spark version.
> >>    2.
> >>
> >>    [SPARK-32038]
> >> &lt;https://issues.apache.org/jira/browse/SPARK-32038&gt;
> >> The
> >>    regression bug in handling NaN values in COUNT(DISTINCT)
> >>    3.
> >>
> >>    [SPARK-31918]
> >> &lt;https://issues.apache.org/jira/browse/SPARK-31918&gt;[WIP]
> >>    CRAN requires to make it working with the latest R 4.0. It makes the
> >> 3.0
> >>    release unavailable on CRAN, and only supports R [3.5, 4.0)
> >>    4.
> >>
> >>    [SPARK-31967]
> >> &lt;https://issues.apache.org/jira/browse/SPARK-31967&gt;
> >>    Downgrade vis.js to fix Jobs UI loading time regression
> >>
> >>
> >> I also noticed branch-3.0 already has 39 commits
> >> &lt;
> https://issues.apache.org/jira/browse/SPARK-32038?jql=project%20%3D%20SPARK%20AND%20fixVersion%20%3D%203.0.1&gt
> ;
> >> after Spark 3.0.0. I think it would be great if we have Spark 3.0.1 to
> >> deliver the critical fixes.
> >>
> >> Any comments are appreciated.
> >>
> >> Best,
> >>
> >> Yuanjian
> >
> >
> >
> >
> >
> > --
> > Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/
> >
> > ---------------------------------------------------------------------
> > To unsubscribe e-mail:
>
> > dev-unsubscribe@.apache
>
>
>
>
>
> --
> Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org
>
>