Hi, Michael.
Can we be more clear on deprecation messages in 2.2.0-RC4 documentation?
> Spark runs on Java 8+, Python 2.6+/3.4+ and R 3.1+.
-> Python 2.7+ ?
https://issues.apache.org/jira/browse/SPARK-12661 (Status: `Open`, Target
Version: `2.2.0`, Label: `ReleaseNotes`)
> Note that support for Python 2.6 is deprecated as of Spark 2.0.0, and support
> for Scala 2.10 and versions of Hadoop before 2.6 are deprecated as of Spark
> 2.1.0, and may be removed in Spark 2.2.0.
-> Support for versions of Hadoop before 2.6.5 are removed as of 2.2.0.
-> Support for Scala 2.10 may be removed in Spark 2.3.0.
Since this is a doc only issue, can we revise this without affecting the RC4
vote?
I created a PR for this, https://github.com/apache/spark/pull/18207.
Bests,
Dongjoon.
From: Michael Armbrust <mich...@databricks.com>
Date: Monday, June 5, 2017 at 12:51 PM
To: Sean Owen <so...@cloudera.com>
Cc: "dev@spark.apache.org" <dev@spark.apache.org>
Subject: Re: [VOTE] Apache Spark 2.2.0 (RC4)
I commented on that JIRA, I don't think that should block the release. We can
support both options long term if this vote passes. Looks like the remaining
JIRAs are doc/website updates that can happen after the vote or QA that should
be done on this RC. I think we are ready to start testing this release
seriously!
On Mon, Jun 5, 2017 at 12:40 PM, Sean Owen
<so...@cloudera.com<mailto:so...@cloudera.com>> wrote:
Xiao opened a blocker on 2.2.0 this morning:
SPARK-20980 Rename the option `wholeFile` to `multiLine` for JSON and CSV
I don't see that this should block?
We still have 7 Critical issues:
SPARK-20520 R streaming tests failed on Windows
SPARK-20512 SparkR 2.2 QA: Programming guide, migration guide, vignettes updates
SPARK-20499 Spark MLlib, GraphX 2.2 QA umbrella
SPARK-20508 Spark R 2.2 QA umbrella
SPARK-20513 Update SparkR website for 2.2
SPARK-20510 SparkR 2.2 QA: Update user guide for new features & APIs
SPARK-20507 Update MLlib, GraphX websites for 2.2
I'm going to assume that the R test issue isn't actually that big a deal, and
that the 2.2 items are done. Anything that really is for 2.2 needs to block the
release; Joseph what's the status on those?
On Mon, Jun 5, 2017 at 8:15 PM Michael Armbrust
<mich...@databricks.com<mailto:mich...@databricks.com>> wrote:
Please vote on releasing the following candidate as Apache Spark version 2.2.0.
The vote is open until Thurs, June 8th, 2017 at 12:00 PST and passes if a
majority of at least 3 +1 PMC votes are cast.
[ ] +1 Release this package as Apache Spark 2.2.0
[ ] -1 Do not release this package because ...
To learn more about Apache Spark, please see http://spark.apache.org/
The tag to be voted on is
v2.2.0-rc4<https://github.com/apache/spark/tree/v2.2.0-rc4>
(377cfa8ac7ff7a8a6a6d273182e18ea7dc25ce7e)
List of JIRA tickets resolved can be found with this
filter<https://issues.apache.org/jira/browse/SPARK-20134?jql=project%20%3D%20SPARK%20AND%20fixVersion%20%3D%202.2.0>.
The release files, including signatures, digests, etc. can be found at:
http://home.apache.org/~pwendell/spark-releases/spark-2.2.0-rc4-bin/
Release artifacts are signed with the following key:
https://people.apache.org/keys/committer/pwendell.asc
The staging repository for this release can be found at:
https://repository.apache.org/content/repositories/orgapachespark-1241/
The documentation corresponding to this release can be found at:
http://people.apache.org/~pwendell/spark-releases/spark-2.2.0-rc4-docs/
FAQ
How can I help test this release?
If you are a Spark user, you can help us test this release by taking an
existing Spark workload and running on this release candidate, then reporting
any regressions.
What should happen to JIRA tickets still targeting 2.2.0?
Committers should look at those and triage. Extremely important bug fixes,
documentation, and API tweaks that impact compatibility should be worked on
immediately. Everything else please retarget to 2.3.0 or 2.2.1.
But my bug isn't fixed!??!
In order to make timely releases, we will typically not hold the release unless
the bug in question is a regression from 2.1.1.
