Re: [VOTE] Apache Spark 2.2.0 (RC1)

2017-05-02 Thread Nick Pentreath
I won't +1 just given that it seems certain there will be another RC and there are the outstanding ML QA blocker issues. But clean build and test for JVM and Python tests LGTM on CentOS Linux 7.2.1511, OpenJDK 1.8.0_111 On Mon, 1 May 2017 at 22:42 Frank Austin Nothaft wrote: > Hi Ryan, > > IMO,

Re: Spark 2.2.0 or Spark 2.3.0?

2017-05-02 Thread Felix Cheung
Yes 2.2.0 From: kant kodali Sent: Monday, May 1, 2017 10:43:44 PM To: dev Subject: Spark 2.2.0 or Spark 2.3.0? Hi All, If I understand the Spark standard release process correctly. It looks like the official release is going to be sometime end of this month and

Re: Spark 2.2.0 or Spark 2.3.0?

2017-05-02 Thread Michael Armbrust
An RC for 2.2.0 was released last week. Please test. Note that update mode has been supported since 2.0. On Mon, May 1, 2017 at 10:43 PM, kant kodali wrote: > Hi All, > > If I understand the Spark standard release process c

[Spark Streaming] Dynamic Broadcast Variable Update

2017-05-02 Thread Nipun Arora
Hi All, To support our Spark Streaming based anomaly detection tool, we have made a patch in Spark 1.6.2 to dynamically update broadcast variables. I'll first explain our use-case, which I believe should be common to several people using Spark Streaming applications. Broadcast variables are often

[ANNOUNCE] Apache Spark 2.1.1

2017-05-02 Thread Michael Armbrust
We are happy to announce the availability of Spark 2.1.1! Apache Spark 2.1.1 is a maintenance release, based on the branch-2.1 maintenance branch of Spark. We strongly recommend all 2.1.x users to upgrade to this stable release. To download Apache Spark 2.1.1 visit http://spark.apache.org/downloa

Hoping contribute code-Spark 2.1.1 Documentation

2017-05-02 Thread cht liu
Hello,The Spark organizational leader : This is my first time to contribute the Spark code, do not know much about the process.I released a bug in JIRA:SPARK-20570 :On the spark.apache.org home page, when I click the menu Latest Release (Spark

Re: Hoping contribute code-Spark 2.1.1 Documentation

2017-05-02 Thread Reynold Xin
Liucht, Thanks for the interest. You are more than welcomed to contribute a pull request to fix the issue, at https://github.com/apache/spark On Tue, May 2, 2017 at 7:44 PM, cht liu wrote: > Hello,The Spark organizational leader : > This is my first time to contribute the Spark code, do n