Since many users still use 1.6 and our previous release do not have python artifact, it would be a good idea to do a 0.12 release with Spark 1.6 and python artifact first. Then, we merge the PR for Spark 2.0.
Thanks, Niketan Pansare IBM Almaden Research Center E-mail: npansar At us.ibm.com http://researcher.watson.ibm.com/researcher/view.php?person=us-npansar From: Deron Eriksson <[email protected]> To: [email protected] Cc: Acs S <[email protected]> Date: 01/06/2017 12:21 PM Subject: Re: Time To Merge Spark 2.0 Support PR I would prefer to move forward with Spark 2 now. Deron On Fri, Jan 6, 2017 at 12:15 PM, Mike Dusenberry <[email protected]> wrote: > I vote that we scratch that release, and move forward with adding Spark 2.x > support now, and then release on February 1st as discussed on another > thread this week. Otherwise, our PR board will continue to be backed up > without real benefit to the user. > > - Mike > > > -- > > Michael W. Dusenberry > GitHub: github.com/dusenberrymw > LinkedIn: linkedin.com/in/mikedusenberry > > On Fri, Jan 6, 2017 at 12:03 PM, Acs S <[email protected]> wrote: > > > We are trying to get SystemML 0.12 release out, which slowed down due to > > holiday period in last 2+ weeksFinal verification pending from Glen > > (Niketan, Berthed) related to run wrappers related code with 80GB data. > > Once this get verified we should be in position to release 0.12 and then > > can plan to get PR related to Spark 2.0 merged. > > -Arvind > > > > From: Mike Dusenberry <[email protected]> > > To: dev <[email protected]> > > Sent: Friday, January 6, 2017 11:54 AM > > Subject: Time To Merge Spark 2.0 Support PR > > > > Hi to the SystemML community! > > > > As you may know, SystemML currently only supports Spark 1.6, and does not > > yet support Spark 2.x. However, there is an open PR ( > > https://github.com/apache/incubator-systemml/pull/202) that replaces > Spark > > 1.6 support with Spark 2.x support. > > > > Spark 2.0.0 was released on July 26, 2016 ( > > https://spark.apache.org/news/spark-2-0-0-released.html), and 2.1.0 is > now > > available (https://spark.apache.org/news/spark-2-1-0-released.html). > > > > I think it is time to merge the above PR into the master branch of the > > project in order to move SystemML onto Spark 2.x. > > > > Thoughts? If no objections, I'd like to merge next week. > > > > > > Cheers! > > > > - Mike > > > > -- > > > > Michael W. Dusenberry > > GitHub: github.com/dusenberrymw > > LinkedIn: linkedin.com/in/mikedusenberry > > > > > > > > > -- Deron Eriksson Spark Technology Center http://www.spark.tc/
