Re: [vote] Apache Spark 2.0.0-preview release (rc1)

This vote passes with 14 +1s (5 binding*) and no 0 or -1! Thanks to everyone who voted. I'll start work on publishing the release. +1: Reynold Xin* Sean Owen* Ovidiu-Cristian MARCU Krishna Sankar Michael Armbrust* Yin Huai Joseph Bradley* Xiangrui Meng* Herman van Hövell tot Westerflier Vishnu

Re: [vote] Apache Spark 2.0.0-preview release (rc1)

+1 Ricardo Almeida On 20 May 2016 at 18:33, Mark Hamstra wrote: > This is isn't yet a release candidate since, as Reynold mention in his > opening post, preview releases are "not meant to be functional, i.e. they > can and highly likely will contain critical bugs

Re: [vote] Apache Spark 2.0.0-preview release (rc1)

This is isn't yet a release candidate since, as Reynold mention in his opening post, preview releases are "not meant to be functional, i.e. they can and highly likely will contain critical bugs or documentation errors." Once we're at the point where we expect there not to be such bugs and errors,

Re: [vote] Apache Spark 2.0.0-preview release (rc1)

+1 Having an rc1 would help me get stable feedback on using my library with Spark, compared to relying on 2.0.0-SNAPSHOT. On Fri, 20 May 2016 at 05:57 Xiao Li wrote: > Changed my vote to +1. Thanks! > > 2016-05-19 13:28 GMT-07:00 Xiao Li : > >> Will

Re: [vote] Apache Spark 2.0.0-preview release (rc1)

Changed my vote to +1. Thanks! 2016-05-19 13:28 GMT-07:00 Xiao Li : > Will do. Thanks! > > 2016-05-19 13:26 GMT-07:00 Reynold Xin : > >> Xiao thanks for posting. Please file a bug in JIRA. Again as I said in >> the email this is not meant to be a

Re: [vote] Apache Spark 2.0.0-preview release (rc1)

I happened to test SparkR in Windows 7 (32 bits) and it seems some tests are failed. Could this be a reason to downvote? For more details of the tests, please see https://github.com/apache/spark/pull/13165#issuecomment-220515182 2016-05-20 13:44 GMT+09:00 Takuya UESHIN

Re: [vote] Apache Spark 2.0.0-preview release (rc1)

-1 (non-binding) I filed 2 major bugs of Spark SQL: SPARK-15308 : RowEncoder should preserve nested column name. SPARK-15313 : EmbedSerializerInFilter rule should keep exprIds of output of

Re: [vote] Apache Spark 2.0.0-preview release (rc1)

@Xiao, It is tracked in SPARK-15345 On Fri, May 20, 2016 at 4:20 AM, Xiao Li wrote: > -1 > > Unable to use Hive meta-store in pyspark shell. Tried both HiveContext and > SparkSession. Both failed. It always uses

Re: [vote] Apache Spark 2.0.0-preview release (rc1)

+1 On 20 May 2016 at 01:19, Herman van Hövell tot Westerflier < hvanhov...@questtec.nl> wrote: > +1 > > > 2016-05-19 18:20 GMT+02:00 Xiangrui Meng : > >> +1 >> >> On Thu, May 19, 2016 at 9:18 AM Joseph Bradley >> wrote: >> >>> +1 >>> >>> On Wed, May

Re: [vote] Apache Spark 2.0.0-preview release (rc1)

Will do. Thanks! 2016-05-19 13:26 GMT-07:00 Reynold Xin : > Xiao thanks for posting. Please file a bug in JIRA. Again as I said in the > email this is not meant to be a functional release and will contain bugs. > > On Thu, May 19, 2016 at 1:20 PM, Xiao Li

Re: [vote] Apache Spark 2.0.0-preview release (rc1)

Xiao thanks for posting. Please file a bug in JIRA. Again as I said in the email this is not meant to be a functional release and will contain bugs. On Thu, May 19, 2016 at 1:20 PM, Xiao Li wrote: > -1 > > Unable to use Hive meta-store in pyspark shell. Tried both

Re: [vote] Apache Spark 2.0.0-preview release (rc1)

-1 Unable to use Hive meta-store in pyspark shell. Tried both HiveContext and SparkSession. Both failed. It always uses in-memory catalog. Anybody else hit the same issue? Method 1: SparkSession >>> from pyspark.sql import SparkSession >>> spark =

Re: [vote] Apache Spark 2.0.0-preview release (rc1)

+1 2016-05-19 18:20 GMT+02:00 Xiangrui Meng : > +1 > > On Thu, May 19, 2016 at 9:18 AM Joseph Bradley > wrote: > >> +1 >> >> On Wed, May 18, 2016 at 10:49 AM, Reynold Xin >> wrote: >> >>> Hi Ovidiu-Cristian , >>> >>> The best

Re: [vote] Apache Spark 2.0.0-preview release (rc1)

+1 On Wed, May 18, 2016 at 10:49 AM, Reynold Xin wrote: > Hi Ovidiu-Cristian , > > The best source of truth is change the filter with target version to > 2.1.0. Not a lot of tickets have been targeted yet, but I'd imagine as we > get closer to 2.0 release, more will be

Re: [vote] Apache Spark 2.0.0-preview release (rc1)

+1 On Wed, May 18, 2016 at 10:49 AM, Reynold Xin wrote: > Hi Ovidiu-Cristian , > > The best source of truth is change the filter with target version to > 2.1.0. Not a lot of tickets have been targeted yet, but I'd imagine as we > get closer to 2.0 release, more will be

Re: [vote] Apache Spark 2.0.0-preview release (rc1)

Hi Ovidiu-Cristian , The best source of truth is change the filter with target version to 2.1.0. Not a lot of tickets have been targeted yet, but I'd imagine as we get closer to 2.0 release, more will be retargeted at 2.1.0. On Wed, May 18, 2016 at 10:43 AM, Ovidiu-Cristian MARCU <

Re: [vote] Apache Spark 2.0.0-preview release (rc1)

Yes, I can filter.. Did that and for example: https://issues.apache.org/jira/browse/SPARK-15370?jql=project%20%3D%20SPARK%20AND%20resolution%20%3D%20Unresolved%20AND%20affectedVersion%20%3D%202.0.0

Re: [vote] Apache Spark 2.0.0-preview release (rc1)

+1, excited for 2.0! On Wed, May 18, 2016 at 10:06 AM, Krishna Sankar wrote: > +1. Looks Good. > The mllib results are in line with 1.6.1. Deprecation messages. I will > convert to ml and test later in the day. > Also will try GraphX exercises for our Strata London Tutorial

Re: [vote] Apache Spark 2.0.0-preview release (rc1)

+1. Looks Good. The mllib results are in line with 1.6.1. Deprecation messages. I will convert to ml and test later in the day. Also will try GraphX exercises for our Strata London Tutorial Quick Notes: 1. pyspark env variables need to be changed - IPYTHON and IPYTHON_OPTS are removed

Re: [vote] Apache Spark 2.0.0-preview release (rc1)

fairly big issue for people using Spark with Mesos. > > Thanks! > Mike > > From: <r...@databricks.com> on behalf of Reynold Xin <r...@apache.org> > Date: Wednesday, May 18, 2016 at 6:40 AM > To: "dev@spark.apache.org" <dev@spark.apache.org> > Subjec

Re: [vote] Apache Spark 2.0.0-preview release (rc1)

You can find that by changing the filter to target version = 2.0.0. Cheers. On Wed, May 18, 2016 at 9:00 AM, Ovidiu-Cristian MARCU < ovidiu-cristian.ma...@inria.fr> wrote: > +1 Great, I see the list of resolved issues, do you have a list of known > issue you plan to stay with this release? > >

Re: [vote] Apache Spark 2.0.0-preview release (rc1)

+1 Great, I see the list of resolved issues, do you have a list of known issue you plan to stay with this release? with build/mvn -Pyarn -Phadoop-2.6 -Dhadoop.version=2.7.1 -Phive -Phive-thriftserver -DskipTests clean package mvn -version Apache Maven 3.3.9

Re: [vote] Apache Spark 2.0.0-preview release (rc1)

I think it's a good idea. Although releases have been preceded before by release candidates for developers, it would be good to get a formal preview/beta release ratified for public consumption ahead of a new major release. Better to have a little more testing in the wild to identify problems

[vote] Apache Spark 2.0.0-preview release (rc1)

Hi, In the past the Apache Spark community have created preview packages (not official releases) and used those as opportunities to ask community members to test the upcoming versions of Apache Spark. Several people in the Apache community have suggested we conduct votes for these preview