Re: [VOTE] Release Apache Spark 1.6.0 (RC4)

+1 On Tue, Dec 22, 2015 at 12:29 PM, Michael Armbrust wrote: > I'll kick the voting off with a +1. > > On Tue, Dec 22, 2015 at 12:10 PM, Michael Armbrust > wrote: > >> Please vote on releasing the following candidate as Apache Spark version >>

Re: [VOTE] Release Apache Spark 1.6.0 (RC4)

+1 2015-12-22 12:43 GMT-08:00 Reynold Xin : > +1 > > > On Tue, Dec 22, 2015 at 12:29 PM, Michael Armbrust > wrote: > >> I'll kick the voting off with a +1. >> >> On Tue, Dec 22, 2015 at 12:10 PM, Michael Armbrust < >> mich...@databricks.com> wrote:

Re: [VOTE] Release Apache Spark 1.6.0 (RC4)

I'll kick the voting off with a +1. On Tue, Dec 22, 2015 at 12:10 PM, Michael Armbrust wrote: > Please vote on releasing the following candidate as Apache Spark version > 1.6.0! > > The vote is open until Friday, December 25, 2015 at 18:00 UTC and passes > if a majority

Re: [Spark SQL] SQLContext getOrCreate incorrect behaviour

I think the original idea is that the life of the driver is the life of the SparkContext: the context is stopped when the driver finishes. Or: if for some reason the "context" dies or there's an unrecoverable error, that's it for the driver. (There's nothing wrong with stop(), right? you have to

Re: [VOTE] Release Apache Spark 1.6.0 (RC4)

+1 On Tue, Dec 22, 2015 at 7:01 PM, Josh Rosen wrote: > +1 > > On Tue, Dec 22, 2015 at 7:00 PM, Jeff Zhang wrote: > >> +1 >> >> On Wed, Dec 23, 2015 at 7:36 AM, Mark Hamstra >> wrote: >> >>> +1 >>> >>> On Tue, Dec 22, 2015

Re: [VOTE] Release Apache Spark 1.6.0 (RC4)

+1 On Wed, Dec 23, 2015 at 7:36 AM, Mark Hamstra wrote: > +1 > > On Tue, Dec 22, 2015 at 12:10 PM, Michael Armbrust > wrote: > >> Please vote on releasing the following candidate as Apache Spark version >> 1.6.0! >> >> The vote is open until

Re: [VOTE] Release Apache Spark 1.6.0 (RC4)

+1 On Tue, Dec 22, 2015 at 7:00 PM, Jeff Zhang wrote: > +1 > > On Wed, Dec 23, 2015 at 7:36 AM, Mark Hamstra > wrote: > >> +1 >> >> On Tue, Dec 22, 2015 at 12:10 PM, Michael Armbrust < >> mich...@databricks.com> wrote: >> >>> Please vote on releasing

[VOTE] Release Apache Spark 1.6.0 (RC4)

Please vote on releasing the following candidate as Apache Spark version 1.6.0! The vote is open until Friday, December 25, 2015 at 18:00 UTC and passes if a majority of at least 3 +1 PMC votes are cast. [ ] +1 Release this package as Apache Spark 1.6.0 [ ] -1 Do not release this package because

Re: [VOTE] Release Apache Spark 1.6.0 (RC4)

+1 On 22 Dec 2015 9:54 p.m., "Andrew Or" wrote: > +1 > > 2015-12-22 12:43 GMT-08:00 Reynold Xin : > >> +1 >> >> >> On Tue, Dec 22, 2015 at 12:29 PM, Michael Armbrust < >> mich...@databricks.com> wrote: >> >>> I'll kick the voting off with a +1. >>> >>>

Re: [VOTE] Release Apache Spark 1.6.0 (RC4)

Running test suite, there was timeout in hive-thriftserver module. This has been fixed by SPARK-11823. So I assume this is test issue. lgtm On Tue, Dec 22, 2015 at 2:28 PM, Benjamin Fradet wrote: > +1 > On 22 Dec 2015 9:54 p.m., "Andrew Or"

Re: A proposal for Spark 2.0

I started a wiki page: https://cwiki.apache.org/confluence/display/SPARK/Development+Discussions On Tue, Dec 22, 2015 at 6:27 AM, Tom Graves wrote: > Do we have a summary of all the discussions and what is planned for 2.0 > then? Perhaps we should put on the wiki for

Re: [Spark SQL] SQLContext getOrCreate incorrect behaviour

Hi Sean, What if the spark context stops for involuntary reasons (misbehavior of some connections) then we need to programmatically handle the failures by recreating spark context. Is there something I don't understand/know about the assumptions on how to use spark context? I tend to think of

Re: [VOTE] Release Apache Spark 1.6.0 (RC4)

+1 On Tue, Dec 22, 2015 at 12:10 PM, Michael Armbrust wrote: > Please vote on releasing the following candidate as Apache Spark version > 1.6.0! > > The vote is open until Friday, December 25, 2015 at 18:00 UTC and passes > if a majority of at least 3 +1 PMC votes are

Re: [VOTE] Release Apache Spark 1.6.0 (RC4)

+1 (non binding) Tested with samples on standalone and yarn. Regards JB On 12/22/2015 09:10 PM, Michael Armbrust wrote: Please vote on releasing the following candidate as Apache Spark version 1.6.0! The vote is open until Friday, December 25, 2015 at 18:00 UTC and passes if a majority of at

Re: Tungsten gives unexpected results when selecting null elements in array

FYI, I filed a JIRA and submitted a PR for this issue: https://issues.apache.org/jira/browse/SPARK-12477 https://github.com/apache/spark/pull/10429 -- View this message in context:

Re: A proposal for Spark 2.0

Do we have a summary of all the discussions and what is planned for 2.0 then?   Perhaps we should put on the wiki for reference. Tom On Tuesday, December 22, 2015 12:12 AM, Reynold Xin wrote: FYI I updated the master branch's Spark version to 2.0.0-SNAPSHOT.  On

Re: [VOTE] Release Apache Spark 1.6.0 (RC4)

+1 On Tue, Dec 22, 2015 at 7:05 PM Aaron Davidson wrote: > +1 > > On Tue, Dec 22, 2015 at 7:01 PM, Josh Rosen > wrote: > >> +1 >> >> On Tue, Dec 22, 2015 at 7:00 PM, Jeff Zhang wrote: >> >>> +1 >>> >>> On Wed, Dec 23, 2015 at

Re: [VOTE] Release Apache Spark 1.6.0 (RC4)

+1 On Tue, Dec 22, 2015 at 8:10 PM, Denny Lee wrote: > +1 > > On Tue, Dec 22, 2015 at 7:05 PM Aaron Davidson wrote: > >> +1 >> >> On Tue, Dec 22, 2015 at 7:01 PM, Josh Rosen >> wrote: >> >>> +1 >>> >>> On Tue, Dec 22, 2015

Re: [Spark SQL] SQLContext getOrCreate incorrect behaviour

Hi Fyi The following 2 tickets are blocking currently (for releases up to 1.5.2) the pattern of Starting and Stopping a sparkContext inside the same driver program https://issues.apache.org/jira/browse/SPARK-11700 ->memory leak in SqlContext https://issues.apache.org/jira/browse/SPARK-11739 In