Re: [VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-24 Thread Sean Owen
PS Shixiong Zhu is correct that this one has to be fixed: https://issues.apache.org/jira/browse/SPARK-10168 For example you can see assemblies like this are nearly empty: https://repository.apache.org/content/repositories/orgapachespark-1137/org/apache/spark/spark-streaming-flume-assembly_2.10/1.5

Fwd: [jira] [Commented] (INFRA-10191) git pushing for Spark fails

2015-08-24 Thread Reynold Xin
FYI -- Forwarded message -- From: Geoffrey Corey (JIRA) Date: Mon, Aug 24, 2015 at 11:54 AM Subject: [jira] [Commented] (INFRA-10191) git pushing for Spark fails To: r...@apache.org [ https://issues.apache.org/jira/browse/INFRA-10191?page=com.atlassian.jira.plugin.system.i

Re: [jira] [Commented] (INFRA-10191) git pushing for Spark fails

2015-08-24 Thread Reynold Xin
This has been resolved. On Mon, Aug 24, 2015 at 11:58 AM, Reynold Xin wrote: > FYI > > > -- Forwarded message -- > From: Geoffrey Corey (JIRA) > Date: Mon, Aug 24, 2015 at 11:54 AM > Subject: [jira] [Commented] (INFRA-10191) git pushing for Spark fails > To: r...@apache.org > >

Re: [VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-24 Thread Reynold Xin
Nope --- I cut that last Friday but had an error. I will remove it and cut a new one. On Mon, Aug 24, 2015 at 2:06 PM, Sandy Ryza wrote: > I see that there's an 1.5.0-rc2 tag in github now. Is that the official > RC2 tag to start trying out? > > -Sandy > > On Mon, Aug 24, 2015 at 7:23 AM, Sean

Re: [VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-24 Thread Sandy Ryza
Cool, thanks! On Mon, Aug 24, 2015 at 2:07 PM, Reynold Xin wrote: > Nope --- I cut that last Friday but had an error. I will remove it and cut > a new one. > > > On Mon, Aug 24, 2015 at 2:06 PM, Sandy Ryza > wrote: > >> I see that there's an 1.5.0-rc2 tag in github now. Is that the official >>

Re: [VOTE] Release Apache Spark 1.5.0 (RC1)

2015-08-24 Thread Sandy Ryza
I see that there's an 1.5.0-rc2 tag in github now. Is that the official RC2 tag to start trying out? -Sandy On Mon, Aug 24, 2015 at 7:23 AM, Sean Owen wrote: > PS Shixiong Zhu is correct that this one has to be fixed: > https://issues.apache.org/jira/browse/SPARK-10168 > > For example you can

ExternalSorter: Thread *** spilling in-memory map of 352.6 MB to disk (38 times so far)

2015-08-24 Thread d...@lumity.com
Hi all, I posted this on the user list but didn't get any responses to I was hoping one of you awesome devs could shed some light: I'm trying to run a spark 1.5 job with: ./spark-shell --driver-java-options "-Xdebug -Xrunjdwp:transport=dt_socket,server=y,suspend=n,address=1044 -Xms16g -Xmx48g