[VOTE] Release Apache Spark 1.5.2 (RC1)

2015-10-25 Thread Reynold Xin
Please vote on releasing the following candidate as Apache Spark version 1.5.2. The vote is open until Wed Oct 28, 2015 at 08:00 UTC and passes if a majority of at least 3 +1 PMC votes are cast. [ ] +1 Release this package as Apache Spark 1.5.2 [ ] -1 Do not release this package because ... The

[VOTE] Release Apache Spark 1.5.2 (RC1)

2015-10-29 Thread Stavros Kontopoulos
+1 (non binding) I tested several of the examples on mesos latest version (fine and coarse-grained modes) and they work fine. Hope not too late...though.. -- Stavros Kontopoulos

Re: [VOTE] Release Apache Spark 1.5.2 (RC1)

2015-10-25 Thread Ted Yu
When I ran the following command: ~/apache-maven-3.3.3/bin/mvn -Phive -Phive-thriftserver -Pyarn -Phadoop-2.4 -Dhadoop.version=2.6.0 package I got: testChildProcLauncher(org.apache.spark.launcher.SparkLauncherSuite) Time elapsed: 0.031 sec <<< FAILURE! java.lang.AssertionError: expected:<0> but

Re: [VOTE] Release Apache Spark 1.5.2 (RC1)

2015-10-25 Thread Sean Owen
I believe you still need to "clean package" and then "test" separately. Or did the change to make that unnecessary go in to 1.5? FWIW I do not see this (my results coming soon) On Sun, Oct 25, 2015 at 4:28 PM, Ted Yu wrote: > When I ran the following command: > ~/apache-maven-3.3.3/bin/mvn -Phiv

Re: [VOTE] Release Apache Spark 1.5.2 (RC1)

2015-10-25 Thread Mark Hamstra
You're correct, Sean: That build change isn't in branch-1.5, so the two-phase build is still needed there. On Sun, Oct 25, 2015 at 9:30 AM, Sean Owen wrote: > I believe you still need to "clean package" and then "test" > separately. Or did the change to make that unnecessary go in to 1.5? > > FW

Re: [VOTE] Release Apache Spark 1.5.2 (RC1)

2015-10-25 Thread Sean Owen
The signatures and licenses are fine. I continue to get failures in these tests though, with "-Pyarn -Phadoop-2.6 -Phive -Phive-thriftserver" on Ubuntu 15 / Java 7. - Unpersisting HttpBroadcast on executors and driver in distributed mode *** FAILED *** java.util.concurrent.TimeoutException: Can'

Re: [VOTE] Release Apache Spark 1.5.2 (RC1)

2015-10-25 Thread Mark Hamstra
Should 1.5.2 wait for Josh's fix of SPARK-11293? On Sun, Oct 25, 2015 at 2:25 PM, Sean Owen wrote: > The signatures and licenses are fine. I continue to get failures in > these tests though, with "-Pyarn -Phadoop-2.6 -Phive > -Phive-thriftserver" on Ubuntu 15 / Java 7. > > - Unpersisting HttpBro

Re: [VOTE] Release Apache Spark 1.5.2 (RC1)

2015-10-25 Thread Josh Rosen
Hi Mark, The shuffle memory leaks that I identified in SPARK-11239 have been around for multiple releases and it's not clear whether they have caused performance problems in real workloads, so I would say that it's fine to move the release forward without including my patch. If we have to cut anot

Re: [VOTE] Release Apache Spark 1.5.2 (RC1)

2015-10-26 Thread Patrick Wendell
I verified that the issue with build binaries being present in the source release is fixed. Haven't done enough vetting for a full vote, but did verify that. On Sun, Oct 25, 2015 at 12:07 AM, Reynold Xin wrote: > Please vote on releasing the following candidate as Apache Spark > version 1.5.2. T

Re: [VOTE] Release Apache Spark 1.5.2 (RC1)

2015-10-26 Thread Krishna Sankar
Guys, The sc.version returns 1.5.1 in python and scala. Is anyone getting the same results ? Probably I am doing something wrong. Cheers On Sun, Oct 25, 2015 at 12:07 AM, Reynold Xin wrote: > Please vote on releasing the following candidate as Apache Spark > version 1.5.2. The vote is open u

Re: [VOTE] Release Apache Spark 1.5.2 (RC1)

2015-10-27 Thread Sean Owen
Ah, good point. I also see it still reads 1.5.1. I imagine we just need another sweep to update all the version strings. On Tue, Oct 27, 2015 at 3:08 AM, Krishna Sankar wrote: > Guys, >The sc.version returns 1.5.1 in python and scala. Is anyone getting the > same results ? Probably I am doin

Re: [VOTE] Release Apache Spark 1.5.2 (RC1)

2015-10-27 Thread Reynold Xin
Yup looks like I missed that. I will build a new one. On Tuesday, October 27, 2015, Sean Owen wrote: > Ah, good point. I also see it still reads 1.5.1. I imagine we just need > another sweep to update all the version strings. > > On Tue, Oct 27, 2015 at 3:08 AM, Krishna Sankar > wrote: > >> Guy