Re: [VOTE] Release Apache Spark 1.6.2 (RC1)

2016-06-19 Thread Reynold Xin
While we wait on the resolution of the test issue, I've created rc2.

This vote is now canceled in favor of rc2.

On Sun, Jun 19, 2016 at 1:59 PM, Sean Owen  wrote:

> I consistently get this error in the launcher suite on Ubuntu 16. I
> don't know if it's a known issue.
>
> ---
>
>  T E S T S
>
> ---
>
> OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512m;
> support was removed in 8.0
>
> Running org.apache.spark.launcher.SparkSubmitOptionParserSuite
>
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.333
> sec - in org.apache.spark.launcher.SparkSubmitOptionParserSuite
>
> Running org.apache.spark.launcher.LauncherServerSuite
>
> Tests run: 3, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 0.376
> sec <<< FAILURE! - in org.apache.spark.launcher.LauncherServerSuite
>
> testCommunication(org.apache.spark.launcher.LauncherServerSuite)  Time
> elapsed: 0.078 sec  <<< FAILURE!
>
> java.lang.AssertionError: null
>
> at org.junit.Assert.fail(Assert.java:86)
>
> at org.junit.Assert.assertTrue(Assert.java:41)
>
> at org.junit.Assert.assertNotNull(Assert.java:621)
>
> at org.junit.Assert.assertNotNull(Assert.java:631)
>
> at
> org.apache.spark.launcher.LauncherServerSuite.testCommunication(LauncherServerSuite.java:98)
>
> On Fri, Jun 17, 2016 at 5:49 AM, Reynold Xin  wrote:
> > Please vote on releasing the following candidate as Apache Spark version
> > 1.6.2!
> >
> > The vote is open until Sunday, June 19, 2016 at 22:00 PDT and passes if a
> > majority of at least 3+1 PMC votes are cast.
> >
> > [ ] +1 Release this package as Apache Spark 1.6.2
> > [ ] -1 Do not release this package because ...
> >
> >
> > The tag to be voted on is v1.6.2-rc1
> > (4168d9c94a9564f6b3e62f5d669acde13a7c7cf6)
> >
> > The release files, including signatures, digests, etc. can be found at:
> > https://home.apache.org/~pwendell/spark-releases/spark-1.6.2-rc1-bin/
> >
> > Release artifacts are signed with the following key:
> > https://people.apache.org/keys/committer/pwendell.asc
> >
> > The staging repository for this release can be found at:
> > https://repository.apache.org/content/repositories/orgapachespark-1184
> >
> > The documentation corresponding to this release can be found at:
> > https://home.apache.org/~pwendell/spark-releases/spark-1.6.2-rc1-docs/
> >
> >
> > ===
> > == How can I help test this release? ==
> > ===
> > If you are a Spark user, you can help us test this release by taking an
> > existing Spark workload and running on this release candidate, then
> > reporting any regressions from 1.6.1.
> >
> > 
> > == What justifies a -1 vote for this release? ==
> > 
> > This is a maintenance release in the 1.6.x series.  Bugs already present
> in
> > 1.6.1, missing features, or bugs related to new features will not
> > necessarily block this release.
> >
>


Re: [VOTE] Release Apache Spark 1.6.2 (RC1)

2016-06-19 Thread Sean Owen
I consistently get this error in the launcher suite on Ubuntu 16. I
don't know if it's a known issue.

---

 T E S T S

---

OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512m;
support was removed in 8.0

Running org.apache.spark.launcher.SparkSubmitOptionParserSuite

Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.333
sec - in org.apache.spark.launcher.SparkSubmitOptionParserSuite

Running org.apache.spark.launcher.LauncherServerSuite

Tests run: 3, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 0.376
sec <<< FAILURE! - in org.apache.spark.launcher.LauncherServerSuite

testCommunication(org.apache.spark.launcher.LauncherServerSuite)  Time
elapsed: 0.078 sec  <<< FAILURE!

java.lang.AssertionError: null

at org.junit.Assert.fail(Assert.java:86)

at org.junit.Assert.assertTrue(Assert.java:41)

at org.junit.Assert.assertNotNull(Assert.java:621)

at org.junit.Assert.assertNotNull(Assert.java:631)

at 
org.apache.spark.launcher.LauncherServerSuite.testCommunication(LauncherServerSuite.java:98)

On Fri, Jun 17, 2016 at 5:49 AM, Reynold Xin  wrote:
> Please vote on releasing the following candidate as Apache Spark version
> 1.6.2!
>
> The vote is open until Sunday, June 19, 2016 at 22:00 PDT and passes if a
> majority of at least 3+1 PMC votes are cast.
>
> [ ] +1 Release this package as Apache Spark 1.6.2
> [ ] -1 Do not release this package because ...
>
>
> The tag to be voted on is v1.6.2-rc1
> (4168d9c94a9564f6b3e62f5d669acde13a7c7cf6)
>
> The release files, including signatures, digests, etc. can be found at:
> https://home.apache.org/~pwendell/spark-releases/spark-1.6.2-rc1-bin/
>
> Release artifacts are signed with the following key:
> https://people.apache.org/keys/committer/pwendell.asc
>
> The staging repository for this release can be found at:
> https://repository.apache.org/content/repositories/orgapachespark-1184
>
> The documentation corresponding to this release can be found at:
> https://home.apache.org/~pwendell/spark-releases/spark-1.6.2-rc1-docs/
>
>
> ===
> == How can I help test this release? ==
> ===
> If you are a Spark user, you can help us test this release by taking an
> existing Spark workload and running on this release candidate, then
> reporting any regressions from 1.6.1.
>
> 
> == What justifies a -1 vote for this release? ==
> 
> This is a maintenance release in the 1.6.x series.  Bugs already present in
> 1.6.1, missing features, or bugs related to new features will not
> necessarily block this release.
>

-
To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
For additional commands, e-mail: dev-h...@spark.apache.org



Re: [VOTE] Release Apache Spark 1.6.2 (RC1)

2016-06-18 Thread Jacek Laskowski
+1

Pozdrawiam,
Jacek Laskowski

https://medium.com/@jaceklaskowski/
Mastering Apache Spark http://bit.ly/mastering-apache-spark
Follow me at https://twitter.com/jaceklaskowski


On Sat, Jun 18, 2016 at 9:13 AM, Reynold Xin  wrote:
> Looks like that's resolved now.
>
> I will wait till Sunday to cut rc2 to give people more time to find issues
> with rc1.
>
>
> On Fri, Jun 17, 2016 at 10:58 AM, Marcelo Vanzin 
> wrote:
>>
>> -1 (non-binding)
>>
>> SPARK-16017 shows a severe perf regression in YARN compared to 1.6.1.
>>
>> On Thu, Jun 16, 2016 at 9:49 PM, Reynold Xin  wrote:
>> > Please vote on releasing the following candidate as Apache Spark version
>> > 1.6.2!
>> >
>> > The vote is open until Sunday, June 19, 2016 at 22:00 PDT and passes if
>> > a
>> > majority of at least 3+1 PMC votes are cast.
>> >
>> > [ ] +1 Release this package as Apache Spark 1.6.2
>> > [ ] -1 Do not release this package because ...
>> >
>> >
>> > The tag to be voted on is v1.6.2-rc1
>> > (4168d9c94a9564f6b3e62f5d669acde13a7c7cf6)
>> >
>> > The release files, including signatures, digests, etc. can be found at:
>> > https://home.apache.org/~pwendell/spark-releases/spark-1.6.2-rc1-bin/
>> >
>> > Release artifacts are signed with the following key:
>> > https://people.apache.org/keys/committer/pwendell.asc
>> >
>> > The staging repository for this release can be found at:
>> > https://repository.apache.org/content/repositories/orgapachespark-1184
>> >
>> > The documentation corresponding to this release can be found at:
>> > https://home.apache.org/~pwendell/spark-releases/spark-1.6.2-rc1-docs/
>> >
>> >
>> > ===
>> > == How can I help test this release? ==
>> > ===
>> > If you are a Spark user, you can help us test this release by taking an
>> > existing Spark workload and running on this release candidate, then
>> > reporting any regressions from 1.6.1.
>> >
>> > 
>> > == What justifies a -1 vote for this release? ==
>> > 
>> > This is a maintenance release in the 1.6.x series.  Bugs already present
>> > in
>> > 1.6.1, missing features, or bugs related to new features will not
>> > necessarily block this release.
>> >
>>
>>
>>
>> --
>> Marcelo
>>
>> -
>> To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
>> For additional commands, e-mail: dev-h...@spark.apache.org
>>
>

-
To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
For additional commands, e-mail: dev-h...@spark.apache.org



Re: [VOTE] Release Apache Spark 1.6.2 (RC1)

2016-06-18 Thread Reynold Xin
Looks like that's resolved now.

I will wait till Sunday to cut rc2 to give people more time to find issues
with rc1.


On Fri, Jun 17, 2016 at 10:58 AM, Marcelo Vanzin 
wrote:

> -1 (non-binding)
>
> SPARK-16017 shows a severe perf regression in YARN compared to 1.6.1.
>
> On Thu, Jun 16, 2016 at 9:49 PM, Reynold Xin  wrote:
> > Please vote on releasing the following candidate as Apache Spark version
> > 1.6.2!
> >
> > The vote is open until Sunday, June 19, 2016 at 22:00 PDT and passes if a
> > majority of at least 3+1 PMC votes are cast.
> >
> > [ ] +1 Release this package as Apache Spark 1.6.2
> > [ ] -1 Do not release this package because ...
> >
> >
> > The tag to be voted on is v1.6.2-rc1
> > (4168d9c94a9564f6b3e62f5d669acde13a7c7cf6)
> >
> > The release files, including signatures, digests, etc. can be found at:
> > https://home.apache.org/~pwendell/spark-releases/spark-1.6.2-rc1-bin/
> >
> > Release artifacts are signed with the following key:
> > https://people.apache.org/keys/committer/pwendell.asc
> >
> > The staging repository for this release can be found at:
> > https://repository.apache.org/content/repositories/orgapachespark-1184
> >
> > The documentation corresponding to this release can be found at:
> > https://home.apache.org/~pwendell/spark-releases/spark-1.6.2-rc1-docs/
> >
> >
> > ===
> > == How can I help test this release? ==
> > ===
> > If you are a Spark user, you can help us test this release by taking an
> > existing Spark workload and running on this release candidate, then
> > reporting any regressions from 1.6.1.
> >
> > 
> > == What justifies a -1 vote for this release? ==
> > 
> > This is a maintenance release in the 1.6.x series.  Bugs already present
> in
> > 1.6.1, missing features, or bugs related to new features will not
> > necessarily block this release.
> >
>
>
>
> --
> Marcelo
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
> For additional commands, e-mail: dev-h...@spark.apache.org
>
>


Re: [VOTE] Release Apache Spark 1.6.2 (RC1)

2016-06-17 Thread Ted Yu
Docker Integration Tests failed on Linux:

http://pastebin.com/Ut51aRV3

Here was the command I used:

mvn clean -Phive -Phive-thriftserver -Pyarn -Phadoop-2.6 -Psparkr
-Dhadoop.version=2.7.0 package

Has anyone seen similar error ?

Thanks

On Thu, Jun 16, 2016 at 9:49 PM, Reynold Xin  wrote:

> Please vote on releasing the following candidate as Apache Spark version
> 1.6.2!
>
> The vote is open until Sunday, June 19, 2016 at 22:00 PDT and passes if a
> majority of at least 3+1 PMC votes are cast.
>
> [ ] +1 Release this package as Apache Spark 1.6.2
> [ ] -1 Do not release this package because ...
>
>
> The tag to be voted on is v1.6.2-rc1
> (4168d9c94a9564f6b3e62f5d669acde13a7c7cf6)
>
> The release files, including signatures, digests, etc. can be found at:
> https://home.apache.org/~pwendell/spark-releases/spark-1.6.2-rc1-bin/
>
> Release artifacts are signed with the following key:
> https://people.apache.org/keys/committer/pwendell.asc
>
> The staging repository for this release can be found at:
> https://repository.apache.org/content/repositories/orgapachespark-1184
>
> The documentation corresponding to this release can be found at:
> https://home.apache.org/~pwendell/spark-releases/spark-1.6.2-rc1-docs/
>
>
> ===
> == How can I help test this release? ==
> ===
> If you are a Spark user, you can help us test this release by taking an
> existing Spark workload and running on this release candidate, then
> reporting any regressions from 1.6.1.
>
> 
> == What justifies a -1 vote for this release? ==
> 
> This is a maintenance release in the 1.6.x series.  Bugs already present
> in 1.6.1, missing features, or bugs related to new features will not
> necessarily block this release.
>
>


Re: [VOTE] Release Apache Spark 1.6.2 (RC1)

2016-06-17 Thread Marcelo Vanzin
-1 (non-binding)

SPARK-16017 shows a severe perf regression in YARN compared to 1.6.1.

On Thu, Jun 16, 2016 at 9:49 PM, Reynold Xin  wrote:
> Please vote on releasing the following candidate as Apache Spark version
> 1.6.2!
>
> The vote is open until Sunday, June 19, 2016 at 22:00 PDT and passes if a
> majority of at least 3+1 PMC votes are cast.
>
> [ ] +1 Release this package as Apache Spark 1.6.2
> [ ] -1 Do not release this package because ...
>
>
> The tag to be voted on is v1.6.2-rc1
> (4168d9c94a9564f6b3e62f5d669acde13a7c7cf6)
>
> The release files, including signatures, digests, etc. can be found at:
> https://home.apache.org/~pwendell/spark-releases/spark-1.6.2-rc1-bin/
>
> Release artifacts are signed with the following key:
> https://people.apache.org/keys/committer/pwendell.asc
>
> The staging repository for this release can be found at:
> https://repository.apache.org/content/repositories/orgapachespark-1184
>
> The documentation corresponding to this release can be found at:
> https://home.apache.org/~pwendell/spark-releases/spark-1.6.2-rc1-docs/
>
>
> ===
> == How can I help test this release? ==
> ===
> If you are a Spark user, you can help us test this release by taking an
> existing Spark workload and running on this release candidate, then
> reporting any regressions from 1.6.1.
>
> 
> == What justifies a -1 vote for this release? ==
> 
> This is a maintenance release in the 1.6.x series.  Bugs already present in
> 1.6.1, missing features, or bugs related to new features will not
> necessarily block this release.
>



-- 
Marcelo

-
To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
For additional commands, e-mail: dev-h...@spark.apache.org



Re: [VOTE] Release Apache Spark 1.6.2 (RC1)

2016-06-17 Thread Jonathan Kelly
+1 (non-binding)

On Thu, Jun 16, 2016 at 9:49 PM Reynold Xin  wrote:

> Please vote on releasing the following candidate as Apache Spark version
> 1.6.2!
>
> The vote is open until Sunday, June 19, 2016 at 22:00 PDT and passes if a
> majority of at least 3+1 PMC votes are cast.
>
> [ ] +1 Release this package as Apache Spark 1.6.2
> [ ] -1 Do not release this package because ...
>
>
> The tag to be voted on is v1.6.2-rc1
> (4168d9c94a9564f6b3e62f5d669acde13a7c7cf6)
>
> The release files, including signatures, digests, etc. can be found at:
> https://home.apache.org/~pwendell/spark-releases/spark-1.6.2-rc1-bin/
>
> Release artifacts are signed with the following key:
> https://people.apache.org/keys/committer/pwendell.asc
>
> The staging repository for this release can be found at:
> https://repository.apache.org/content/repositories/orgapachespark-1184
>
> The documentation corresponding to this release can be found at:
> https://home.apache.org/~pwendell/spark-releases/spark-1.6.2-rc1-docs/
>
>
> ===
> == How can I help test this release? ==
> ===
> If you are a Spark user, you can help us test this release by taking an
> existing Spark workload and running on this release candidate, then
> reporting any regressions from 1.6.1.
>
> 
> == What justifies a -1 vote for this release? ==
> 
> This is a maintenance release in the 1.6.x series.  Bugs already present
> in 1.6.1, missing features, or bugs related to new features will not
> necessarily block this release.
>
>


[VOTE] Release Apache Spark 1.6.2 (RC1)

2016-06-16 Thread Reynold Xin
Please vote on releasing the following candidate as Apache Spark version
1.6.2!

The vote is open until Sunday, June 19, 2016 at 22:00 PDT and passes if a
majority of at least 3+1 PMC votes are cast.

[ ] +1 Release this package as Apache Spark 1.6.2
[ ] -1 Do not release this package because ...


The tag to be voted on is v1.6.2-rc1
(4168d9c94a9564f6b3e62f5d669acde13a7c7cf6)

The release files, including signatures, digests, etc. can be found at:
https://home.apache.org/~pwendell/spark-releases/spark-1.6.2-rc1-bin/

Release artifacts are signed with the following key:
https://people.apache.org/keys/committer/pwendell.asc

The staging repository for this release can be found at:
https://repository.apache.org/content/repositories/orgapachespark-1184

The documentation corresponding to this release can be found at:
https://home.apache.org/~pwendell/spark-releases/spark-1.6.2-rc1-docs/


===
== How can I help test this release? ==
===
If you are a Spark user, you can help us test this release by taking an
existing Spark workload and running on this release candidate, then
reporting any regressions from 1.6.1.


== What justifies a -1 vote for this release? ==

This is a maintenance release in the 1.6.x series.  Bugs already present in
1.6.1, missing features, or bugs related to new features will not
necessarily block this release.