Re: [VOTE] Release Apache Spark 2.3.4 (RC1)

2019-08-27 Thread Wenchen Fan
+1 On Wed, Aug 28, 2019 at 2:43 AM DB Tsai wrote: > +1 > > Sincerely, > > DB Tsai > -- > Web: https://www.dbtsai.com > PGP Key ID: 42E5B25A8F7A82C1 > > On Tue, Aug 27, 2019 at 11:31 AM Dongjoon Hyun > wrote: > > > > +1. > > > > I also

Re: Apply for JIRA permission

2019-08-27 Thread Dongjoon Hyun
Hi, Hefei. You can file a JIRA issue already. And, you will be added to the Apache Spark Contributor Jira group when the committers merge your PR and assign an JIRA issue to you. For more information, please see https://spark.apache.org/contributing.html . You can make a PR to Apache Spark

Re: [VOTE] Release Apache Spark 2.4.4 (RC3)

2019-08-27 Thread Dongjoon Hyun
+1. - Checked checksums and signatures of artifacts. - Checked to have all binaries and maven repo. - Checked document generation (including a new change after RC2) - Build with `-Pyarn -Pmesos -Pkubernetes -Phive -Phive-thriftserver -Phadoop-2.6` on AdoptOpenJDK8_202. - Tested with both

Apply for JIRA permission

2019-08-27 Thread Hefei Li
Hi guys, I want to contribute to Apache Spark. Would you please give me the permission as a contributor ? My JIRA username is *lhfei *. === Best Regards Hefei LiHefei Li MP: +86 18701581473 MSN: lh...@live.cn ===

[VOTE] Release Apache Spark 2.4.4 (RC3)

2019-08-27 Thread Dongjoon Hyun
Please vote on releasing the following candidate as Apache Spark version 2.4.4. The vote is open until August 30th 5PM PST and passes if a majority +1 PMC votes are cast, with a minimum of 3 +1 votes. [ ] +1 Release this package as Apache Spark 2.4.4 [ ] -1 Do not release this package because

Re: [DISCUSSION]JDK11 for Apache 2.x?

2019-08-27 Thread Sean Owen
Spark 3 will not require Java 11; it will work with Java 8 too. I think the question is whether someone who _wants_ Java 11 should have a 2.x release instead of 3.0. In practice... how much are people moving off Java 8 right now? It's still my default, because most but not all things work with

Re: [DISCUSSION]JDK11 for Apache 2.x?

2019-08-27 Thread Jean Georges Perrin
Not a contributor, but a user perspective… As Spark 3.x will be an evolution, I am not completely shocked that it would imply a Java 11 requirement as well. Would be great to have both Java 8 and Java 11, but one needs to be able to say goodbye. Java 8 is great, still using it actively in

Re: [VOTE] Release Apache Spark 2.4.4 (RC2)

2019-08-27 Thread Dongjoon Hyun
Hi, All. Thank you for testing. 2.4.4 RC2 vote fails due to the PySpark correctness issue. Since the blocker is merged, I'll start RC3 soon. Bests, Dongjoon. On Mon, Aug 26, 2019 at 10:55 PM Hyukjin Kwon wrote: > -1 > > Seems there's one critical correctness issue specifically in branch-2.4

Re: [DISCUSSION]JDK11 for Apache 2.x?

2019-08-27 Thread Sean Owen
I think one of the key problems here are the required dependency upgrades. It would mean many minor breaking changes and a few bigger ones, notably around Hive, and forces a scala 2.12-only update. I think my question is whether that even makes sense as a minor release? it wouldn't be backwards

Re: [DISCUSSION]JDK11 for Apache 2.x?

2019-08-27 Thread Holden Karau
On Tue, Aug 27, 2019 at 12:01 PM DB Tsai wrote: > Hello everyone, > > Thank you all for working on supporting JDK11 in Apache Spark 3.0 as a > community. > > Java 8 is already end of life for commercial users, and many companies are > moving to Java 11. > The release date for Apache Spark 3.0 is

[DISCUSSION]JDK11 for Apache 2.x?

2019-08-27 Thread DB Tsai
Hello everyone, Thank you all for working on supporting JDK11 in Apache Spark 3.0 as a community. Java 8 is already end of life for commercial users, and many companies are moving to Java 11. The release date for Apache Spark 3.0 is still not there yet, and there are many API

Re: [VOTE] Release Apache Spark 2.3.4 (RC1)

2019-08-27 Thread DB Tsai
+1 Sincerely, DB Tsai -- Web: https://www.dbtsai.com PGP Key ID: 42E5B25A8F7A82C1 On Tue, Aug 27, 2019 at 11:31 AM Dongjoon Hyun wrote: > > +1. > > I also verified SHA/GPG and tested UTs on AdoptOpenJDKu8_222/CentOS6.9 with > profile >

Re: [VOTE] Release Apache Spark 2.3.4 (RC1)

2019-08-27 Thread Dongjoon Hyun
+1. I also verified SHA/GPG and tested UTs on AdoptOpenJDKu8_222/CentOS6.9 with profile "-Pyarn -Phadoop-2.7 -Pkubernetes -Pkinesis-asl -Phive -Phive-thriftserver" Additionally, JDBC IT also is tested. Thank you, Kazuaki! Bests, Dongjoon. On Tue, Aug 27, 2019 at 11:20 AM Sean Owen wrote: >

Re: [VOTE] Release Apache Spark 2.3.4 (RC1)

2019-08-27 Thread Sean Owen
+1 - license and signature looks OK, the docs look OK, the artifacts seem to be in order. Tests passed for me when building from source with most common profiles set. On Mon, Aug 26, 2019 at 3:28 PM Kazuaki Ishizaki wrote: > > Please vote on releasing the following candidate as Apache Spark

Re: JDK11 Support in Apache Spark

2019-08-27 Thread Hyukjin Kwon
YaY! 2019년 8월 27일 (화) 오후 3:36, Dongjoon Hyun 님이 작성: > Hi, All. > > Thank you for your attention! > > UPDATE: We succeeded to build with JDK8 and test with JDK11. > > - https://github.com/apache/spark/pull/25587 > - >

Re: JDK11 Support in Apache Spark

2019-08-27 Thread Dongjoon Hyun
Hi, All. Thank you for your attention! UPDATE: We succeeded to build with JDK8 and test with JDK11. - https://github.com/apache/spark/pull/25587 - https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4842 (Scala/Java/Python/R) We are ready to release Maven artifacts as