Re: JDK11 Support in Apache Spark

2019-08-27 Thread Hyukjin Kwon
YaY! 2019년 8월 27일 (화) 오후 3:36, Dongjoon Hyun 님이 작성: > Hi, All. > > Thank you for your attention! > > UPDATE: We succeeded to build with JDK8 and test with JDK11. > > - https://github.com/apache/spark/pull/25587 > - >

Re: JDK11 Support in Apache Spark

2019-08-27 Thread Dongjoon Hyun
Hi, All. Thank you for your attention! UPDATE: We succeeded to build with JDK8 and test with JDK11. - https://github.com/apache/spark/pull/25587 - https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4842 (Scala/Java/Python/R) We are ready to release Maven artifacts as

Re: JDK11 Support in Apache Spark

2019-08-26 Thread Sean Owen
>>> Takeshi >>> >>> On Mon, Aug 26, 2019 at 1:01 PM Hichame El Khalfi >>> wrote: >>> >>>> That's Awesome !!! >>>> >>>> Thanks to everyone that made this possible :cheers: >>>> >>>> Hichame >>>

Re: JDK11 Support in Apache Spark

2019-08-26 Thread Matei Zaharia
+1, it’s super messy without that. But great to see this running! > On Aug 26, 2019, at 10:53 AM, Reynold Xin wrote: > > Exactly - I think it's important to be able to create a single binary build. > Otherwise downstream users (the 99.99% won't be building their own Spark but > just pull it

Re: JDK11 Support in Apache Spark

2019-08-26 Thread Reynold Xin
Exactly - I think it's important to be able to create a single binary build. Otherwise downstream users (the 99.99% won't be building their own Spark but just pull it from Maven) will have to deal with the mess, and it's even worse for libraries. On Mon, Aug 26, 2019 at 10:51 AM, Dongjoon Hyun

Re: JDK11 Support in Apache Spark

2019-08-26 Thread Dongjoon Hyun
Oh, right. If you want to publish something to Maven, it will inherit the situation. Thank you for feedback. :) On Mon, Aug 26, 2019 at 10:37 AM Michael Heuer wrote: > That is not true for any downstream users who also provide a library. > Whatever build mess you create in Apache Spark, we'll

Re: JDK11 Support in Apache Spark

2019-08-26 Thread Michael Heuer
That is not true for any downstream users who also provide a library. Whatever build mess you create in Apache Spark, we'll have to inherit it. ;) michael > On Aug 26, 2019, at 12:32 PM, Dongjoon Hyun wrote: > > As Shane wrote, not yet. > > `one build for works for both` is our

Re: JDK11 Support in Apache Spark

2019-08-26 Thread Shane Knapp
t;>> Thanks to everyone that made this possible :cheers: >>>> >>>> Hichame >>>> >>>> *From:* cloud0...@gmail.com >>>> *Sent:* August 25, 2019 10:43 PM >>>> *To:* lix...@databricks.com >>>> *Cc:* felixcheun...@hotmail.

Re: JDK11 Support in Apache Spark

2019-08-26 Thread Reynold Xin
August 25, 2019 10:43 PM >>> *To:* lix...@databricks.com >>> *Cc:* felixcheun...@hotmail.com; ravishankar.n...@gmail.com; >>> dongjoon.h...@gmail.com; dev@spark.apache.org; u...@spark.apache.org >>> *Subject:* Re: JDK11 Support in Apache Spark >>

Re: JDK11 Support in Apache Spark

2019-08-26 Thread Dongjoon Hyun
:43 PM >> *To:* lix...@databricks.com >> *Cc:* felixcheun...@hotmail.com; ravishankar.n...@gmail.com; >> dongjoon.h...@gmail.com; dev@spark.apache.org; u...@spark.apache.org >> *Subject:* Re: JDK11 Support in Apache Spark >> >> Great work! >> >> On Sun, Au

Re: JDK11 Support in Apache Spark

2019-08-25 Thread Takeshi Yamamuro
icks.com > *Cc:* felixcheun...@hotmail.com; ravishankar.n...@gmail.com; > dongjoon.h...@gmail.com; dev@spark.apache.org; u...@spark.apache.org > *Subject:* Re: JDK11 Support in Apache Spark > > Great work! > > On Sun, Aug 25, 2019 at 6:03 AM Xiao Li wrote: > >>

Re: JDK11 Support in Apache Spark

2019-08-25 Thread Wenchen Fan
t; -- >> *From:* ☼ R Nair >> *Sent:* Saturday, August 24, 2019 10:57:31 AM >> *To:* Dongjoon Hyun >> *Cc:* dev@spark.apache.org ; user @spark/'user >> @spark'/spark users/user@spark >> *Subject:* Re: JDK11 Support in Apache Spar

Re: JDK11 Support in Apache Spark

2019-08-24 Thread Xiao Li
To:* Dongjoon Hyun > *Cc:* dev@spark.apache.org ; user @spark/'user > @spark'/spark users/user@spark > *Subject:* Re: JDK11 Support in Apache Spark > > Finally!!! Congrats > > On Sat, Aug 24, 2019, 11:11 AM Dongjoon Hyun > wrote: > >> Hi, All. >> >>

Re: JDK11 Support in Apache Spark

2019-08-24 Thread Felix Cheung
That’s great! From: ☼ R Nair Sent: Saturday, August 24, 2019 10:57:31 AM To: Dongjoon Hyun Cc: dev@spark.apache.org ; user @spark/'user @spark'/spark users/user@spark Subject: Re: JDK11 Support in Apache Spark Finally!!! Congrats On Sat, Aug 24, 2019, 11:11

Re: JDK11 Support in Apache Spark

2019-08-24 Thread DB Tsai
Congratulations on the great work! Sincerely, DB Tsai -- Web: https://www.dbtsai.com PGP Key ID: 42E5B25A8F7A82C1 On Sat, Aug 24, 2019 at 8:11 AM Dongjoon Hyun wrote: > > Hi, All. > > Thanks to your many many contributions, > Apache Spark

JDK11 Support in Apache Spark

2019-08-24 Thread Dongjoon Hyun
Hi, All. Thanks to your many many contributions, Apache Spark master branch starts to pass on JDK11 as of today. (with `hadoop-3.2` profile: Apache Hadoop 3.2 and Hive 2.3.6)