maybe in the future, but not right now as the hadoop 2.7 build is broken. also, i busted dev/run-tests.py in my changes to support java11 in PRBs: https://github.com/apache/spark/pull/25585
quick fix, testing now. On Mon, Aug 26, 2019 at 10:23 AM Reynold Xin <[email protected]> wrote: > Would it be possible to have one build that works for both? > > On Mon, Aug 26, 2019 at 10:22 AM Dongjoon Hyun <[email protected]> > wrote: > >> Thank you all! >> >> Let me add more explanation on the current status. >> >> - If you want to run on JDK8, you need to build on JDK8 >> - If you want to run on JDK11, you need to build on JDK11. >> >> The other combinations will not work. >> >> Currently, we have two Jenkins jobs. (1) is the one I pointed, and (2) is >> the one for the remaining community work. >> >> 1) Build and test on JDK11 (spark-master-test-maven-hadoop-3.2-jdk-11) >> 2) Build on JDK8 and test on JDK11 >> (spark-master-test-maven-hadoop-2.7-jdk-11-ubuntu-testing) >> >> To keep JDK11 compatibility, the following is merged today. >> >> [SPARK-28701][TEST-HADOOP3.2][TEST-JAVA11][K8S] adding java11 >> support for pull request builds >> >> But, we still have many stuffs to do for Jenkins/Release and we need your >> support about JDK11. :) >> >> Bests, >> Dongjoon. >> >> >> On Sun, Aug 25, 2019 at 10:30 PM Takeshi Yamamuro <[email protected]> >> wrote: >> >>> Cool, congrats! >>> >>> Bests, >>> Takeshi >>> >>> On Mon, Aug 26, 2019 at 1:01 PM Hichame El Khalfi <[email protected]> >>> wrote: >>> >>>> That's Awesome !!! >>>> >>>> Thanks to everyone that made this possible :cheers: >>>> >>>> Hichame >>>> >>>> *From:* [email protected] >>>> *Sent:* August 25, 2019 10:43 PM >>>> *To:* [email protected] >>>> *Cc:* [email protected]; [email protected]; >>>> [email protected]; [email protected]; [email protected] >>>> *Subject:* Re: JDK11 Support in Apache Spark >>>> >>>> Great work! >>>> >>>> On Sun, Aug 25, 2019 at 6:03 AM Xiao Li <[email protected]> wrote: >>>> >>>>> Thank you for your contributions! This is a great feature for Spark >>>>> 3.0! We finally achieve it! >>>>> >>>>> Xiao >>>>> >>>>> On Sat, Aug 24, 2019 at 12:18 PM Felix Cheung < >>>>> [email protected]> wrote: >>>>> >>>>>> That’s great! >>>>>> >>>>>> ------------------------------ >>>>>> *From:* ☼ R Nair <[email protected]> >>>>>> *Sent:* Saturday, August 24, 2019 10:57:31 AM >>>>>> *To:* Dongjoon Hyun <[email protected]> >>>>>> *Cc:* [email protected] <[email protected]>; user @spark/'user >>>>>> @spark'/spark users/user@spark <[email protected]> >>>>>> *Subject:* Re: JDK11 Support in Apache Spark >>>>>> >>>>>> Finally!!! Congrats >>>>>> >>>>>> On Sat, Aug 24, 2019, 11:11 AM Dongjoon Hyun <[email protected]> >>>>>> wrote: >>>>>> >>>>>>> Hi, All. >>>>>>> >>>>>>> Thanks to your many many contributions, >>>>>>> Apache Spark master branch starts to pass on JDK11 as of today. >>>>>>> (with `hadoop-3.2` profile: Apache Hadoop 3.2 and Hive 2.3.6) >>>>>>> >>>>>>> >>>>>>> https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-master-test-maven-hadoop-3.2-jdk-11/326/ >>>>>>> (JDK11 is used for building and testing.) >>>>>>> >>>>>>> We already verified all UTs (including PySpark/SparkR) before. >>>>>>> >>>>>>> Please feel free to use JDK11 in order to build/test/run `master` >>>>>>> branch and >>>>>>> share your experience including any issues. It will help Apache >>>>>>> Spark 3.0.0 release. >>>>>>> >>>>>>> For the follow-ups, please follow >>>>>>> https://issues.apache.org/jira/browse/SPARK-24417 . >>>>>>> The next step is `how to support JDK8/JDK11 together in a single >>>>>>> artifact`. >>>>>>> >>>>>>> Bests, >>>>>>> Dongjoon. >>>>>>> >>>>>> >>>>> >>>>> -- >>>>> [image: Databricks Summit - Watch the talks] >>>>> <https://databricks.com/sparkaisummit/north-america> >>>>> >>>> >>> >>> -- >>> --- >>> Takeshi Yamamuro >>> >> -- Shane Knapp UC Berkeley EECS Research / RISELab Staff Technical Lead https://rise.cs.berkeley.edu
