Thank you all!
Let me add more explanation on the current status.
- If you want to run on JDK8, you need to build on JDK8
- If you want to run on JDK11, you need to build on JDK11.
The other combinations will not work.
Currently, we have two Jenkins jobs. (1) is the one I pointed, and (2) is
the one for the remaining community work.
1) Build and test on JDK11 (spark-master-test-maven-hadoop-3.2-jdk-11)
2) Build on JDK8 and test on JDK11
(spark-master-test-maven-hadoop-2.7-jdk-11-ubuntu-testing)
To keep JDK11 compatibility, the following is merged today.
[SPARK-28701][TEST-HADOOP3.2][TEST-JAVA11][K8S] adding java11
support for pull request builds
But, we still have many stuffs to do for Jenkins/Release and we need your
support about JDK11. :)
Bests,
Dongjoon.
On Sun, Aug 25, 2019 at 10:30 PM Takeshi Yamamuro <[email protected]>
wrote:
> Cool, congrats!
>
> Bests,
> Takeshi
>
> On Mon, Aug 26, 2019 at 1:01 PM Hichame El Khalfi <[email protected]>
> wrote:
>
>> That's Awesome !!!
>>
>> Thanks to everyone that made this possible :cheers:
>>
>> Hichame
>>
>> *From:* [email protected]
>> *Sent:* August 25, 2019 10:43 PM
>> *To:* [email protected]
>> *Cc:* [email protected]; [email protected];
>> [email protected]; [email protected]; [email protected]
>> *Subject:* Re: JDK11 Support in Apache Spark
>>
>> Great work!
>>
>> On Sun, Aug 25, 2019 at 6:03 AM Xiao Li <[email protected]> wrote:
>>
>>> Thank you for your contributions! This is a great feature for Spark
>>> 3.0! We finally achieve it!
>>>
>>> Xiao
>>>
>>> On Sat, Aug 24, 2019 at 12:18 PM Felix Cheung <[email protected]>
>>> wrote:
>>>
>>>> That’s great!
>>>>
>>>> ------------------------------
>>>> *From:* ☼ R Nair <[email protected]>
>>>> *Sent:* Saturday, August 24, 2019 10:57:31 AM
>>>> *To:* Dongjoon Hyun <[email protected]>
>>>> *Cc:* [email protected] <[email protected]>; user @spark/'user
>>>> @spark'/spark users/user@spark <[email protected]>
>>>> *Subject:* Re: JDK11 Support in Apache Spark
>>>>
>>>> Finally!!! Congrats
>>>>
>>>> On Sat, Aug 24, 2019, 11:11 AM Dongjoon Hyun <[email protected]>
>>>> wrote:
>>>>
>>>>> Hi, All.
>>>>>
>>>>> Thanks to your many many contributions,
>>>>> Apache Spark master branch starts to pass on JDK11 as of today.
>>>>> (with `hadoop-3.2` profile: Apache Hadoop 3.2 and Hive 2.3.6)
>>>>>
>>>>>
>>>>> https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-master-test-maven-hadoop-3.2-jdk-11/326/
>>>>> (JDK11 is used for building and testing.)
>>>>>
>>>>> We already verified all UTs (including PySpark/SparkR) before.
>>>>>
>>>>> Please feel free to use JDK11 in order to build/test/run `master`
>>>>> branch and
>>>>> share your experience including any issues. It will help Apache Spark
>>>>> 3.0.0 release.
>>>>>
>>>>> For the follow-ups, please follow
>>>>> https://issues.apache.org/jira/browse/SPARK-24417 .
>>>>> The next step is `how to support JDK8/JDK11 together in a single
>>>>> artifact`.
>>>>>
>>>>> Bests,
>>>>> Dongjoon.
>>>>>
>>>>
>>>
>>> --
>>> [image: Databricks Summit - Watch the talks]
>>> <https://databricks.com/sparkaisummit/north-america>
>>>
>>
>
> --
> ---
> Takeshi Yamamuro
>
