[ https://issues.apache.org/jira/browse/SPARK-26896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16769804#comment-16769804 ]
Imran Rashid commented on SPARK-26896: -------------------------------------- I posted a PR https://github.com/apache/spark/pull/23804 but thats really just for discussion & to help anybody else along, based on work I'm doing in a fork. Anyone is welcome to pick this task up. > Add maven profiles for running tests with JDK 11 > ------------------------------------------------ > > Key: SPARK-26896 > URL: https://issues.apache.org/jira/browse/SPARK-26896 > Project: Spark > Issue Type: Sub-task > Components: Build > Affects Versions: 3.0.0 > Reporter: Imran Rashid > Priority: Major > > Running unit tests w/ JDK 11 trips over some issues w/ the new module system. > These can be worked around with the new {{--add-opens}} etc. commands. I > think we need to add a build profile for JDK 11 to add some extra args to the > test runners. > In particular: > 1) removal of jaxb from java itself (used in pmml export in mllib) > 2) Some reflective access which results in failures, eg. > {noformat} > Unable to make field jdk.internal.ref.PhantomCleanable > jdk.internal.ref.PhantomCleanable.prev accessible: module java.base does > not "opens jdk.internal.ref" to unnamed module > {noformat} > 3) Some reflective access which results in warnings (you can add > {{--illegal-access=warn}} to see all of these). > All I'm proposing we do here is put in the required handling to make these > problems go away, not necessarily do the "right" thing by no longer > referencing these unexposed internals. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org