[ 
https://issues.apache.org/jira/browse/SPARK-28765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Dongjoon Hyun updated SPARK-28765:
----------------------------------
    Description: 
SPARK-28737 removes `javax.annotation:javax.annotation-api:jar:1.2:compile` 
dependency. However, it occurs at JDK11 environment. This breaks our dependency 
manifest testing on JDK11 environment.
{code:java}
$ mvn dependency:tree -Dincludes=javax.annotation:javax.annotation-api 
-Phadoop-3.2 -Phive-thriftserver -Pmesos -Pkubernetes -Pyarn -Phive
...
[INFO] --- maven-dependency-plugin:3.1.1:tree (default-cli) @ 
spark-kubernetes_2.12 ---
[INFO] org.apache.spark:spark-kubernetes_2.12:jar:3.0.0-SNAPSHOT
[INFO] \- io.fabric8:kubernetes-client:jar:4.1.2:compile
[INFO]    \- io.fabric8:kubernetes-model:jar:4.1.2:compile
[INFO]       \- javax.annotation:javax.annotation-api:jar:1.2:compile
{code}

The other example is the following.
{code}
$ mvn dependency:tree -Dincludes=jakarta.activation:jakarta.activation-api 
-Phadoop-3.2 -Phive-thriftserver -Pmesos -Pkubernetes -Pyarn -Phive
...
[INFO] org.apache.spark:spark-catalyst_2.12:jar:3.0.0-SNAPSHOT
[INFO] \- org.apache.spark:spark-core_2.12:jar:3.0.0-SNAPSHOT:compile
[INFO]    \- org.glassfish.jersey.core:jersey-server:jar:2.29:compile
[INFO]       \- jakarta.xml.bind:jakarta.xml.bind-api:jar:2.3.2:compile
[INFO]          \- jakarta.activation:jakarta.activation-api:jar:1.2.1:compile
{code}


*JDK8*
{code}
$ cd resource-managers/kubernetes/core
$ mvn -X dependency:tree -Dincludes=jakarta.activation:jakarta.activation-api
...
[DEBUG]       org.glassfish.jersey.core:jersey-server:jar:2.29:compile (version 
managed from 2.22.2)
[DEBUG]          org.glassfish.jersey.media:jersey-media-jaxb:jar:2.29:compile
[DEBUG]          javax.validation:validation-api:jar:2.0.1.Final:compile
{code}

*JDK11*
{code}
$ cd resource-managers/kubernetes/core
$ mvn -X dependency:tree -Dincludes=jakarta.activation:jakarta.activation-api
...
[DEBUG]       org.glassfish.jersey.core:jersey-server:jar:2.29:compile (version 
managed from 2.22.2)
[DEBUG]          org.glassfish.jersey.media:jersey-media-jaxb:jar:2.29:compile
[DEBUG]          javax.validation:validation-api:jar:2.0.1.Final:compile
[DEBUG]          jakarta.xml.bind:jakarta.xml.bind-api:jar:2.3.2:compile
[DEBUG]             jakarta.activation:jakarta.activation-api:jar:1.2.1:compile
{code}

  was:
SPARK-28737 removes `javax.annotation:javax.annotation-api:jar:1.2:compile` 
dependency. However, it occurs at JDK11 environment. This breaks our dependency 
manifest testing on JDK11 environment.
{code:java}
$ mvn dependency:tree -Dincludes=javax.annotation:javax.annotation-api 
-Phadoop-3.2 -Phive-thriftserver -Pmesos -Pkubernetes -Pyarn -Phive
...
[INFO] --- maven-dependency-plugin:3.1.1:tree (default-cli) @ 
spark-kubernetes_2.12 ---
[INFO] org.apache.spark:spark-kubernetes_2.12:jar:3.0.0-SNAPSHOT
[INFO] \- io.fabric8:kubernetes-client:jar:4.1.2:compile
[INFO]    \- io.fabric8:kubernetes-model:jar:4.1.2:compile
[INFO]       \- javax.annotation:javax.annotation-api:jar:1.2:compile
{code}

The other example is the following.
{code}
$ mvn dependency:tree -Dincludes=jakarta.activation:jakarta.activation-api 
-Phadoop-3.2 -Phive-thriftserver -Pmesos -Pkubernetes -Pyarn -Phive
...
[INFO] org.apache.spark:spark-catalyst_2.12:jar:3.0.0-SNAPSHOT
[INFO] \- org.apache.spark:spark-core_2.12:jar:3.0.0-SNAPSHOT:compile
[INFO]    \- org.glassfish.jersey.core:jersey-server:jar:2.29:compile
[INFO]       \- jakarta.xml.bind:jakarta.xml.bind-api:jar:2.3.2:compile
[INFO]          \- jakarta.activation:jakarta.activation-api:jar:1.2.1:compile
{code}


> Dependency generation for JDK8/JDK11
> ------------------------------------
>
>                 Key: SPARK-28765
>                 URL: https://issues.apache.org/jira/browse/SPARK-28765
>             Project: Spark
>          Issue Type: Sub-task
>          Components: Build
>    Affects Versions: 3.0.0
>            Reporter: Dongjoon Hyun
>            Priority: Major
>
> SPARK-28737 removes `javax.annotation:javax.annotation-api:jar:1.2:compile` 
> dependency. However, it occurs at JDK11 environment. This breaks our 
> dependency manifest testing on JDK11 environment.
> {code:java}
> $ mvn dependency:tree -Dincludes=javax.annotation:javax.annotation-api 
> -Phadoop-3.2 -Phive-thriftserver -Pmesos -Pkubernetes -Pyarn -Phive
> ...
> [INFO] --- maven-dependency-plugin:3.1.1:tree (default-cli) @ 
> spark-kubernetes_2.12 ---
> [INFO] org.apache.spark:spark-kubernetes_2.12:jar:3.0.0-SNAPSHOT
> [INFO] \- io.fabric8:kubernetes-client:jar:4.1.2:compile
> [INFO]    \- io.fabric8:kubernetes-model:jar:4.1.2:compile
> [INFO]       \- javax.annotation:javax.annotation-api:jar:1.2:compile
> {code}
> The other example is the following.
> {code}
> $ mvn dependency:tree -Dincludes=jakarta.activation:jakarta.activation-api 
> -Phadoop-3.2 -Phive-thriftserver -Pmesos -Pkubernetes -Pyarn -Phive
> ...
> [INFO] org.apache.spark:spark-catalyst_2.12:jar:3.0.0-SNAPSHOT
> [INFO] \- org.apache.spark:spark-core_2.12:jar:3.0.0-SNAPSHOT:compile
> [INFO]    \- org.glassfish.jersey.core:jersey-server:jar:2.29:compile
> [INFO]       \- jakarta.xml.bind:jakarta.xml.bind-api:jar:2.3.2:compile
> [INFO]          \- jakarta.activation:jakarta.activation-api:jar:1.2.1:compile
> {code}
> *JDK8*
> {code}
> $ cd resource-managers/kubernetes/core
> $ mvn -X dependency:tree -Dincludes=jakarta.activation:jakarta.activation-api
> ...
> [DEBUG]       org.glassfish.jersey.core:jersey-server:jar:2.29:compile 
> (version managed from 2.22.2)
> [DEBUG]          org.glassfish.jersey.media:jersey-media-jaxb:jar:2.29:compile
> [DEBUG]          javax.validation:validation-api:jar:2.0.1.Final:compile
> {code}
> *JDK11*
> {code}
> $ cd resource-managers/kubernetes/core
> $ mvn -X dependency:tree -Dincludes=jakarta.activation:jakarta.activation-api
> ...
> [DEBUG]       org.glassfish.jersey.core:jersey-server:jar:2.29:compile 
> (version managed from 2.22.2)
> [DEBUG]          org.glassfish.jersey.media:jersey-media-jaxb:jar:2.29:compile
> [DEBUG]          javax.validation:validation-api:jar:2.0.1.Final:compile
> [DEBUG]          jakarta.xml.bind:jakarta.xml.bind-api:jar:2.3.2:compile
> [DEBUG]             
> jakarta.activation:jakarta.activation-api:jar:1.2.1:compile
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to