[
https://issues.apache.org/jira/browse/SPARK-37264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kousuke Saruta updated SPARK-37264:
-----------------------------------
Description:
Like hadoop-common and hadoop-hdfs, this PR proposes to exclude
hadoop-client-api transitive dependency from orc-core.
Why are the changes needed?
Since Apache Hadoop 2.7 doesn't work on Java 17, Apache ORC has a dependency on
Hadoop 3.3.1.
This causes test-dependencies.sh failure on Java 17. As a result, run-tests.py
also fails.
was:
In the current master, `run-tests.py` fails on Java 17 due to
`test-dependencies.sh` fails. The cause is orc-shims:1.7.1 has a compile
dependency on hadoop-client-api:3.3.1 only for Java 17.
Hadoop 2.7 doesn't support Java 17 so let's
> [SPARK-37264][BUILD] Exclude hadoop-client-api transitive dependency from
> orc-core
> ----------------------------------------------------------------------------------
>
> Key: SPARK-37264
> URL: https://issues.apache.org/jira/browse/SPARK-37264
> Project: Spark
> Issue Type: Sub-task
> Components: Build
> Affects Versions: 3.3.0
> Reporter: Kousuke Saruta
> Assignee: Kousuke Saruta
> Priority: Minor
>
> Like hadoop-common and hadoop-hdfs, this PR proposes to exclude
> hadoop-client-api transitive dependency from orc-core.
> Why are the changes needed?
> Since Apache Hadoop 2.7 doesn't work on Java 17, Apache ORC has a dependency
> on Hadoop 3.3.1.
> This causes test-dependencies.sh failure on Java 17. As a result,
> run-tests.py also fails.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
