MartijnVisser opened a new pull request, #29821:
URL: https://github.com/apache/flink/pull/29821
## What is the purpose of the change
The Azure, OSS and GCS filesystems bundle Hadoop 3.3.4, which fails on Java
23 and later with `getSubject is not supported` (HADOOP-19212). This is the
part of #27026 by @ctrlaltdilj that doesn't depend on the AWS SDK v2 migration;
the S3 part follows in a separate PR.
## Brief change log
- `fs.hadoopshaded.version` is 3.4.3; flink-s3-fs-base, flink-s3-fs-hadoop
and flink-s3-fs-presto keep 3.3.4 until FLINK-30975
- flink-fs-hadoop-shaded excludes jersey-json and Netty, which
hadoop-common 3.4 declares but doesn't use
- flink-azure-fs-hadoop bundles jackson-core and jackson-databind, which
hadoop-azure 3.4 no longer pulls in, and drops module-info.class like
flink-fs-hadoop-shaded already does (hadoop-shaded-guava 1.5.0 has one that
breaks the javadoc build)
- NOTICE files updated
## Verifying this change
This change is already covered by existing tests: the
flink-fs-hadoop-shaded, flink-azure-fs-hadoop, flink-oss-fs-hadoop and
flink-gs-fs-hadoop tests pass on Java 17, 21 (`-Pjava21-target`) and 25. On
Java 25, master fails AzureBlobFsRecoverableDataOutputStreamTest with the
getSubject error.
A test dependency hides the missing Jackson from the Azure tests, so I also
created each filesystem from its plugin jar on Java 17, 21 and 25. The OSS
writer tests need credentials, so they were skipped.
## Does this pull request potentially affect one of the following parts:
- Dependencies (does it add or upgrade a dependency): yes
- The public API, i.e., is any changed class annotated with
`@Public(Evolving)`: no
- The serializers: no
- The runtime per-record code paths (performance sensitive): no
- Anything that affects deployment or recovery: JobManager (and its
components), Checkpointing, Kubernetes/Yarn, ZooKeeper: no
- The S3 file system connector: no
## Documentation
- Does this pull request introduce a new feature? no
- If yes, how is the feature documented? not applicable
---
##### Was generative AI tooling used to co-author this PR?
- [X] Yes (please specify the tool below)
Generated-by: Claude Code (Claude Opus 5.5)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
