chinmayms opened a new pull request, #19540: URL: https://github.com/apache/flink/pull/19540
## What is the purpose of the change This PR upgrades flink-filesystems hadoop version to 3.3.2 and makes the necessary code changes as part of changes to constructors in hadoop 3.3.2 code. Context: We have a security requirement to client side encrypt flink state for certain flink applications that process sensitive data. One way to do it is to use flink-s3-fs-hadoop compiled against hadoop 3.3.2 for checkpoints as hadoop 3.3.2 provides out of the box AWS client side encryption using AWS KMS keys before writing the data to S3. (https://issues.apache.org/jira/browse/HADOOP-13887) ## Brief change log Change shaded hadoop version to 3.3.2 in flink-filesystems pom.xml Update arguments for methods connected to `WriteOperationHelper` since hadoop 3.3.2 introduces 3 new arguments to its constructor. ## Verifying this change This change is a trivial rework / code cleanup without any test coverage. Tested on flink jobs with jar flink-s3-fs-hadoop in checkpoint plugin path at Apple Flink Infrastructure for Flink version 1.14.3 ## Does this pull request potentially affect one of the following parts: - Dependencies (does it add or upgrade a dependency): (yes) - The public API, i.e., is any changed class annotated with `@Public(Evolving)`: (no) - The serializers: (no) - The runtime per-record code paths (performance sensitive): (no) - Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: (no) - The S3 file system connector: (yes) ## Documentation - Does this pull request introduce a new feature? (no) - If yes, how is the feature documented? (not documented) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
