Sylvia Lin created FLINK-31095:
----------------------------------
Summary: FileSink doesn't work with s3a on EKS
Key: FLINK-31095
URL: https://issues.apache.org/jira/browse/FLINK-31095
Project: Flink
Issue Type: Bug
Components: Connectors / FileSystem
Affects Versions: 1.16.1
Reporter: Sylvia Lin
FileSink gives below exception on AWS EKS cluster:
{code:java}
Caused by: java.lang.UnsupportedOperationException: This s3 file system
implementation does not support recoverable writers.
at
org.apache.flink.fs.s3.common.FlinkS3FileSystem.createRecoverableWriter(FlinkS3FileSystem.java:136)
~[?:?]
at
org.apache.flink.core.fs.PluginFileSystemFactory$ClassLoaderFixingFileSystem.createRecoverableWriter(PluginFileSystemFactory.java:134)
~[flink-dist-1.16.1.jar:1.16.1]
at
org.apache.flink.connector.file.sink.FileSink$RowFormatBuilder.createBucketWriter(FileSink.java:475)
~[flink-connector-files-1.16.1.jar:1.16.1]
at
org.apache.flink.connector.file.sink.FileSink$RowFormatBuilder.getCommittableSerializer(FileSink.java:466)
~[flink-connector-files-1.16.1.jar:1.16.1]
at
org.apache.flink.connector.file.sink.FileSink.getCommittableSerializer(FileSink.java:175)
~[flink-connector-files-1.16.1.jar:1.16.1]{code}
[https://github.com/apache/flink/blob/278dc7b793303d228f7816585054629708983af6/flink-filesystems/flink-s3-fs-base/src/main/java/org/apache/flink/fs/s3/common/FlinkS3FileSystem.java#LL136C16-L136C16]
And this may be related to
https://issues.apache.org/jira/browse/FLINK-23487?page=com.atlassian.jira.plugin.system.issuetabpanels%3Aall-tabpanel
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
