[ 
https://issues.apache.org/jira/browse/FLINK-25200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17480904#comment-17480904
 ] 

Yun Tang commented on FLINK-25200:
----------------------------------

[~pnowojski] From my knowledge, S3 will involve copy on server side if calling 
#copyObject, which cannot be really fast. And OSS would use [shallow 
copy|https://issues.apache.org/jira/browse/HADOOP-15323] for normal foramt file 
under 32MB or multipat format file, which could finish the copying within 
hundreds of milliseconds (can achive 10 millisecond at least), which deserves 
to be implemented first.

> Implement duplicating for s3 filesystem
> ---------------------------------------
>
>                 Key: FLINK-25200
>                 URL: https://issues.apache.org/jira/browse/FLINK-25200
>             Project: Flink
>          Issue Type: Sub-task
>          Components: FileSystems
>            Reporter: Dawid Wysakowicz
>            Priority: Major
>             Fix For: 1.15.0
>
>
> We can use https://docs.aws.amazon.com/AmazonS3/latest/API/API_CopyObject.html



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to