[
https://issues.apache.org/jira/browse/HADOOP-16604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16944262#comment-16944262
]
Rajesh Balamohan commented on HADOOP-16604:
-------------------------------------------
Thanks for sharing the details [~ste...@apache.org] . Initial step is to enable
copyFile(URI, URI) for S3AFileSystem. I have created a subtask for this. This
is for copying single file to destination and higher level apps can make use of
the API to parallelize copy. In next iterations, we can provide parallel copy
option within FS itself.
> Provide copy functionality for cloud native applications
> --------------------------------------------------------
>
> Key: HADOOP-16604
> URL: https://issues.apache.org/jira/browse/HADOOP-16604
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs, fs/azure, fs/s3
> Affects Versions: 3.2.1
> Reporter: Rajesh Balamohan
> Priority: Major
>
> Lot of cloud native systems provide out of the box and optimized copy
> functionality within their system. They avoid bringing data over to the
> client and write back to the destination.
> It would be good to have a cloud native interface, which can be implemented
> by the cloud connectors to provide (e.g {{copy(URI srcFile, URI destFile)}})
> This would be helpful for applications which make use of these connectors and
> enhance copy performance within cloud.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
