[
https://issues.apache.org/jira/browse/HDDS-9598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chung En Lee updated HDDS-9598:
-------------------------------
Description:
emphasized textCurrent ozone does not have flexibility to concatenating the
files. We have multipart upload functionality in place and it does merging at
server at the end of the upload. So, we should be able to reuse most that
functionality at server to implement merge functionality.
Since Ozone semantics are like visible only after key commit, it would be good
to have this merge option for file system users to create smaller files and
merge. So, that they don't need to retry bugger size(say 10GB) files upload in
full. They can split into smaller file and try. Once all smaller file uploads
done, they can use merge functionality to create targeted file.
was:
Current ozone does not have flexibility to concatenating the files. We have
multipart upload functionality in place and it does merging at server at the
end of the upload. So, we should be able to reuse most that functionality at
server to implement merge functionality.
Since Ozone semantics are like visible only after key commit, it would be good
to have this merge option for file system users to create smaller files and
merge. So, that they don't need to retry bugger size(say 10GB) files upload in
full. They can split into smaller file and try. Once all smaller file uploads
done, they can use merge functionality to create targeted file.
> Support merge API in Ozone File System
> --------------------------------------
>
> Key: HDDS-9598
> URL: https://issues.apache.org/jira/browse/HDDS-9598
> Project: Apache Ozone
> Issue Type: New Feature
> Affects Versions: 1.3.0
> Reporter: Uma Maheswara Rao G
> Priority: Major
>
> emphasized textCurrent ozone does not have flexibility to concatenating the
> files. We have multipart upload functionality in place and it does merging at
> server at the end of the upload. So, we should be able to reuse most that
> functionality at server to implement merge functionality.
>
> Since Ozone semantics are like visible only after key commit, it would be
> good to have this merge option for file system users to create smaller files
> and merge. So, that they don't need to retry bugger size(say 10GB) files
> upload in full. They can split into smaller file and try. Once all smaller
> file uploads done, they can use merge functionality to create targeted file.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
