[
https://issues.apache.org/jira/browse/HADOOP-12756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15383693#comment-15383693
]
uncleGen edited comment on HADOOP-12756 at 7/19/16 7:08 AM:
------------------------------------------------------------
[~shimingfei] IMHO, when do 'multipartUploadObject' operation in class
'AliyunOSSOutputStream', the part number is less than or equal to 10000, so the
part size need to be limited by 'fs.oss.multipart.upload.size' and part number
upper limit (now is 10000). See the doc
[here|https://help.aliyun.com/document_detail/31993.html?spm=5176.product31815.6.265.iPB9WC].
was (Author: unclegen):
[~shimingfei] IMHO, when do 'multipartUploadObject' operation in class
'AliyunOSSOutputStream', the part number is less than or equal to 10000, so the
part size need to be limited by 'fs.oss.multipart.upload.size' and part number
upper limit (now is 10000). See the doc
[here](https://help.aliyun.com/document_detail/31993.html?spm=5176.product31815.6.265.iPB9WC).
> Incorporate Aliyun OSS file system implementation
> -------------------------------------------------
>
> Key: HADOOP-12756
> URL: https://issues.apache.org/jira/browse/HADOOP-12756
> Project: Hadoop Common
> Issue Type: New Feature
> Components: fs
> Affects Versions: 2.8.0, HADOOP-12756
> Reporter: shimingfei
> Assignee: shimingfei
> Fix For: HADOOP-12756
>
> Attachments: HADOOP-12756-v02.patch, HADOOP-12756.003.patch,
> HADOOP-12756.004.patch, HADOOP-12756.005.patch, HADOOP-12756.006.patch, HCFS
> User manual.md, OSS integration.pdf, OSS integration.pdf
>
>
> Aliyun OSS is widely used among China’s cloud users, but currently it is not
> easy to access data laid on OSS storage from user’s Hadoop/Spark application,
> because of no original support for OSS in Hadoop.
> This work aims to integrate Aliyun OSS with Hadoop. By simple configuration,
> Spark/Hadoop applications can read/write data from OSS without any code
> change. Narrowing the gap between user’s APP and data storage, like what have
> been done for S3 in Hadoop
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
