[
https://issues.apache.org/jira/browse/HADOOP-12756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15348804#comment-15348804
]
Chris Nauroth commented on HADOOP-12756:
----------------------------------------
bq. According to our previous discussion, a committer to prepare for committing
the codes (now the branch to merge) could run the tests using the way we do for
existing cloud modules. Sure for long term, we need to think about a perfect
solution for such live service integrations, look like Steve Loughran has
already some ideas and even work about this.
[~drankye], to clarify, I am asking that there be a way for committers who have
Aliyun cloud credentials to run the contract tests live against the real Aliyun
Object Storage Service. I am not demanding that we go beyond that (like a true
pre-commit solution) within the scope of the Aliyun integration effort.
Another way to think of this is that I am asking for the Aliyun integration
effort to provide equivalent testing support as our other supported alternative
file systems, like WASB and S3A. Currently, that means use of the standard
contract tests with a capability to configure credentials and run them from a
developer environment integrated with the corresponding back-end service.
Thank you!
> Incorporate Aliyun OSS file system implementation
> -------------------------------------------------
>
> Key: HADOOP-12756
> URL: https://issues.apache.org/jira/browse/HADOOP-12756
> Project: Hadoop Common
> Issue Type: New Feature
> Components: fs
> Affects Versions: 2.8.0
> Reporter: shimingfei
> Assignee: shimingfei
> Attachments: HADOOP-12756-v02.patch, HADOOP-12756.003.patch,
> HADOOP-12756.004.patch, HADOOP-12756.005.patch, HADOOP-12756.006.patch, HCFS
> User manual.md, OSS integration.pdf, OSS integration.pdf
>
>
> Aliyun OSS is widely used among China’s cloud users, but currently it is not
> easy to access data laid on OSS storage from user’s Hadoop/Spark application,
> because of no original support for OSS in Hadoop.
> This work aims to integrate Aliyun OSS with Hadoop. By simple configuration,
> Spark/Hadoop applications can read/write data from OSS without any code
> change. Narrowing the gap between user’s APP and data storage, like what have
> been done for S3 in Hadoop
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
