[
https://issues.apache.org/jira/browse/HADOOP-15616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16824348#comment-16824348
]
Steve Loughran commented on HADOOP-15616:
-----------------------------------------
Just taken a quick look. First, I need to warn you that all object store
patches take a while to get in, as its a long-term commitment to maintaining
them. So we have to worry about testability as well as actual implementation
code. I've just looked at the test code.
* All tests against the live store should have the prefix ITest, not Test, and
set up so that they run in the mvn verify stage. And all which can run in
parallel do so, for performance. Look at hadoop-azure and hadoop-aws for
examples here.
* If your store doesn't support append, don't bother with the subclass to skip
it.
* But do add tests for the other core contract operations, such as
{{AbstractContractGetFileStatusTest}}, {{AbstractContractDistCpTest}} and
ideally, {{FSMainOperationsBaseTest}}.
I'm too overloaded with commitments to stand a chance of reviewing these, and
not set up to test. [~djp] -can you commit some time to this?
> Incorporate Tencent Cloud COS File System Implementation
> --------------------------------------------------------
>
> Key: HADOOP-15616
> URL: https://issues.apache.org/jira/browse/HADOOP-15616
> Project: Hadoop Common
> Issue Type: New Feature
> Components: fs/cos
> Reporter: Junping Du
> Assignee: YangY
> Priority: Major
> Attachments: HADOOP-15616.001.patch, HADOOP-15616.002.patch,
> HADOOP-15616.003.patch, HADOOP-15616.004.patch, HADOOP-15616.005.patch,
> HADOOP-15616.006.patch, HADOOP-15616.007.patch, HADOOP-15616.008.patch,
> HADOOP-15616.009.patch, Tencent-COS-Integrated-v2.pdf,
> Tencent-COS-Integrated.pdf
>
>
> Tencent cloud is top 2 cloud vendors in China market and the object store COS
> （[https://intl.cloud.tencent.com/product/cos]） is widely used among China’s
> cloud users but now it is hard for hadoop user to access data laid on COS
> storage as no native support for COS in Hadoop.
> This work aims to integrate Tencent cloud COS with Hadoop/Spark/Hive, just
> like what we do before for S3, ADL, OSS, etc. With simple configuration,
> Hadoop applications can read/write data from COS without any code change.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
