[
https://issues.apache.org/jira/browse/HADOOP-18337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17566287#comment-17566287
]
Steve Loughran commented on HADOOP-18337:
-----------------------------------------
the alibaba committer, looks like it is based on the magic committer design,
which is good as it is correct (apart from the implementation bugs listed in
the paper)
has anyone used it? does it create a _SUCCESS file with summary json?
> Supporting performant output committers for Aliyun
> --------------------------------------------------
>
> Key: HADOOP-18337
> URL: https://issues.apache.org/jira/browse/HADOOP-18337
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs/oss
> Affects Versions: 3.3.3
> Reporter: Ujjawal Kumar
> Priority: Minor
>
> Due to the non-performant rename on OSS (similar to s3), zero-rename output
> committer (similar to HADOOP-13786 which provides this for S3) can be added
> for Aliyun as well. I see [similar output committer provided by Alibaba's E
> MapReduce
> platform|https://www.alibabacloud.com/help/en/e-mapreduce/latest/use-jindo-job-committer]
> but it's not available in open source
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
