[
https://issues.apache.org/jira/browse/HDFS-13713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16652272#comment-16652272
]
Steve Loughran commented on HDFS-13713:
---------------------------------------
Interesting. Are you seeing that ordering against AWS S3 or just with WDC S3?
It may be something different
What happens if I go
{code}
nit 1
init 2
putpart 1
complete 1
{code}
Here #2 is never completed, MPU #1 is. I'd expect it to be visible, yes? (we
should test that too, maybe) So its the complete #2 call which is resetting the
other pending upload, not the put commands.
FWIW, I suspect that AWS will still bill you for those uncommitted parts, even
if complete() simply discards the parts.
Irrespective of that, yes, looks like something which may vary with
implementations.
How about we say
if you attempt >1 MPU to the same dest then it may be rejected, or it may be
accepted. In the latter case, which upload becomes visible after the first
completes
> Add specification of Multipart Upload API to FS specification, with contract
> tests
> ----------------------------------------------------------------------------------
>
> Key: HDFS-13713
> URL: https://issues.apache.org/jira/browse/HDFS-13713
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: fs, test
> Affects Versions: 3.2.0
> Reporter: Steve Loughran
> Assignee: Ewan Higgs
> Priority: Blocker
> Attachments: HADOOP-13713-004.patch, HADOOP-13713-004.patch,
> HADOOP-13713-005.patch, HADOOP-13713-006.patch, HADOOP-13713-007.patch,
> HDFS-13713.001.patch, HDFS-13713.002.patch, HDFS-13713.003.patch,
> HDFS-13713.008.patch, multipartuploader.md
>
>
> There's nothing in the FS spec covering the new API. Add it in a new .md file
> * add FS model with the notion of a function mapping (uploadID -> Upload),
> the operations (list, commit, abort). The [TLA+
> mode|https://issues.apache.org/jira/secure/attachment/12865161/objectstore.pdf]l
> of HADOOP-13786 shows how to do this.
> * Contract tests of not just the successful path, but all the invalid ones.
> * implementations of the contract tests of all FSs which support the new API.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
