[
https://issues.apache.org/jira/browse/HADOOP-16906?focusedWorklogId=548808&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-548808
]
ASF GitHub Bot logged work on HADOOP-16906:
-------------------------------------------
Author: ASF GitHub Bot
Created on: 05/Feb/21 18:54
Start Date: 05/Feb/21 18:54
Worklog Time Spent: 10m
Work Description: steveloughran opened a new pull request #2684:
URL: https://github.com/apache/hadoop/pull/2684
This is #2667 with an extra commit; my changes
* markdown spec (really needs outputstream.md in, but...)
* stats collected on invocations of abort and multpart uploads
-counters and durations
* stats of streams propagated to filesystem in abort()
* tests use stats to verify what happens
* verify that aborted stream doesn't delete/overwrite an existing file
* oh, and FSDataOutputStream uses instanceof over ClassCast. and catch.
Consistent with the other uses.
Testing in progress.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 548808)
Time Spent: 2h 40m (was: 2.5h)
> Add some Abortable.abort() interface for streams etc which can be terminated
> ----------------------------------------------------------------------------
>
> Key: HADOOP-16906
> URL: https://issues.apache.org/jira/browse/HADOOP-16906
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs, fs/azure, fs/s3
> Affects Versions: 3.3.0
> Reporter: Steve Loughran
> Assignee: Jungtaek Lim
> Priority: Blocker
> Labels: pull-request-available
> Time Spent: 2h 40m
> Remaining Estimate: 0h
>
> Some IO we want to be able to abort rather than close cleanly, especially if
> the inner stream is an HTTP connection which itself supports some abort()
> method. For example: uploads to an object where we want to cancel the upload
> without close() making an incomplete write visible.
> Proposed: Add a generic interface which things like streams can implement
> {code}
> AbortableIO {
> public void abortIO() throws IOE;
> }
> {code}
> +do for s3a output stream. I wouldn't do this a passthrough on
> FSDataOutputStream because we need to consider what expectations callers have
> of an operation being "aborted"
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
