[
https://issues.apache.org/jira/browse/HADOOP-18695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17711534#comment-17711534
]
ASF GitHub Bot commented on HADOOP-18695:
-----------------------------------------
steveloughran opened a new pull request, #5548:
URL: https://github.com/apache/hadoop/pull/5548
Adds a new subclass of AuditFailureException,
AuditOperationRejectedException to indicate audit rejection of the operation.
This is mapped to a new PathIOE subclass, UnsupportedRequestException, in
the method AuditIntegration.translateAuditException(), so avoiding making
S3AUtils.translateException even more complicated.
New test ITestS3AHugeFilesNoMultipart extends the huge file test to verify
rename worked, and that it is correctly rejected if the part size is too small.
Contains
HADOOP-18698 S3ABlockOutputStream doesn't collect stats on multipart block
uploads
This adds a new DurationTrackerFactory parameter to
WriteOperation.uploadPart()
and the S3AFileSystem equivalent; all callers updated to collect duration
of this in their IOStatistics.
### How was this patch tested?
new unit tests + new ITest
### For code changes:
- [X] Does the title or this PR starts with the corresponding JIRA issue id
(e.g. 'HADOOP-17799. Your PR title ...')?
- [ ] Object storage: have the integration tests been executed and the
endpoint declared according to the connector-specific documentation?
- [ ] If adding new dependencies to the code, are these dependencies
licensed in a way that is compatible for inclusion under [ASF
2.0](http://www.apache.org/legal/resolved.html#category-a)?
- [ ] If applicable, have you updated the `LICENSE`, `LICENSE-binary`,
`NOTICE-binary` files?
> S3A: reject multipart copy requests initiated by transfer manager when
> disabled
> -------------------------------------------------------------------------------
>
> Key: HADOOP-18695
> URL: https://issues.apache.org/jira/browse/HADOOP-18695
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs/s3
> Affects Versions: 3.4.0
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Minor
>
> follow-on to HADOOP-18637 and support for huge file uploads with stores which
> don't support MPU.
> * prevent use of API against any s3 store when disabled, using logging
> auditor to reject it
> * tests to verify rename of huge files still works (by setting large part
> size)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
