[
https://issues.apache.org/jira/browse/HADOOP-19191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran resolved HADOOP-19191.
-------------------------------------
Resolution: Duplicate
Fixed in HADOOP-18679; there's an iceberg PR up to use the reflection-friendly
WrappedIO access point.
That feature will ship in hadoop 3.4.1; i would like a basic backport to
branch-3.3 where even though the full s3a-side backport would be impossible
(sdk versions...), we could at least offer the public API to all and the
page-size=1 DELETE call for S3, *without any safety checks*. it'll still save
some LIST calls and encourage adoption.
If you want to get involved there, happy to take PRs (under the original JIRA)
> Batch APIs for delete
> ---------------------
>
> Key: HADOOP-19191
> URL: https://issues.apache.org/jira/browse/HADOOP-19191
> Project: Hadoop Common
> Issue Type: New Feature
> Components: fs
> Reporter: Alkis Evlogimenos
> Priority: Major
>
> Add batch APIs with for delete to allow better performance for object stores:
> {{boolean[] delete(Path[] paths);}}
> The API should have a default implementation that delegates to the singular
> delete. Implementations can override to provide better performance.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
