[
https://issues.apache.org/jira/browse/HADOOP-19801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18056436#comment-18056436
]
Steve Loughran commented on HADOOP-19801:
-----------------------------------------
well, *someone* (and it is not going to be me) would have to
* provide an alternative to org.apache.hadoop.fs.s3a.impl.DeleteOperation which
did just the root delete
* an option to enable
* changes to those tests which measure #of deletes issued and assert that when
the relevant option was set (filesystem path capability probe) the files were
all delete at the cost of one operation.
presumably you refer to this?
https://kb.vastdata.com/documentation/docs/using-trash-folder-for-s3-objects-6
Rename could be tuned too, as they've extended that too
https://kb.vastdata.com/documentation/docs/en/renaming-objects-1
> Allow to skip recursive file deletion for non-empty directory
> -------------------------------------------------------------
>
> Key: HADOOP-19801
> URL: https://issues.apache.org/jira/browse/HADOOP-19801
> Project: Hadoop Common
> Issue Type: New Feature
> Components: hadoop-aws
> Reporter: Enrico Minack
> Priority: Major
>
> A non-empty directory, as well as a directory where its emptiness is unknown,
> is deleted by listing all contained files (or objects with matching key
> prefix), then deleting those files (objects) in bulk delete requests, and
> finally deleting the (then) empty directory itself.
> The recursive deletion of objects is not needed for S3 endpoints that support
> deleting non-empty directories (or path prefixes).
> For example: The [VAST S3 endpoint supports deleting non-empty
> directories|https://support.vastdata.com/s/document-item?bundleId=vast-cluster-administrator-s-guide4.7&topicId=managing-access-protocols/s3-object-storage-protocol/s3-client-features.html&_LANG=enus]
> with a single request. Such a feature can only be fully leveraged if
> {{hadoop-aws}} coupd skip the recursive deletion.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
