EnricoMi commented on PR #8306:
URL: https://github.com/apache/hadoop/pull/8306#issuecomment-4223921515
@deepujain how did you test this?
Did you run `ITestS3ADeleteNonEmptyDirectoryCapability` against your VAST S3
endpoint?
Did you
1. set `fs.s3a.delete.non-empty-directory.enabled` to `true`?
2. set `fs.s3a.client.s3.custom.headers` to `x-amz-delete-contents=true`?
With 1., obviously, assertions in tests `testDeleteDeepEmptyDir`,
`testDeleteNonEmptyDirRecursive` and `testCapabilityDisabledByDefault` fail.
This is expected because dirs still exist after deletion fails silently.
With 1. and 2., non-delete requests fail for me with `Invalid Argument`
(`fs.delete` involves non-delete requests):
```
org.apache.hadoop.fs.s3a.AWSBadRequestException: List vask-bucket:/test/
delimiter=/ keys=2 requester pays=null on /:
software.amazon.awssdk.services.s3.model.S3Exception: Invalid Argument
(Service: S3, Status Code: 400, Request ID: 31f13100005f19, Extended Request
ID: 31f13100005f19) (SDK Attempt Count: 1):InvalidArgument: Invalid Argument
(Service: S3, Status Code: 400, Request ID: 31f13100005f19, Extended Request
ID: 31f13100005f19) (SDK Attempt Count: 1)
at
org.apache.hadoop.fs.s3a.S3AUtils.translateException(S3AUtils.java:271)
at org.apache.hadoop.fs.s3a.Invoker.retryUntranslated(Invoker.java:481)
at org.apache.hadoop.fs.s3a.Invoker.retryUntranslated(Invoker.java:431)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.listObjects(S3AFileSystem.java:3106)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.s3GetFileStatus(S3AFileSystem.java:4096)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.innerGetFileStatus(S3AFileSystem.java:3987)
at
org.apache.hadoop.fs.s3a.S3AFileSystem$MkdirOperationCallbacksImpl.probePathStatus(S3AFileSystem.java:3846)
at
org.apache.hadoop.fs.s3a.impl.MkdirOperation.probePathStatusOrNull(MkdirOperation.java:216)
at
org.apache.hadoop.fs.s3a.impl.MkdirOperation.getPathStatusExpectingDir(MkdirOperation.java:237)
at
org.apache.hadoop.fs.s3a.impl.MkdirOperation.execute(MkdirOperation.java:134)
at
org.apache.hadoop.fs.s3a.impl.MkdirOperation.execute(MkdirOperation.java:59)
...
```
This is against VAST 5.4.3.1.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
