[
https://issues.apache.org/jira/browse/HADOOP-16916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17100297#comment-17100297
]
Thomas Marqardt commented on HADOOP-16916:
------------------------------------------
I updated PR 1965 with the following:
1. With hierarchical namespace disabled, some list operations were failing. It
turns out that when it is disabled, the directory query parameter used by the
List Paths API must not start with a forward slash '/'. The continuation token
was also affected by this, so I have fixed both of these issues.
2. With hierarchical namespace disabled, the
ITestAzureBlobFileSystemAuthorization tests that use ACLs were missing
Assume.assumeTrue(this.getFileSystem().getIsNamespaceEnabled()) so I have added
that.
3. I changed the default for fs.azure.enable.check.access back to false. We
will wait for the next release of ADLS Gen2 REST API before changing this
to true.
My USWest2 account with namespace disabled:
$mvn -T 1C -Dparallel-tests=abfs -Dscale -DtestsThreadCount=8 clean verify
Tests run: 63, Failures: 0, Errors: 0, Skipped: 0
Tests run: 432, Failures: 0, Errors: 0, Skipped: 244
Tests run: 206, Failures: 0, Errors: 0, Skipped: 24
My USWest2 account with namespace enabled:
$mvn -T 1C -Dparallel-tests=abfs -Dscale -DtestsThreadCount=8 clean verify
Tests run: 63, Failures: 0, Errors: 0, Skipped: 0
Tests run: 432, Failures: 0, Errors: 0, Skipped: 41
Tests run: 206, Failures: 0, Errors: 0, Skipped: 24
My eastus2euap test account with namespace enabled:
$mvn -T 1C -Dparallel-tests=abfs -Dscale -DtestsThreadCount=8 clean verify
Tests run: 63, Failures: 0, Errors: 0, Skipped: 0
Tests run: 432, Failures: 0, Errors: 0, Skipped: 41
Tests run: 206, Failures: 0, Errors: 0, Skipped: 24
My eastus2euap test account with namespace enabled and Delegation SAS tests
enabled:
$mvn -T 1C -Dparallel-tests=abfs -Dscale -DtestsThreadCount=8 clean verify
Tests run: 63, Failures: 0, Errors: 0, Skipped: 0
Tests run: 432, Failures: 0, Errors: 0, Skipped: 33
Tests run: 206, Failures: 0, Errors: 0, Skipped: 24
> ABFS: Delegation SAS generator for integration with Ranger
> ----------------------------------------------------------
>
> Key: HADOOP-16916
> URL: https://issues.apache.org/jira/browse/HADOOP-16916
> Project: Hadoop Common
> Issue Type: New Feature
> Components: fs/azure
> Affects Versions: 3.2.1
> Reporter: Thomas Marqardt
> Assignee: Thomas Marqardt
> Priority: Minor
> Attachments: HADOOP-16916.001.patch
>
>
> HADOOP-16730 added support for Shared Access Signatures (SAS). Azure Data
> Lake Storage Gen2 supports a new SAS type known as User Delegation SAS. This
> Jira tracks an update to the ABFS driver that will include a Delegation SAS
> generator and tests to validate that this SAS type is working correctly with
> the driver.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
