omar opened a new pull request, #623:
URL: https://github.com/apache/arrow-rs-object-store/pull/623
# Which issue does this PR close?
Closes #461.
# Rationale for this change
Implements `list_with_offset` support for Azure/ADLS. See #461 for more
details.
# What changes are included in this PR?
Besides adding support for `list_with_offset` for Azure, I've also added
some tests to codify that `list_with_offset` always assumed the response did
not include the offset value provided.
Previously, this was implied because S3/GCP `list_with_offset` operations
were exclusive. However, Azure's implementation is inclusive (i.e. it returns
the offset value if found).
The Azure implementation handles the exclusivity client side by removing the
offset key in the response before handing it off to the crate's internal
structs.
# Are there any user-facing changes?
No user-facing changes for non-Azure users.
For Azure users, `list_from_offset` behaves differently now.
- Before: `list_from_offset` defaulted to the underlying `list_from` method
which returned everything ignoring `offset` value.
- After: `list_from_offset` now uses a `startFrom` parameter set to the
value of the offset. See
https://learn.microsoft.com/en-us/rest/api/storageservices/list-blobs?view=rest-storageservices-datalakestoragegen2-2019-12-12&tabs=microsoft-entra-id#uri-parameters
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
