Chao Sun created HADOOP-19323:
---------------------------------
Summary: ABFS: Add a new API in AzureBlobFileSystem to allow
listing with startFrom
Key: HADOOP-19323
URL: https://issues.apache.org/jira/browse/HADOOP-19323
Project: Hadoop Common
Issue Type: Improvement
Reporter: Chao Sun
Currently the API to list from a certain starting point is hidden inside
{{{}AzureBlobFileSystemStore{}}}, and is hard to access. It'd be better to
surface this up to places like {{AzureBlobFileSystem}} to make it easier to
use.
The API is useful in scenarios such as Delta Lake where transaction logs are
always indexed sequentially. With this API, the listing in Delta no longer
needs to listing the whole {{_delta_log}} directory but only a small subset.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
