Manish Bhatt created HADOOP-19946:
-------------------------------------
Summary: ABFS: Enable data locality aware reads for Azure Blob
Storage
Key: HADOOP-19946
URL: https://issues.apache.org/jira/browse/HADOOP-19946
Project: Hadoop Common
Issue Type: New Feature
Components: fs/azure
Reporter: Manish Bhatt
Assignee: Manish Bhatt
Introduce data locality support in ABFS to improve read performance for Azure
Blob Storage by routing read requests to the endpoint that hosts the required
data range. The goal is to reduce latency, improve throughput, and make read
operations more efficient for large files and distributed workloads. This work
adds blob layout discovery, range-to-endpoint mapping, locality-aware range
selection, and caching of layout metadata to avoid repeated lookups. It also
enables segmented read-ahead aligned with locality boundaries and adds
safeguards for concurrency, eviction, timeout handling, and failure propagation
needed for reliable production-scale reads.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
