[
https://issues.apache.org/jira/browse/HADOOP-19622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18050335#comment-18050335
]
ASF GitHub Bot commented on HADOOP-19622:
-----------------------------------------
anujmodi2021 opened a new pull request, #8168:
URL: https://github.com/apache/hadoop/pull/8168
Backport PR for following commits in trunk:
1566613c725979d0ccda45822dfa275cbd97467a
2e9ef96d8f4e91e5861f42b073c2a92bc98bb49f
JIRA: https://issues.apache.org/jira/browse/HADOOP-19650
### Description of Original PR
Implementing ReadBufferManagerV2 as per the new design document.
Following capabilities are added to ReadBufferManager:
Configurable minimum and maximum number of prefetch threads.
Configurable minimum and maximum size of cached buffer pool
Dynamically adjusting thread pool size and buffer pool size based on
workload requirement and resource utilization but within the limits defined by
user.
Mapping prefetched data to file ETag so that multiple streams reading same
file can share the cache and save TPS.
For more details on design doc please refer to the design doc attached to
parent JIRA: https://issues.apache.org/jira/browse/HADOOP-19596
### How was this patch tested?
> ABFS: [ReadAheadV2] Implement Read Buffer Manager V2 with improved
> aggressiveness
> ---------------------------------------------------------------------------------
>
> Key: HADOOP-19622
> URL: https://issues.apache.org/jira/browse/HADOOP-19622
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/azure
> Affects Versions: 3.5.0, 3.4.1
> Reporter: Anuj Modi
> Assignee: Anuj Modi
> Priority: Major
> Labels: pull-request-available
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
