anujmodi2021 opened a new pull request, #8168: URL: https://github.com/apache/hadoop/pull/8168
Backport PR for following commits in trunk: 1566613c725979d0ccda45822dfa275cbd97467a 2e9ef96d8f4e91e5861f42b073c2a92bc98bb49f JIRA: https://issues.apache.org/jira/browse/HADOOP-19650 ### Description of Original PR Implementing ReadBufferManagerV2 as per the new design document. Following capabilities are added to ReadBufferManager: Configurable minimum and maximum number of prefetch threads. Configurable minimum and maximum size of cached buffer pool Dynamically adjusting thread pool size and buffer pool size based on workload requirement and resource utilization but within the limits defined by user. Mapping prefetched data to file ETag so that multiple streams reading same file can share the cache and save TPS. For more details on design doc please refer to the design doc attached to parent JIRA: https://issues.apache.org/jira/browse/HADOOP-19596 ### How was this patch tested? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
