runzhiwang opened a new pull request #692: HDDS-3168. Improve read efficiency by merging a lot of RPC call getContainerWithPipeline into one URL: https://github.com/apache/hadoop-ozone/pull/692 ## What changes were proposed in this pull request? What's the problem ? 1. If download a big file, there will be a lot of RPC call `getContainerWithPipeline` at https://github.com/apache/hadoop-ozone/blob/master/hadoop-ozone/ozone-manager/src/main/java/org/apache/hadoop/ozone/om/KeyManagerImpl.java#L703. 2. Use jaeger trace the download operation. Download 187MB will be splited into 24 GET requests, each request will send 24 RPC call `getContainerWithPipeline`, the average cost of 24 GET requests is about 57 ms.   How to fix ? 1. I merge the 24 RPC call `getContainerWithPipeline` into one by `getContainerWithPipelineBatch` 2. Use jaeger trace the download operation. The average cost of 24 GET requests is about 47 ms, improve about 17%   ## What is the link to the Apache JIRA https://issues.apache.org/jira/browse/HDDS-3168 ## How was this patch tested? Change existed UT to test it.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: ozone-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: ozone-issues-h...@hadoop.apache.org
