fenixjin commented on PR #6613: URL: https://github.com/apache/ozone/pull/6613#issuecomment-2575932018
> > Test conducted on our cluster(3DN / HDD / 10 Gigabit network) shows this improvement can boost read speed by at least 30%. > > > It can be seen that for 1GB file reading, streaming reading can reduce the reading time by about 30%. > > Hi @chungen0126 @guohao-rosicky, do we know how much of an improvement is being seen for files smaller than 1GB? @ptlrs conducted test using freon on the latest version of this pr, hardware is 3DN / HDD / 10 Gigabit network, tested file sizes are 1GB 128MB 16MB 2MB 256KB. there is an index bug when verifying checksum, tests were conducted after fixing it. here are the redunctions in mean read time given by freon： - 1GB: 7% - 128MB: 10% - 16MB 8% - 2MB 10% - 256KB 8% -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
